I always follow what my heart says and do it. It can be difficult sometimes but it is worth it.
Try to look at the bigger picture, not what is temporary. Figure out what you want in the longer run and weed out things that does not bring any value to you.