Out of sight - out of mind

There are some people who I don't see very often. When the parting period is too long I even forget about there existance, and when it comes to meeting it seems to me that I hate them. It's quite strange as I tend to be tolerant but still there are things I can't cope with.