Why are the tiles going wrong way of where I want to move them

This problem has gotten worse in the last week, I've lost so many lives and it's really frustrating. Now I've figured out it's nothing to do with my mouse, it also happens on my touch pad. I don't get it, is it me or the game? Sometimes I carefully swipe which ever direction I want them to go and I can clearly see them going the wrong way. I know for a fact I haven't moved the cursor a fraction up or down, I go sideways, but the tiles still go up/down.
I've not only lost lives, I've lost rainbow row advantages. I'm furious.

Please fix this !!!