That's definitely going to happen. The feature is absolutely terrible! If someone drops a hater comment, it will get a bunch of thumbs up and get pushed to the top of comments. That's why I disable commenting voting on my videos.