Sincerely, Me discussion

I really liked the first three books in the series, but after reading the fourth one, I don't feel the need to continue because I'm SO annoyed by Voldemort and Hermione (please don't kill me), the plot is too complex and you need to remember everything to understand what's happening. I'll try to force myself through the other books because the world is quite cool, but I expected the series to be better when I decided to start with the series this summer. ;-;