I started off thinking Ulysses was a pile of incoherent drivel, even though I'd never got past the first page. At 20 I would sit in the uni bar getting pissed and slagging off literary types and lecturers who mentioned it (some of them were pretentious posers; some of them weren't). At 30 I decided to put up or shut up by actually reading it so that I could explain why it was incoherent drivel. The result was that I was drawn into it and have read it five times cover-to-cover. Like a lot of challenging literature, it requires a bit of life experience to get into.
If you're into stuff like this, you can read the full review.