That was actually my reaction the first time. A few years ago I picked up a VHS of it for a quarter and ended up feeling like I'd wasted my quarter because I couldn't watch the whole thing. IIRC, I got to the end but only because I fast-forwarded through much of it in that first and only viewing. (In other words, I basically quit watching it early on but wanted to see if it ever picked up and it didn't.)
That said, everyone calls The Empire Strikes Back the best of the Star Wars films but I almost always fast-forward through 90% of the Dagobah fortune-cookie scenes despite being enthralled by them in early viewings. It's still a good movie, but those scenes don't generally maintain interest anymore. (The first one was always my favorite anyway.)