You're not alone. I know a few local guys that swear by them. I had a 6'0 that was a ton of fun, but mostly guys ride them in upper 6's on up to 8'0. Don't treat them like funboards (in terms of design/construction) and you can get a surprising amount of performance out of them.
My 6' quad egg is without a doubt my most used and favorite board. I've used it in everything from knee high slop to overhead Pacific juice. When I ride a HPSB ,I can still do almost everything I could do when I was a younger fitter guy. I just can't do it for hours on end. I tire out and start blowing waves. My egg helps me stay out and surf longer. You will lose a little bit when it comes to maneuverability but what you gain in paddling ability makes up for it.