If parking meters, traffic, drunks, drugs under boardwalk,smelly water, cops, games of chance, and artery clogging food is for you than you'll be alright. I'm not sure what answer you're looking for with the question but it's bad to paddle out between 9-5 (lifeguards) and its bad to paddle out if you aren't that skilled of a surfer because you will be escorted down the beach by either the current or the more skilled surfers. If you can hold your own have fun.
As long as you paddle out to the peak and respect the locals, you should be fine don't let people scare you...it's not pipeline. But it's true, dont paddle out of your going to fall or drop in on people and cause havic. Stay a little off the peak and catch some waves on the shoulder more towards the middle of the beach. Feel it out and then wait your turn to catch a wave closer to the pier.
If you paddle out and your not causing any issues, no reason for anyone to give you a hard time. If they do, just wait for them outside on the beach and knock a tooth out. Jk.
The line up is worse. People with scary tattoos and crusty local guys have it wired. Then there is that scary Sam Hammer guy...
That Hammer guy is a KOOK!!!!!! But hey if you can't make it out at the Park on a head high day its self evaluation time!!!! maybe you should adhere more closely to your office jobs absence policies..... for your own safety.