the data on magicseaweed can be deceiving since, they are showing the significant wave height for an area rather than sorting out individual swells. This is a good value for mariners in the open ocean, but not ideal for surf at the beach.

So, what you are seeing is swell that is pointed out to sea away from the coast.