I just started bodyboarding last summer (besides kids stuff)

I went out last tuesday here in LI when we got that big swell. I never noticed my problem until i was riding these big waves. I keep sliding down the wave, but to the way that i am riding, and then end up labout 5 feet in front of the wave and i have to turn back to start riding the face

what am i doing wrong?