I'd say the tides will be a big factor, so I'm thinking if you get there in the late morning when that tide starts to come in then that might be your best shot.
The winds looks pretty calm for the early morning, and will likely come onshore during the day, but it looks like they'll stay fairly light at least for the first half of the day.
I'm probably going to make the DC drive Saturday morning, although that tide is really killing things. Probably get their early enough to catch a session, eat at low, then paddle back out. I wish that waist/stomach call had held for Sunday because that would have been a lot more relaxing. Leave late, catch the incoming tide, and don't worry about the winds picking up too bad. I'll take what I can get though...it's been waaaaaaaaaay to long and I want to get out at least once this year without a wetsuit.