Yep after having been there 3 times in my teens I can tell you unless there is a hurricane or you got a boat to find an outer reef it's flat! The reef ringing the island stops most surf and as said in the link winds play hell with the island.
Was there Aug 11-13 last year during a swell. EC got some but Bermuda was flat. Talked to a catamaran captain/surfer while cruising around the island. Said they don't get much but when they do its on the reefs. Tried prying for more info, but wasn't cool to give up any secret spots.