While tropical storms do develop in June and July it is not all that common. A typical year will have 2 or less storms during this time period. These storms typically form in the Gulf or Caribbean waters and do not become major hurricanes. The majority of major hurricanes develop from the tropical waves moving off of Africa.
So, yes, we are as quiet as can be, and yes the El Nino index seems to be on the rise (bad for tropical development), but no, all hope for fun hurricane swells should not be lost!