The months from December to February are a good time to visit Alexandria. This time is sunny and pleasantly warm. Even in this pleasant climate, the sea water would be too cold to swim in. In the summers, there can be this dusty hot wind which can be bothering you.
The months from March to June (summer) can be humid, but the continuous breeze can be a help. The months of September and October are also a great time to visit Alexandria.