I don't see the swastika. All I see is a building that faintly resembles like, one half of one, and that looks like it was mostly blown up by an explosion or something.
It's really not that big of a deal. The swastika just got a bad name because of the Nazi's. It's actually just a religious symbol. Sure the Navy doesn't have any ties to a religion, but it probably serves some point.
Pink triangles and rainbows have been adopted by the homosexual community; but you don't see the Navy taking up that banner (this 'mans' Navy and all).