I agree. “Exclamation point” sucks all the fun out of it.

Duckduckgo calls it “bang” for their special searchbar commands (like !gi makes it route the search through Google images), and I think more people should use that term instead.