Well, my point is that it's not considered a u, and Austrian and Swiss don't use it.

It's true that u and ü are very different things in German orthography, but it must be some bizarre misunderstanding that ü wouldn't be used in Austria or Switzerland, the largest city in Switzerland is even named Zürich in German (Züri in Swiss German).