Here are some of my controversial ideas math notation. Some of them are quite common, while others are my invention and objected to every time I bring them up.
Square root
This is how you write a square root.It has no hook at the end.
I prefer to avoid using the notation sin−1(x), since it's unclear if it refers to arcsin(x) or sin(x)1. Similarly, I like to write sin(x)2, which is completely inambiguous, rather than sin2(x).
Factorial of a real number
There's no reason why the notation x! couldn't be used for the factorial of a real number, which many people awkwardly write as Γ(x+1).
Logarithm
The notation log(x) should not be used since nobody agrees if it's base e, 10 or 2. Use ln, log10 or lg respectively.
Vertical parentheses
Vertical parentheses are useful to apply a diacritic to a complex expression. For example, dtd∂q˙j∂L can be succintly written as ∂q˙j∂L˙.
Extracting the limit
When dealing with limits, it often gets repetitive to write lim at the beginning. For example:
n→∞limn+2n+1=n→∞limn(1+n2)n(1+n1)=n→∞lim1+n21+n1=1+01+0=1
In this case, we can “extract the limit”:
n→∞lim(n+2n+1=n(1+n2)n(1+n1)=1+n21+n1)=1+01+0=1
This can also apply to other things.
Existence
The notation ∃n means “there exist exactly n”. For example, ∃1 is equivalent to (and harder to overlook than) ∃!, ∃∞ means “there exist infinitely many”, and ∃0 is the same as ∄.