There are two cases where I would edit out LaTeX code:
- in titles
- in the main body if the formatting can be reproduced entirely with Markdown
Titles are also displayed on SE sites that don't have MathJax enabled, they should generally not contain any LaTeX code unless absolutely necessary. This is a site rule and everyone should follow it.
Using the LaTeX formatting leads to a short delay before display, especially on slow devices like mobile phones. It shouldn't be used without need. So simply using it to display numbers like $1$, $2$ is something I would edit out.
In your example the formatting without LaTeX is not equivalent. I might use the non-LaTeX version in my own posts, but I wouldn't edit such cases in the posts of other users. This is a case where it comes down to preference, and there are no hard rules established so far.