Yeah, I tried and Excel does that to me too, and surprisingly there don't seem to be any configurable options during the save or in the general program options to make it stop. Verry odd.
I typically use Planmaker from Softmaker which I like a lot better than Excel anyway. There at least they give you options during the save. Strangely, the default delimiter character is a Tab (in a Comma Separated Value file!!?), but they do let you set that as well as text identifier character. None vs. ' vs. " vs. Auto. Oddly, Auto defaults to putting in the extras.
Anyway, consider this an endorsement for Planmaker in general. You can get the free version, which is almost complete, although I bought it for a couple obscure features I need. Perpetual license is like $50 or something, rather than renting it for more than that each year.