In practice, I don't think this makes a difference for any use case I'm concerned with, but it's really noticeable if you layer a bunch of tracks on top of each other, which some people have reasonable reasons for doing.
You can try to subtract this noise out in post, but that generally sounds significantly worse than not having the noise there in the first place (to the 1% of people who notice kind of thing).