Well, yeah, that was kind of my overall point... or rather I'd say that it's a collaboration between the DM and the player. But I do agree with the general point that weirdly arbitrary rules can jar you out of immersion. The thing is, you have to be immersed to begin with for that to matter.