> temperature is not some kind of "deterministic" switch, but rather it affects the sampling distribution (which becomes more "spiky"—but is still very much a distribution).

You're correct. The confusion arises because we use the word "non-deterministic" when we mean "probabilistic".

I tried to explain it better: https://www.lelanthran.com/chap15/content.html