Yes, they always flew with them.
But you have answered your own question about whether they always wore them; depends on the altitude of the operation being flown. As you say, comms were via a throat mic so no need to wear the oxy mask, or have it front of your mouth, to send messages.