tbf, that isn’t quite right.
I sometimes, on special occasions, answer my phone. Which irks the caller enormously because they will call constantly in the hope it is one of these special occasions, but they, and I, just don’t know if it is going to be one of those #specialtimes! Not answering the phone also annoys the rest of the office, probably.
I blanket out my calendar to “busy” every day, to stop people calling/emailing me, so I can concentrate which irks people a lot as well