I am very rarely wound up as a driver or pedestrian - I’ll often let people out, cross or whatever.
The only time I ever get irked is if I let another driver out and they don’t acknowledge it. Pedestrians are at risk, so while it’s appreciated I don’t get annoyed by it and wouldn’t expect them to run across the road or anything.
Cyclists that don’t obey the basic rules of human decency (so - all cyclists) do boil my piss a little. Like when they go through reds or over zebra crossings/weave through people crossing just because they don’t want to have to brake/stop and then pull away again.