I’m neither stressed nor confused by it, so don’t worry. You go to the gym loads and your fella plays golf all the time right? There’s your answer as to why your metabolism is quicker than mine.
Also I’m in my mid 30s now and I don’t really do any exercise outside of walking. Therefore I need to be careful about what I eat. We live and die by our choices, as with anything.