To an extent, when it comes to your comings and goings, you have to become mentally resilient to what you feel are people's eyes on you. If you are doing a full working day, sticking to your allocated lunch breaks and getting everything completed on time, then there is no reason to feel 'guilted' into working long hours. Why should you have to pay for having the good sense to choose a workplace that's close to home, or vice versa?
If this expectation is voiced frequently then you may need to raise it with your manager. Even if just to clarify what nonsense it is and put your mind at rest. If these expectations are actually coming from your manager, then it's even more important to address the issue.
Without being glib - you win some you lose some. A tiny commute is your 'win', but other people's lives will be good in other ways. Don't let them make you pay for what you have. I'm sure you're doing a great job and your obvious generosity with your home and time show that you're a colleague to value rather than resent.
