That office will be there in that building whether you are in it or not.

The only thing you’re saving is the power your computer would use and the miniscule amount of energy that it took to cool down your body heat and maybe an elevator if you go up at all by yourself