Perhaps it's the irregularity of your working from home may contribute to this.

My parents were artists who both worked from home, it was generally established that I didn't bother them in their offices when they were working on their projects.

I am grateful to have grown up in such a situation and if in the future I decide to have children I will definitely switch to a primarily or entirely remote position.