Fear of not being seen at the meetings, fear of not being perceived as someone "necessary", fear that decisions will be made without you, that inside jokes won't include you. I once had a boss who evaluated people almost entirely by how busy they appeared, rather than by their actual work. I didn't last long with him.