The most aggressive bees I tend to encounter are male carpenter bees. They are highly territorial and they’ll even buzz a human to scare them off. However, there’s no threat.
No threat of stinging, anyway. They will absolutely wreak havoc on a wood framed house.
bzzzzbzzzBZZZZZ
Yes, sir, I see you. I see your little pile of sawdust on the fence, too. No, I’m not going to screw with it. I’m just installing this gate latch."
bzzzbzbbzbbzbzbzbzbzzzzz
This would go a lot faster if I didn’t have to keep ducking.
BZZZZZZ
Okay, I’m done, jeez.
BZZZZZzzzbzzzzbzzzz
…aaaaand under the fascia board it goes. Shit.
As far as I’m aware, it’s the females that dig the holes in wood as a nesting chamber, not the males. So I don’t think the males are even a thread to a wood framed house.