Wow! Something similar happened to me, a house I had just bought had 20+ wasp nests under the roof eves and where roof sections joined together. The wasps even built one nest inside the kitchen ceiling vent and some were getting into the house from there which is how we originally discovered the wasps.
It took two weeks of killing off 2-3 nests a night at dusk after all the wasps had returned to finally get rid of them. One early evening I pulled a bush growing out of the roof and a live wasp nest came out with it. They chased me off the roof and I hit the ground running after jumping off the roof.
I hate wasp nests.