Make an essential oil mix of peppermint oil and eucalyptus oil, wasps hate the smell of both. I use this mix in the attic by way of an oil burner, after a week they've gone.

Please don't kill them as we need all the pollinators we can get.