WASPS never swarm. If you see many wasps, they will be very close to their nest.
Queen wasps spend winter in hibernation and emerge in spring to build a nest and a new colony of wasps. She forages for nectar and pollen along with other pollinators, but adult wasps will catch insect food to nourish the larvae (this includes garden and domestic pests so there is a case for tolerating them).
The first worker wasps of the year become active 4-6 weeks after the queen has emerged from hibernation in April or May, depending on the weather.In autumn, new queen wasps emerge and mate then leave the nest to hibernate. Food for the workers diminishes and wasps become a nuisance as they scavenge for anything sweet, such as fallen fruit. Worker wasps do not survive winter.