No time. 3 Advil.
What do I do to get rid of them??? Those suckers are still swarming out there. There must be a thousand!
Thank goodness Molly was spared.
Are they yellow jackets?
Sounds like yellow jackets, so I'll tell you what I know about yellow jackets. First, never squash a yellow jacket. Always spray them. They have the same pheremone as killer bees; when one is squashed or stings, the others swarm. That's why you are usually stung by multiple yellow jackets.
As for getting rid of them, find a safe place to observe them right now, while it's still daylight. You'll see them going back and forth from one or two places in the ground. Make a mental note of exactly where they are going.
They will go to bed when the sun goes down. You can either go out then, or wait until early in the morning before full light. Take 2 cans of some sort of yellow jacket spray (I strongly recommend the kind that foams) and a 20-oz. Coke bottle without the cap. (The shape of the Coke-product bottles works best because they don't round off at the neck; they're tapered.) Wear gloves.
Take a long hard look at the hole, take a deep breath, gather your courage, take the lids off both cans of spray, spray the hell out of that hole (use the whole can) and jam the bottle in the hole. If you have a bag of mulch or something to hold the bottle in place, even better. (The second can is for personal defense in case one was out of the hole on potty break.) Be ready to run.
If there are two holes, this is best done as a 2-person assault.
DO NOT USE GASOLINE! It will kill all your plants.
Good luck. I hate them little buggers. Hate 'em!
...that is awful and so scary! Yes, I did follow the directions I found online. I scrapped the bites with a credit card, washed the sites and applied a sting stick that had ammonia in it and took some Advil and a Zyrtec. I am now sitting on a cold compress. 
