I've heard a "rule of thumb" that you should have at least six full turns on the lug nuts for them to be secure. That's one thing you can check to see if you're okay right now. If you're not, I wouldn't risk driving on it. Not even around the block.
I assume you are using the "flat plate" kind of spacer, that looks like this:
Another solution is to get the kind of spacers that includes studs on it, like these 25 mm spacers from
Science of Speed, shown on the right:
Finally, as Mark notes, longer studs can also address this problem.
Science of Speed and
Dali Racing sell their 5 mm and 15 mm spacers as a kit that includes the longer studs. Dali also sells the longer studs separately, and SoS might, too; they're shown on Dali's website, but not on SoS's. When buying longer studs, just make sure that you either (a) get studs that are the proper length; if they're too long, the lug nuts won't hold the wheels on securely, or (b) replace your closed lug nuts with open end lug nuts to avoid this problem. (Open end lug nuts means that the threaded hole goes all the way through the lug nut, rather than having one end closed off.) If the latter, you will still have to make sure that the stud is not too long for the deepest socket you have.