I typically don't get my finished wort cooled as fast as I'd like. One time, I even left the covered fermenter overnight and pitched in the morning. So far, I haven't had any problems with infections in my beer, and everything has come out quite tasty.
If it were me, I would wait till your...