Old hospital engineering director here.
Yes, airboorne latex can be a problem for those allergic in an operating room. Without the protection that their skin provides (because of the surgical opening), the reaction can be severe.
Xera is right about the air exchange rate, and I agree with Mint that you need longer due to air change efficacy.
The nurses running the OR where I worked would typically assign any such cases to a room known to have had no latex for 24 hours, and to have also been through terminal cleaning (everything rinsed, dried, then sterilized with a bleach solution and wet-cleaned again). Any latex that settled on floor or equipment would be removed by the terminal cleaning procedures.
24 hours is probably overkill, but overkill is better than an allergic reaction by someone under anesthesia with their insides exposed. My opinion would be that it's OK to enter after the cleaning process is done and the room is dry, but the medical safety folks are, justifiably, the ones who decide.
Good on ya,
Goober Dave