The bulk of the noise is from the periodic impingement of the downwash (sidewash?) of the induced flow against the fin and tail boom. It's nice if the tip is not in the high subsonic to supersonic region as well. Eliminating the tail rotor is the best way to eliminate tail rotor noise, such as with the fan and slotted boom arrangement or dual counteracting main rotors.
I can't say as to how I have ever noticed that a majority of sound emitted from the tail rotor - it is usually the powerplant and the main rotor downwash impingement on the fuselage, at least to my ear.
The biggest consideration, past plain aerodynamic efficiency and effectiveness, is that tail rotors offer an excellent thing to strike trees, power lines, careless people walking around them, and that this often leads to an immediate disassembly of much of the remainder of the helicopter, either from uncontrolled spinning, flipping over, or by smashing into the ground.