Actually, sometimes we don't mind it, as it props up our voltage at the end of long feeders, but...
1) Most 'legacy' utility revenue meters cannot distinguish between leading and lagging power factors and will charge you for a poor power factor either way.
2) Some of your facilities equipment may not like the impact of excessive VAR's furnished by capacitors, as they tend to aggrivate the impact of harmonics and cause the voltage to rise above nominal levels.