Although the motor starters would be rated for less current, medium voltage switchgear is considerably more expensive to begin with because of the higher voltage involved. So from that standpoint I agree that 4160V would be slightly better than 2300V since the major cost jump is just to get to MV in the first place.
You also will need to decide on what level of protection you want. Whereas with LV gear you just have to decide on breakers or fuses as SCPDs, in MV it isn't as simple. Here is a grossly simplistic primmer on what you are in for:
MV Circuit Breakers are typically only available in "draw-out" format, called Metal Clad switchgear, where each controller has a separate cubical that can be withdrawn and isolated from the bus bars when it's necessary to work on the equipment. The individual metal enclosed compartments also serve to contain any fault energy to a limited area thus reducing the likelihood of collateral damage. Most people consider this to be the safest way to use MV equipment. But Metal Clad gear is extremely expensive and very large. A basic single starter, regardless of how small, is likely to start at US$80,000. the cost per unit goes down a bit if you have multiple starters in one location.
An alternative is to use Fused Load Interrupter Switch (FLIS) style motor starters. They are less expensive, typically under US$15,000 to start with for an Across-the-Line starter. The drawback to them is that they use fuses, which cannot be "reset" after a fault and require having spares on hand (a very old argument), plus they don't utilize a draw-out mechanism to provide the isolation; they rely upon an air gap switch. Some people do not consider this to be as safe as draw-out when dealing with MV equipment.
The lowest cost MV control gear is now a hybrid of sorts; Fused motor controllers that rely upon a vacuum contactor to interrupt a load, backed up by fuses as SCPDs, but with a switch that is NOT rated to interrupt power if opened under load, especially if it is a fault load. The switch is often on a truck assembly that can be racked out for service isolation however. The big drawback to that style is in the fact that IF someone were to panic and try to open the disconnect under load, it just might blow up on them (obviously I'm not a fan of that design).
So you really have a lot more homework to do before making that decision. Going to MV means making a leap of technology, not just deciding on what will be more efficient.
By the way, do you typically buy your own transformers or do you expect the utility to do that for you? If you are expecting the utility to supply MV to you at your terminals, check with them before deciding anything. Some utilities will only allow certain voltages in certain areas, usually because of what they have available as spares etc. for ongoing service.