There have been some other threads on this forum about modal participation mass ratios (per the ETABS terminology). I'm not sure that anything covers your exact situation. But, I'd search for threads with "local modes", "lumped mass", "discretized mass" or similar terms.
In a case like this, where the mass is basically associated with the walls, you're going to get a lot of "local modes" associated with those walls. When I say "local modes" I mean modes that don't involve the majority of the structure... but rather a smaller portion of it. Like the portion of a wall between transvers supports vibrating by itself without really activating the lateral force resisting system.
There are lots of ways to deal with this.
a) You might choose to try Ritz Vectors instead of Eigen Vectors.... Which it looks like you've already done.
b) You might try to manually create a different mass source with a "discretized mass" that will reduce your local modes. This is essentially where you remove the self weight from that mass source and instead manually lump that mass at specific locations that capture the main spatial distribution of the mass... But, also minimize the local modes.
If I get a chance this weekend, I might look for some training materials I had for a training class on dynamics I used to teach (6+ years ago). It was for a different program. But, the concepts of discretizing the mass will be similar.