There are many factors to consider, there is not really any perfectly "correct" size.
First each runner must have enough volume to draw from so each cylinder is not going to rob the next, so bigger is better in that regard.
Also the plenum entry must not flow at high velocity directly across the face of some particular runners. If it does it can starve those cylinders of air, and they will run rich, while others further from the plenum entry will have excess air and run lean. A symmetrical plenum is going to be better than an end fed plenum as far as air distribution goes, all other factors remaining equal.
If you only have a single throttle body at the plenum entry, a large plenum is not going to help with throttle response or lag. A smaller plenum might be better in that regard. However, if you are planning on individual throttle bodies in each runner, it is going to have crisper throttle response with even a humongous plenum.
In practice you will always be limited by the available space and layout.
When tuning the induction on an n/a engine there are three tuning variables. The first is runner cross sectional flow area. This will be the strongest tuning variable and will effect the torque peak. The second variable is runner length. This can introduce tuning peaks and hollows into the torque curve, but the effect is not as strong as diameter. Plenum volume is a third variable that may (sometimes) be used to create an additional low speed tuning hump in the torque curve. The runner VOLUME, that is length x area, can combine with the air volume in the plenum to create Helmholtz resonance at a particular (usually low) frequency. Its a bit like the tuned port in your loudspeaker box. The volume of air in the runner, combined with the springiness of the air in the plenum causes the air in the runner to bounce like a spring.
This is not the same as tuned runner length which relies on the speed of sound. If you blow into a beer bottle you can get a low frequency droning sound which has a wavelength far longer than the size of the bottle. Look up "Helmholtz" in google for some formulas.