Looking at the FV ratings you have supplied,I would use a 3-cell battery, in series.
Connect all the LEDs of a color in parallel, connect red LEDs between common and the the junction between the 2nd and 3rd batteries, white cells between the common and +ve of the third. Perhaps a low value...