Ibeam,
The soil conditions for growing will be different than with no insulation. Because the insulation is rather shallow, the soil may dry out faster. Also, I'm not sure what problems one may have with roots damaging the insulation board (which of course you don't want), depending on the...