It also depends on how the wall was designed. If it is a cantilever wall you may be correct. However, if it is a restrained wall and utilizes the slab above for support, I wouldn't recommend backfilling until the upper slab is in place and has reqached specified strength.