Actually, the factored loads are only used for the strength calculations -- unfactored loads should be used for deflection calculations.
LRFD designs yeild larger real world deflections because you can usually use smaller sections from a strength standpoint. Ie., if the ASD design says a...