I think the answer has to do more with design criteria than it does with specific differences between diesel and gasoline engine operation. Simply put, the typical diesel engine (and it's subcomponents) are designed and built to last longer than it's gasoline counterpart.
Assuming, for the sake of discussion, that both are "built to last", then we can take into account some operational concerns. The typical diesel engine sees more steady-state operation, over a narrower RPM range, than its gasoline cousin. This allows engineers to size turbos more accurately for a diesel application. This equates typically to more stable EGT temps, and lower turbine shaft speeds. Both of which aid in turbo longevity.
Regards,
Bryan Carter