Artisi,
Different types of slurries behave quite differently in piping. For a well-suspended fine slurry, the wearing in pipe is normally not a major concern for friction, or as you said, it even polishes the pipe surface. For heavier and larger solid slurries, it can be totally different. The velocity is higher because of greater critical velocity to suspend the solids. Sliding on the bottom of pipe, gouging, impact can all become problems. Erosion and abrasion can be very serious. The pipe wall surfaces do get rougher in many services. I did see sliding lines in a coal power plant discharge pipe (not remember how many years' use) where the slag particles have very sharp edges (the velocity might be not high enough since there was a sliding bed obviously). It's up to you to say it was fines handling or coarse one but the average solid size is below 1mm (do not remember exactly how much).
The behaviors on pump impellers are also quite different. You are right, we only use rubber-lined pumps for fines handling (<5~6mm as a rule of thumb) , but it's not because the fine slurry has greater wear rate (which is not necessarily true - see next paragraph). Rubber liner has a better wear-resistance than steel, but it's bad at to impact, gouging, edge-cutting, which are major problems in the coarse applications.
When we come to check if the fines or coarse solids have greater wear rate, let's go to visit some mining process plants where they bought all steel impellers for all slurry services since some major suppliers (GIW is one) only supply steel impellers. The grinding circuits handle coarse ore and flotation circuits and tailing pumps handle finer solids. The impellers in grinding pumps have normally two months to six months life and casing may double the impeller life. The minimum impeller life for flotation and tailing pumps are over a year as I know (many last for mine life). Although lower solids percentage in flotation can be a major factor, but many final tailings get close solid percentage to grinding and life is still much longer. There are also many other factors affecting the impeller life, so I do not want draw a conclusion here as what kind of slurry will have greater wear rate.