Considering the load and speed conditions of your tests, I think you should have observed some black debris. They are called equiaxed particles and corespond to Regime 1 in the wear maps for Al alloys.
Wear and friction coefficient (FC) do not always correlate to each other. My experience is FC varies between 0.4 and 0.6 in the load and speed range you have used. FC goes above 0.6, some times even close to 1.0 when the load and speed are very high where heavy plastic deformation occurs.
Wear rate also increased linearly high with load or speed up to a point and above which wear mechanism (how wear debris are produced) changes from one type to another and wear rate could increase or decrease.
It is a complicated picture as there so many parameters involved.
Please refer to a good tribology book such as I.M. Hutchings.