In answer to your question, "can you get much erosion?", YES.
Look at Thread 158-171016 for some discussion of proper filter for these drain systems. This subject also is in many other threads.
I suspect that your job was not put is as you describe, or if so, the water comes from the side, not passing down thru the sand over the stone fill.
That coarse stone fill is not a filter and, with sufficient water flow, plenty of fines can get carried out from under the building.
I saw one case with one foot voids under the basement and 6 inch footing settlements in a year's time. At the outlet of the drain system there was a big delta. That's erosion.
The solution to doing it right is have the proper filter between all weeping soil and the drain pipe. More often than not, typical workmen will think that gravel is the best pipe backfill to use and your system will have much gravel in contact with weeping soil. I have fought this dumb work for years, since architects just don't know the mechanics of these systems.
Back to "what is a proper French Drain"? I don't know of a "Proper French Drain". because in my definieion it is a trench filled with coarse rock. That is destined to be a failure, since it is not filtering the fines from the soil. You are lucky it has worked this long.
The systems I am describing are "sub-drains", "footing drains", etc. but I never use the words "French drains, because, in my definition, that means coarse rock backfill, which means it will fail some day.
I find the easiest solution and relatively trouble free installation with well meaning workmen, is to say "no gravel allowed on the job". That way they can't do it their way. Use ASTM C-33 concrete fine aggregate (Concrete sand) for all backfill that will carry seeping water. If you use the black currugated plastic pipe, slotted, very little sand will enter the pipe. No clean outs are needed, since this will work forever. No filter sock needed either. They have been known to plug up and seal off those openings.