You need to go back to one of the oldest of the bunch "Naval Jelly".
It is H3PO4 based product and does a marvelous job with the greatest of ease. The H3PO4 products are excellent wash primers for some paints especially oil based, lacquers, and some epoxies. It made by nearly everyone Duro, Permatex, and Loctite to name a few.
The rust converters as mentioned above work mainly with reacting tannic acid or a salt with the iron oxide. They seem to work best with lite rust. I've had very poor luck with thicker rust scales. I've found that if you can knock off the loose stuff, treat it with Naval Jelly and let it age a day or so then apply the converter it work quite well with oil based paints.
Most H3PO4 products are a good wash primer for new steel. They work as stated above with most water based paints being excluded.