This is due to C-Nb-P interactions which lead to phosphorus segregation at grain boundaries, reducing material toughness. High toughness and strength are retained when Nb/C < 6.
You can learn more from the article "Effect of phosphorus segregation on impact toughness variation in 17-4 precipitation hardened stainless steel", Scripta Metallurgica Volume 20, Issue 5 (1986), pages 713-716, available from ScienceDirect: