I would suggest making a shaft with the smaller diameter section growing to a larger section that matches the curve then cutting the larger sections four flats with a single pocket.
1. "Sketch” a square to size with the desired “PAD” length.
2. Create a “Sketch” with the angle included & use “Groove” to remove the material on the solid. (The blend will create automatically)