Single pilot IFR flight is a lot of work. Pilots can get disoriented when it's rough and there are no outside references. It just jams your brain up with your instruments tell you opposite things and you are busy. Rapid changes can really mess you up fast.
It's really not even feasible in an airplane that doesn't have a decent autopilot to pick up the workload when you get tired. Realize that the 3D geometry of everything you are doing has to live in your head as you fly it. Confuse the R turn to heading 130 with a L turn to heading 230 and bam, you die on the granite cloud.
IFR flight in solid IMC conditions with low minimums near challenging terrain is a very bad idea if you don't have a very reliable airplane, great avionics, good automation and at least two pilots. Even then sometimes the situation demands you de-automate, go missed to set up and fly again.
I've seen case reports where ATC requests runway and approach changes faster than you can enter the data and set up any FMS, much less brief the approach, brief the missed and be ready to fly a stable approach.
Equipment failures on the aircraft, engines and avionics can totally turn a busy under control situation into chaos.
This video is worth watching.
In theory, there is no difference between theory and practice however, experience suggests that in practice, there is!
My posts reflect my personal views and are not in any way endorsed or approved by any organization I'm affiliated with.