Your drive sound like a traditoinal "track" not designed for taking loads from large cars, vans or trucks.
To save building a drive with a proper sub-base and road make-up you could removed the top surface of the drive till the area is level across the drive, try and reduce the gradient of the road if possible, lay a geotextile to provide stability and build up a road using compressed quarry material finished with a tar spray and chip wearing layer. Alternatively you could use scarified road material (bitmac removed from the surface of an existing road to allow new wearing coarse to be laid). As contractors have to dump this material at high cost they are usually very keen to sell it cheap. Bitmac is normally (unless chemicals added) inert so using it for your drive would not be against regulation for reuse of material.
Having said that check with your local authority first. They may have bylaws inplace stating otherwise.