I might be stating the obvious here but firstly check that the tailstock is on the true centre, start off (after a centre drill) with a short drill and increase in length, don’t start with a long series, ensure all drills are correctly sharpened, if they are “one sided” this will cause wandering, don’t try and force the feed rate you drill at.
Even with all this I would say you are up against it, could you outsource to a specialist deep drilling company? Failing that drill the hole with sacrificial ends true up between centres.
Good luck.