i'm fairly certain that aci and/or ibc (not sure which one) mention construction tolerances. i suppose the trick would be figuring out if it was built out of whack and hasn't moved at all OR if it was built perfect and is now moving OR was built a little out of whack and is moving. i suggest you take measurements (from top to near bottom) with a plumbbob at intervals along the wall and record the data. come back at some time later at the same locations and see if it moves. if you know how old the wall is then you might be able to ballpark when the readings will provide indication that the thing is still moving (if it is indeed moving). you might also revisit the paper trail of inspection reports (footing, rebar, drainage materials, backfill materials, etc), foundation reports, design dimensions, etc.
realistically (for construction tolerances...not movement) from my perspective, a "good" wall is within a 1/2" or less and an "kinda sorta okay" wall is 1" or less for a 10' height. however, i have seen fairly strict construction tolerances from the EOR for CIP retaining walls.
and never take a contractor's word for anything...whether you actually know the answer or not...