What is your "Target Prestress" for the bolts? What are you using for lubrication (both between the bolt and the nut AND the nut face and the washer/flange face)?
The formula is:
T=F/2*(dn*fn+d2*((f2+cos(alpha)*tan(lambda))/(cos(alpha)-f2*tan(lambda))))
where:
T is the target torque
F is the target bolt tensile load
dn is the mean diameter of the nut
fn is the coefficient of friction between the bolt nut and the flange
d2 is the pitch diameter (or mean thread contact diameter)
f2 is the coefficient of friction between the bolt and nut threads
alpha is the thread flank angle
lambda is the lead angle
Note that for UN and UNR screw threads the flank angel is 30°, the lead angle is equal to atan(L/pi*d2) and L is equal to the pitch of the threads (for 8-thread series this would be 1/8 in)