there is a difference between just building material, and the building component, be careful. for a window for example you have the glass U-value, but that doesn't take into account the frame. So you need the overall U-value. For a stud wall you need to take into account the studs (metal, wood) and the insulation in between. Our code has some calculation procedure how to account for that. Surprisingly your R-19 insulation maybe gives you an R-11 wall, or so. If you have bricks, there is a brick and the mortar joint. with highly-insulating bricks that can make a huge difference to have those thermal bridges.
now I don't know what manual J gives you, that is fr residential calculations. There should be an explanation in the manual. Maybe manually calculate the R-value of a composite wall, and compare it to Manual J? then you know how they did it. Possible Manual J gives some slack for other thermal bridges, in corners, around openings etc.
As said before, air infiltration can be the dominant heat load anyway.
Finally people know the most awesome movie ever. Just imagine early 80's before computers and those special affects. there is a sequel book (die Festung - the fortress) where the war correspondent is in France after D-day. Actually all a true story by Lothar Günther Buchheim, the war correspondent.