believe it or not, earthquake engineering wasn't very well understood until recent times. As such, engineers mostly neglected the effects of lateral seismic loads until the codes began to descibe/mandate them.
For example, significant static equivalent lateral force for schools weren't required until after the 1933 Long Beach Earthquake in the US. It wasn't until the State of California effected the Fielding Act.
As a comparison, the equivalent static lateral force really was initiated in Europe following the Messina, Italy earthquake of 1908.
While its true that the equivalent static force method was in use prior to the 1933 Long Beach earthquake, the magnitude remained small. And until the Fielding act, I'm not sure it was mandatory. Hence, you can see the disparity on the two continents.
The response spectrum method wasn't developed until the 1940s and only after significant computational power was available. The latter was necessary to analyze all of the specific data available to arrive at the code definition of the RSA. As one may figure, that technology takes awhile to be absorbed by the engineering community. And to exacerbate matters, highway technology lags behind due to funding.
Thus you can see why only minimal lateral force values were in use until following the 1971 San Fernando event, which really showed the community just how bridges are vulnerable to strong ground motion.