High groundwater can impact the design, construction and maintenance of each of those.
Pavement:
Groundwater within about 18 inches of a flexible pavement base material will can reduce the structural life of the pavement. The design should accommodate groundwater level control through fill, underdrains, swales or a combination of these. Rigid pavement is less sensitive to high groundwater but is still affected if the subbase support to the concrete is compromised.
Storm sewers:
The most significant problems here are construction (getting the piping in place) and sealing the joints and intersections with manholes, etc. Water and sand infiltration at joints causes downstream problems of lowered capacity and silting/sand buildup
Water line:
Groundwater has little effect on water lines as long as you can get them constructed. Dewatering might be required. If the piping is affected by corrosion, then the groundwater can be an issue...otherwise not so much.