There are several possible factors involved.
Source of the water could be ground water or surface water or both. I will try to summarize treatments. Assumed here is that downspouts are routed well away from the structure and the ground surface is sloped away.
I suspect that there may be failed perimeter drains at the building. If so, it is likely some well meaning builder (and unfortunately too many engineers and architects)call for surrounding the drain pipe with gravel. Gravel is not a filter of soil and the voids easily plug and the system fails, sometimes the first year of use.
If there is a perimeter drain system, dig down to typical places and check for the condition.
You msy or may not have to replace it. If the source of water is actually ground water, yes replace it. however, this time use a good filter around the pipe (slotted plastic). You may find some folks in this group that say surround the pipe with a filter fabric, or they ay say surround the gravel with a filter fabric. that may work, but I have seen the sock covered over with mud and seals it shut. Surrounding the whole system with fabric is very labor intensive.
A good way to do this is place the pipe and then simply dump in a good filter to cover the pipe and go maybe a foot or two above it. A good filter is ASTM C-33 FINE AGGREGATE (CONCRETE SAND). Very easy and concrete sand does a great k=job of filtering all types of soil.
On my jobs, the specs say "No gravel allowed on site" or some well meaning workman will use gravel instead of the sand.
It may be possible to correct the problem by waterproofing the ground surface.
Do this in this manner, after you remove all landscaping plastic, decorative stones,bark chips and the like.
Fill in depressions, as between sidewalk and building.
The strip sod in all areas where there is backfill to the building. It may go 15 feet out from structure.
Apply 2 pounds of powdered bentonite to this earth surface and mix in thoroughly in the top 2 to 3 inches.
Do not use granulated bentonite, since it does not work as well. Do this on a calm day, Use a garden roto-tlller for this mix and be thorough.
Work around bushes as close to them as possible. Do not try to seal stone landscaping areas in depressions and hope to seal a bathtub. This "roof" all should be sloped.
The sod can be replaced and grass will grow great. Bentonite ( a natural volcanic clay) fill soils voids when damp and is a great seal.
If you can't do the whole job, do the most likely places first.
Don't use excessive bentonite or you will have soggy lawns for all summer.