As a fairly new geotech, I struggle with this as well.
I always look at the site grading, sometimes its obvious an area has been filled. If there isn't a topsoil layer under the fill, there is usually a colour change. The fill will be darker, and often the SPT counts will jump bit after the...