Does the fabrication drawing have specific requirements listed under notes or some other reference regarding surface finish or contour for this critically stressed area? I would use caution, and find out exactly what the requirements are for this location.
My sense is that you might be fabricating this part from an out-dated drawing? If so, you might be forced to interpret this statement on your own. I don't believe that it relates to un-equal cooling rates from the casting process.