If the fiber washers are there for IP protection to keep fluids out, then you probably need a conductive gasket around the washer to make the electrical contact, or a counterbore ring for the washer so you can compress the washer adequately for IP protection, and then compress it a little more to make metal to metal contact. It can be done with the right materials and proper engineering.