The conservative answer is you no longer have a bearing connection, but a slip-critical one. The hole sizes listed in Table J3.3 are "maximum" sizes for normal sized holes.
Similarly, contractors sometimes claim that all holes are 'standard' size provided they stop just short of the specified...