Machinery's Handbook is the place to go for this. You are talking about a tolerance on hole size of .0001" with what you want to do. The best way is to hone the bore to size. Be aware that if you are putting the bearing in an aluminum plate a relatively small differenc in temperature will make it loose or tight. Maybe shrink fitting the bearing will work for you. Or try Loctite etc.