Welcome to Eng-Tips.
I think the answer to your question is:
"3" = 3/32" = 0.0938 inch
and so on for nominal sizes.
For oversize rivets, add 1/64 or 0.0156 inch to the diameter.
To learn the basics of riveting, you should download and read AC43-13 from the FAA website.
STF