The rubber probably has a release agent on or in it. Prepare the surface properly for bonding. This would include abrasion with sandpaper or by sand blasting, solvent wipe, and plasma or flame treatment. Flame treatment can be as simple as lightly sweeping the surface with a propane torch. It is not the heat that is effective, but the highly reactive free-radicals in the flame.