I tried it on a discrete rigid body. The ref point is in the centre of hole, so that the ref point isn't attached on the body. The BC didn't work. Part wouldn't move.
It doesn't matter where you put the reference point, as the restraints you apply to it are simply ascribed to all the freedoms on your discrete rigid body. I'd check your files for any warning messages and check your input.
It is working now. I have had a look on the warnings. Something to do with element type I think. It says hourglass is not appliable for some element type. I modified them. And I don't have warning now. It is working!......