carlosgw,
What kind of room is this small room? If it is a bathroom, then transfer air from the adjacent space is permissible according to the International Mechanical Code (2000). This air must be exhausted from the building.
If this isn't a bathroom, then I'll assume you're talking about a 50 CFM outside ventilation air requirement based on occupancy for this room. In this case, drawing in air from an adjacent space might work, but remember that the ventilation requirement is based on outside air. So the amount of air that you transfer into this small room will depend on the fraction of outside air that is in the supply air to the adjacent space. For example, if the supply air in the adjacent space is 20% outside air, then you will have to transfer 250 CFM into your small room to satisfy the requirement.
As mentioned above, overall system balance and heating/cooling loads must be considered. Of course, whatever amount you exhaust will have to be brought into the building, either at the air handler or through infiltration. You need to study the entire system to determine the best solution.
---KenRad