Yea, a guardrail needs to be designed for a 200 lb unfactored point load (or 50 plf, whichever greater).
So, all you are relying on the brick for is to resist 200 lb.
The contractor will likely prefer that you use screw anchors, such as HILTI HUS-EZ.
You can design the connection using ESR...