I don't see a pile of bricks near the base of the building, so presumably someone has been picking up the bricks as they fall off and is aware of the situation (along with everyone else who walks by the building).
As long as there are adequate brick ties securely fastened, the brick fascade may not be in danger of peeling away from the building. As for the vertical load, it appears as the brick has chosen to resort to arching action above the missing bricks.
At the very least, I would expect water issues. At some point, it could cause a catastrophic collapse if enough water got behind the brick, froze during those Toronto winters, popped more brick off the wall