Check the relay manual. Three wye connected PT are often needed (or easier to implement) to get the polarizing element (zero sequence voltage in this case) for directional neutral (ground) overcurrent function.
Alternatively you can use current polarization, usually much more cumbersome or even not feasible if the source transformer is not near by.
There is no zero sequence in the secondary of an open delta VT. So nothing in the relay that works on zero sequence voltage or zero sequence impedance will function correctly.