The condition you describe is typical of a poppet valve that is stuck in the open position, which is how they usually fail.
This is a pressure relief valve that is normally closed at idle speeds when water pressure is low. As water pressure increases with rpm, the valve opens and lets water...