The pump should only run momentarily and then stop until you use water. I think you have already figured out that you have leak or failed connection or something, so there really isn't any option other than to hunt it down...
The only other thing that comes to mind is that maybe there is...