On my 2 boats, that plug was loosely secured to the bulkhead with a short piece of brass chain. I guess so it wouldn't go far.
If by 'hatch' you mean the compartment where the tank sits; yes it has to be as watertight as can be. Not just for water,but fumes, too.
Usually, the water in there...