Probably depends on how your battery charger is wired. Mine has a switch under the AC side of the panel to turn on/off the battery charger. As for the battery select switches, I keep them in the off position, but pretty sure that just cuts power to the motors, and maybe some other circuits. There is also a DC power switch in my panel.
What model and year is your boat?