So when you say it is leaning from one side to another does the bow continue to track straight or is the boat weaving? If it is weaving then it sounds like bow steering. More weight towards the transom trim tabs up a motor trimmed out would help.
If the boat is tracking straight does it occur...