If the trim tab on the skeg is set properly, this is NORMAL. The boat should go MORE straight when on plane and trimmed up.
This is a safety setup that will put the boat into a circle if you fall out.
The trim tab also helps offset the torque of the engine.