Ive got my hi tek mounts all over my aluminum boat and often leave my holders in the bases when trailering. I havent had any problems with mine working loose over time by swaying back and forth like u are saying. Lowes carriers several items such as toggle anchors u could use when mounting your bases just for piece of mind though.