it is possible that u are drowning the minnows, if you are moving constantly. I rarely troll, or even drift but that sounds like the problem. I regularly fish minnows up to 30ft in the summer months ( tightlined while anchored) and they are fine as long as i leave them alone.