I would like your thoughts on this...

My wife and i were fishing a tournament this past week down south.We pre-fished for 2 days prior and i marked a few spots.On the 2nd day of the tournament we went to a spot i marked and i threw out 2 markers about 20-30 yards apart and we started spider-rigging back and forth around my markers.We started catching fish and within 5 minutes not 1,not 2 but 3 boats pulled up and started fishing my markers with bobbers.I had to pull up my markers and move because i had no room to fish around my markers...These boats were NOT tournament entrants...
What are your thoughts on this and what would you have done?