No you will not harm them if you keep what you want anytime you want. They lay so many eggs that one fish will lay more eggs to replace the fish you take out plus thousands more. Harvest when you want and your legal catch. They are just as good frozen also.