I'm the same way dragger, I can taste the difference in large cats and the smaller ones. I'm leary of eating the meat of the large fish also because of the higher mercury levels associated with being higher on the food chain and extended lives.
Crappie meat doesn't last long around here but I've got several quart bags full of catfish filets in the freezer just waiting on some friend or relative to take them home.
AMERICANS: Willing to cross a frozen river to kill you, in your sleep, on Christmas, totally not kidding, we've done it.