When it comes to colors, I'm like you - confidence-preferences depending on the lure. As for when or why to use certain colors, those preferences never change regardless of the day, weather, water clarity or season. I just cleared one of my camera's memory card of over 760 photos showing the huge amount of lures and lure colors that have caught many fish species. (and I still have two more cameras to download photos.)
Would those lures have done better using other colors? Don't know, don't care. All I know is that the only logic that applies to color choice is: caught em on this one, don't stop!
The nice thing about a photo log is confirming all the colors and lures that did well over the years on various waters. Whereas photos don't lie/ many anglers lie to themselves or, as in my case, memory falls short. (...now where did I leave that d*** cup a coffee much less - when was the last time this color/lure work )