I do not know the differences in spawning patterns of white vs. black...but, actually the larger crappie usually spawn first....so it MIGHT be that the white crappie being the larger ones may have already spawned and moved back into the deeper water....usually after they spawn they are not as aggressive....

So, in my opinion...it might be that the larger white crappie have already spawn and went back deeper where they will not be as aggressive...

But, that is just my opinion.

Have you caught any of the white crappie and noted if they still have eggs or not?