From my experience, you are waiting plenty. Typically within 30 minutes or so I have a good batch of stuff swimming around and crappie eating.
That's on a good night. On a bad night within an hour of little to no action, I should just go home. Many times I sit there and enjoy being out, but that's about it. I've done the move around thing, but I decided when it's off, it's just off. Hope you have better luck next trip.