Don't hold it by the end of the pole with just your hand. I hold with my hand well forward of the butt end, so that my forearm supports the weight of the pole.
Also, loosen your grip. Elbow pain starts in the wrist, and a tight grip causes more strain on your wrist. For my tennis elbow, my doctor prescribed several WRIST exercises.