An angle in your line is fine. Just remember that the greater the angle, the shallower your bait is going to run so you will need to compensate. You can also add a small splitshot to keep your line vertical if the smaller jig is absolutely necessary. I normally use a larger jig head when I am fishing deeper brush, and that helps keep the line vertical. Sometimes they just want the smaller profile, and thats when I will add the splitshot.