When you let the ball go, try to spread your fingers away from it all at once, like a flower suddenly opening its petals. This, plus keeping your wrist from moving, will help prevent the release from altering the ball's direction.
At this point in your wind-up, your hitting arm will have finished swinging backward and will be well on its way up to where you will bend it to begin the striking motion.
