Move your hands up his neck to follow him and your body will follow
With your thumb, follow your horse's movements. You should also close your eyes while holding the mane, as Brenna said, you'll follow your horse if so :)
Don't be afrad to hold the mane! Also, try to imagine moving your seat back and allowing your hip angle to close.