My pony has a weird habit of not wanting to leave the field and then not wanting to go back into the feild after our ride. Any ideas of why this could be happening? tips to fix it?

He might know what happens first once he comes out of the field which would be getting worked, but after his work you brush him and give him treats and that part he likes. So maybe he doesn't want to do the first part(riding)and won't come for you but then after the ride likes the last part (grooming)and doesn't want to go back our . That's just my idea.
Join the fun and sign up to connect with our 200,000 members!