Yeah I can't ride him yet anyway he needs to be broke again
Before starting to do heavy work just walk a round the area and make it part of your warm up until your horse calms down. And rember stay calm and patient.
Walk him often, and he should get used to it.
When I got my horse, I let him settle in for a week without riding him. I would hand walk him around the property and groom him.
Spend good quality time with him or her, possibly bring something they had in their old stall/barn.