Is there anything special I have to feed a weanling? Other than regular grain and hay.

I would definitely talk to a vet. There are many brands of specialized feed and supplements; grain, if given in the wrong amounts, can cause all sorts of bone problems
contact your vet to make sure all the nutritional needs are meant
I like to feed minerals