Yes, it's a male coming into being sexually mature. You can either ignore it or try get him to stop doing it by just moving him off and petting him if you can. It shouldn't last for more than a couple of weeks.
He's probably a bit stressed upon having a new home so thus why he's not eating...