I would guess that he is molting. Is he losing any of his tail feathers. What is his age? If he is around 18 months he could be molting, and they molt every year after that. The hens also could be picking out his feathers while he is on the roost or standing around.