Sounds like a chicken bath is in order.
Had to do that with my 6 bigger chicks last week as they got all muddy and icky when they were outside and their feathers were muddy and sticky. I just wrapped them in a towel and brought them to my Utility room with the mud sink and gave them a quick...