Just keep your chickens on your property and ignore him. As long as they don't wander over to his place he doesn't have any right to try to keep you from owning livestock.
If he's a turd about it, put your pig pens up right along the boundary between your properties and let him enjoy. :cool: