You should still go the insurance route. Or take the fence and dump it back on his yard and then post about it. Somebody should be able to come up with a good reverse.