No one so far has told me they want him dead; downside to being a warden is people don't tend to tell me their crimes before they commit them.

The usual, human-friendly theory of justice is that cooler heads design the punishments. They don't like that I let you settle your own score with him. But since you did kill Father John, I think they just doubt that you're the sort of man who is happy with one punch.