sister repo - https://huggingface.co./kohya-ss/ControlNet-diff-modules

Using the diff-modules will produce different outputs than these. 

It's up to the users to decide which works better.