Created custom Inference Handler

fa1167f verified 2 months ago

138 Bytes

	unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git
	xformers<0.0.27
	trl<0.9.0
	peft
	accelerate
	bitsandbytes
	torch==2.3.0
	json