Are you considering performing distillation experiments on the qwen70b model?
#2
by
lambda1989
- opened
Compared to the 7B and 32B distill-models, larger models generally perform better. Looking forward to the experimental results on the 72B model.