li-14b-v0.4 / README.md
wanlige's picture
Update README.md
608fc55 verified
metadata
library_name: transformers
tags:
  - mergekit
  - merge
base_model:
  - Qwen/Qwen2.5-14B-Instruct
  - Qwen/Qwen2.5-Coder-14B
  - deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
  - huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2
  - tanliboy/lambda-qwen2.5-14b-dpo-test
  - SicariusSicariiStuff/Impish_QWEN_14B-1M
  - Qwen/Qwen2.5-14B
model-index:
  - name: li-14b-v0.4
    results:
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: IFEval (0-Shot)
          type: HuggingFaceH4/ifeval
          args:
            num_few_shot: 0
        metrics:
          - type: inst_level_strict_acc and prompt_level_strict_acc
            value: 81.33
            name: strict accuracy
        source:
          url: >-
            https://huggingface.co./spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
          name: Open LLM Leaderboard
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: BBH (3-Shot)
          type: BBH
          args:
            num_few_shot: 3
        metrics:
          - type: acc_norm
            value: 50.38
            name: normalized accuracy
        source:
          url: >-
            https://huggingface.co./spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
          name: Open LLM Leaderboard
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: MATH Lvl 5 (4-Shot)
          type: hendrycks/competition_math
          args:
            num_few_shot: 4
        metrics:
          - type: exact_match
            value: 55.74
            name: exact match
        source:
          url: >-
            https://huggingface.co./spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
          name: Open LLM Leaderboard
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: GPQA (0-shot)
          type: Idavidrein/gpqa
          args:
            num_few_shot: 0
        metrics:
          - type: acc_norm
            value: 11.86
            name: acc_norm
        source:
          url: >-
            https://huggingface.co./spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
          name: Open LLM Leaderboard
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: MuSR (0-shot)
          type: TAUR-Lab/MuSR
          args:
            num_few_shot: 0
        metrics:
          - type: acc_norm
            value: 16.35
            name: acc_norm
        source:
          url: >-
            https://huggingface.co./spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
          name: Open LLM Leaderboard
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: MMLU-PRO (5-shot)
          type: TIGER-Lab/MMLU-Pro
          config: main
          split: test
          args:
            num_few_shot: 5
        metrics:
          - type: acc
            value: 46.3
            name: accuracy
        source:
          url: >-
            https://huggingface.co./spaces/open-llm-leaderboard/open_llm_leaderboard?query=wanlige/li-14b-v0.4
          name: Open LLM Leaderboard

This model is currently ranked #1 among the models up to 15B parameters and #50 among all models on the Open LLM Leaderboard.

关于我们

世纪开元智印互联科技集团股份有限公司创立于2001年3月9日,总部位于山东省济南市。历经20余年发展,世纪开元以技术创新为核心,实现互联网与传统印刷行业的深度融合,探索出了区别于传统印刷行业的新模式、新业态。

世纪开元主要从事定制化影像、商务印刷及包装印刷类产品的研发、设计、生产及销售,通过将互联网、数字化、自动化和智能化等新模式和新技术与包装印刷行业相结合的方式,使小批量个性化定制产品订单得以相对标准化、规模化生产,旨在满足个人消费者及各类企业用户的小批量定制化需求,为用户提供一站式场景化定制印刷服务,实现全流程智能制造,已成长为业内领先的“工业互联网”印刷企业。

在未来发展中,世纪开元将一如既往地加大技术研发投入,深度融合互联网、大数据、人工智能等新一代信息技术,注重专项技术人才的培养,积极引进数字化、智能化手段优化创新业务流程和实现用户体验的提升,并通过多维度的企业发展,带动行业协同发展,促进印刷行业新旧动能转换,开拓印刷行业发展新方向。

了解更多,请访问我们的官网:世纪开元


Established on March 9, 2001, and headquartered in Jinan, Shandong Province, Century Innovation has grown over the past two decades by focusing on technological innovation. The company has achieved deep integration of the Internet with the traditional printing industry, pioneering new models and business formats distinct from conventional printing practices.

Century Innovation specializes in the research, design, production, and sales of customized imaging, commercial printing, and packaging products. By combining the Internet, digitalization, automation, and intelligent technologies with the printing industry, the company enables relatively standardized and scalable production for small-batch personalized custom orders. This approach aims to meet the needs of individual consumers and various enterprise users for small-batch customization, providing users with one-stop, scenario-based custom printing services and achieving full-process intelligent manufacturing. As a result, Century Innovation has become a leading "Industrial Internet" printing enterprise.

In the future, Century Innovation will continue to increase investment in technology R&D, deeply integrate the Internet, big data, artificial intelligence, and other next-generation information technologies, and focus on cultivating specialized technical talent. The company will actively adopt digital and intelligent means to optimize innovative business processes and enhance user experience. Through multi-dimensional development, it aims to drive industry collaboration, promote the transformation of old and new drivers in the printing industry, and explore new directions for its growth.

To learn more, visit our official website: Century Innovation


merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using Qwen/Qwen2.5-14B-Instruct as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B #logic
  - model: huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2 #uncensored
  - model: Qwen/Qwen2.5-14B #text generation
  - model: Qwen/Qwen2.5-14B-Instruct #chat assistant
  - model: Qwen/Qwen2.5-Coder-14B #coding
  - model: SicariusSicariiStuff/Impish_QWEN_14B-1M #math
  - model: tanliboy/lambda-qwen2.5-14b-dpo-test #dpo
merge_method: model_stock
base_model: Qwen/Qwen2.5-14B-Instruct
normalize: true
int8_mask: true
dtype: bfloat16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 43.66
IFEval (0-Shot) 81.33
BBH (3-Shot) 50.38
MATH Lvl 5 (4-Shot) 55.74
GPQA (0-shot) 11.86
MuSR (0-shot) 16.35
MMLU-PRO (5-shot) 46.30