1024m commited on
Commit
f5cc170
·
verified ·
1 Parent(s): 4e75f82

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -30
README.md CHANGED
@@ -109,24 +109,20 @@ model-index:
109
 
110
  # Qwen-14B-Hindi
111
 
112
- Qwen-14B-Hindi is a 14.7B parameter pre-trained and instruction-tuned bilingual large language model for both Hindi and English,
113
- trained on a mixed language dataset containing < >. It features Rotary Position Embeddings (RoPE), SwiGLU activation, RMSNorm normalization, and Attention QKV bias, optimizing performance and efficiency.
114
-
115
 
116
  ### Model Details:
117
 
118
  - **Developed by:** [Traversaal.ai](https://huggingface.co/large-traversaal)
119
- - **Language(s) (NLP):** Hindi and English
120
  - **License:** MIT
121
- - **Input:** Text-only data
122
- - **Output:** Model generates text
123
- - **Paper :** [Improving Multilingual Capabilities with Cultural and Local Knowledge in Large Language Models While Enhancing Native Performance]( )
124
-
125
 
126
  ## Intended Use
127
 
128
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
129
- We release Qwen-14B-Hindi under the MIT and Apache-2.0 licenses, encouraging researchers, developers, and enterprises to experiment with and build upon the model, particularly for bilingual, multilingual and non-English applications.
130
  At the time of release, the model demonstrated state-of-the-art performance across an extensive English and Hindi evaluation suite.
131
 
132
  Some potential downstream applications are as follows:
@@ -148,7 +144,7 @@ Target audiences who may benefit from our model:
148
 
149
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
150
 
151
- While Qwen-14B-Hindi is a powerful bilingual model designed for Hindi and English, it is crucial to acknowledge its limitations and the potential for misuse. The model must not be used in ways that violate any applicable laws or regulations. Below are specific scenarios where its use is restricted:
152
 
153
  - *Harmful or Malicious Use*: The model should not be employed to create or distribute harmful, misleading, or inappropriate content, including but not limited to:
154
  - Encouraging hate speech, violence, or discrimination
@@ -166,33 +162,15 @@ While Qwen-14B-Hindi is a powerful bilingual model designed for Hindi and Englis
166
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
167
 
168
  <!-- The model is trained on publicly available data which was in part curated by Inception. -->
169
- ~~We have employed different techniqes to reduce bias in the model. While efforts have been made to minimize biases, it is likely that the model, as with all LLM models, will exhibit some bias.
170
 
171
  The model is trained as an AI assistant for Hindi and English speakers. The model is limited to produce responses for queries in these two languages
172
  and may not produce appropriate responses to other language queries.
173
 
174
- By using Llama-3-Nanda-10B-Chat, you acknowledge and accept that, as with any large language model, it may generate incorrect, misleading and/or offensive information or content.
175
  The information is not intended as advice and should not be relied upon in any way, nor are we responsible for any of the content or consequences resulting from its use.
176
  We are continuously working to develop models with greater capabilities, and as such, welcome any feedback on the model~~
177
 
178
-
179
- ## Training Details:
180
-
181
- ### Training Data:
182
-
183
-
184
- <!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
185
-
186
- ~~For the pre-training of Llama-3-Nanda-10B-Chat, we used a diverse bilingual corpus sourced from the Web and other sources. We also used publicly available English and code datasets.
187
- To collect Hindi data, we used multiple sources including web pages, Wikipedia articles, news articles, Hindi books, etc.~~
188
-
189
-
190
- ### Training Procedure:
191
-
192
- <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
193
-
194
- ~~We performed continuous pre-training followed by instruction tuning, both on Cerebras supercomputer.~~
195
-
196
  ## Evaluation:
197
  We evaluated our models on multiple well-known benchmarks to measure their effectiveness against other leading models, and the results are as follows:
198
 
 
109
 
110
  # Qwen-14B-Hindi
111
 
112
+ Phi-4-Hindi is a 14.7B parameter pre-trained and instruction-tuned bilingual large language model for both Hindi and English,
113
+ trained on a mixed language dataset.
 
114
 
115
  ### Model Details:
116
 
117
  - **Developed by:** [Traversaal.ai](https://huggingface.co/large-traversaal)
118
+ - **Language(s) (NLP):** Optimized for Hindi and English
119
  - **License:** MIT
120
+ - **Paper :** TBA April 15
 
 
 
121
 
122
  ## Intended Use
123
 
124
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
125
+ We release Phi-4-Hindi under the MIT license, encouraging researchers, developers, and enterprises to experiment with and build upon the model, particularly for bilingual, multilingual and non-English applications.
126
  At the time of release, the model demonstrated state-of-the-art performance across an extensive English and Hindi evaluation suite.
127
 
128
  Some potential downstream applications are as follows:
 
144
 
145
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
146
 
147
+ While Phi-4-Hindi is a powerful bilingual model designed for Hindi and English, it is crucial to acknowledge its limitations and the potential for misuse. The model must not be used in ways that violate any applicable laws or regulations. Below are specific scenarios where its use is restricted:
148
 
149
  - *Harmful or Malicious Use*: The model should not be employed to create or distribute harmful, misleading, or inappropriate content, including but not limited to:
150
  - Encouraging hate speech, violence, or discrimination
 
162
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
163
 
164
  <!-- The model is trained on publicly available data which was in part curated by Inception. -->
165
+ ~~While efforts have been made to minimize biases, it is likely that the model, as with all LLM models, will exhibit some bias.
166
 
167
  The model is trained as an AI assistant for Hindi and English speakers. The model is limited to produce responses for queries in these two languages
168
  and may not produce appropriate responses to other language queries.
169
 
170
+ By using this model, you acknowledge and accept that, as with any large language model, it may generate incorrect, misleading and/or offensive information or content.
171
  The information is not intended as advice and should not be relied upon in any way, nor are we responsible for any of the content or consequences resulting from its use.
172
  We are continuously working to develop models with greater capabilities, and as such, welcome any feedback on the model~~
173
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
174
  ## Evaluation:
175
  We evaluated our models on multiple well-known benchmarks to measure their effectiveness against other leading models, and the results are as follows:
176