Huang Liang Hsun PRO
lianghsun
AI & ML interests
Focused on applying deep learning in legal and scientific domains, with expertise in NLP and model fine-tuning.
Recent Activity
liked
a model
7 days ago
itlwas/Llama-3.2-Taiwan-3B-Instruct-Q4_K_M-GGUF
liked
a dataset
8 days ago
instruction-pretrain/ft-instruction-synthesizer-collection
posted
an
update
9 days ago
🖖 Let me introduce the work I've done over the past three months: 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕 and 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁, now open-sourced on 🤗 Hugging Face.
𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕: This model is built on top of 𝗺𝗲𝘁𝗮-𝗹𝗹𝗮𝗺𝗮/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝟯𝗕 with continual pretraining. The training dataset consists of a mixture of Traditional Chinese and multilingual texts in specific proportions, including 20B tokens of Traditional Chinese text.
𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁: This is a fine-tuned conversational model based on the foundation model.
This Llama-3.2-Taiwan open-source project is currently a one-person effort (yes, I did everything from text preparation — so exhausting!). If you're interested, feel free to join the Discord server for discussions.
🅱🅴🅽🅲🅷🅼🅰🆁🅺🅸🅽🅶
The evaluation was conducted using https://huggingface.co./datasets/ikala/tmmluplus, though the README page does not yet reflect the latest results. The performance is close to the previous versions, indicating that further improvements might require adding more specialized knowledge in the datasets.
🅰 🅲🅰🅻🅻 🅵🅾🆁 🆂🆄🅿🅿🅾🆁🆃
If anyone is willing to provide compute resources, it would be greatly appreciated to help this project continue and grow. 💪
---
🏔️ Foundation model: https://huggingface.co./lianghsun/Llama-3.2-Taiwan-3B
🤖 Instruction model: https://huggingface.co./lianghsun/Llama-3.2-Taiwan-3B-Instruct
⚡ GGUF: https://huggingface.co./lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF
Organizations
lianghsun's activity
playground是壞的
4
#2 opened 16 days ago
by
metalnow
🚩 Report: Legal issue(s)
#1 opened 29 days ago
by
wayne1998
Dataset Viewer issue: UnexpectedError
4
#2 opened about 1 month ago
by
lianghsun
free-gpt-4o-chat
#1 opened about 1 month ago
by
avadhuta
轉換成GGUF後的使用問題
7
#2 opened about 1 month ago
by
AtwoodYen
要不要試試看 Llama-3.2-Taiwan-1B 😎
3
#1 opened about 1 month ago
by
lianghsun
要不要試試看 Llama-3.2-Taiwan-1B 😎
#2 opened about 1 month ago
by
lianghsun
Convert to GGUF format failed!
3
#1 opened about 1 month ago
by
leotaipei
Dataset Viewer issue: JobManagerCrashedError
#1 opened about 2 months ago
by
lianghsun
Dataset Viewer issue: ConfigNamesError
#1 opened 2 months ago
by
lianghsun
Dataset Viewer issue: FeaturesError
#3 opened 2 months ago
by
lianghsun
Dataset Viewer issue: UnexpectedError
1
#1 opened 3 months ago
by
lianghsun
Dataset Viewer issue: JobManagerCrashedError
1
#1 opened 3 months ago
by
lianghsun
Dataset Viewer issue: UnexpectedError
1
#1 opened 4 months ago
by
lianghsun
convert en
1
#2 opened 5 months ago
by
falan42
Dataset Viewer issue: UnexpectedApiError
2
#1 opened 6 months ago
by
lianghsun
Clean up dataset JSON and convert to Alpaca format
#2 opened 6 months ago
by
lianghsun