19 6 162

Huang Liang Hsun PRO

lianghsun

https://www.lianghsun.dev

AI & ML interests

Focused on applying deep learning in legal and scientific domains, with expertise in NLP and model fine-tuning.

Recent Activity

liked a model 7 days ago

itlwas/Llama-3.2-Taiwan-3B-Instruct-Q4_K_M-GGUF

liked a dataset 8 days ago

instruction-pretrain/ft-instruction-synthesizer-collection

posted an update 9 days ago

🖖 Let me introduce the work I've done over the past three months: 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕 and 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁, now open-sourced on 🤗 Hugging Face. 𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕: This model is built on top of 𝗺𝗲𝘁𝗮-𝗹𝗹𝗮𝗺𝗮/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝟯𝗕 with continual pretraining. The training dataset consists of a mixture of Traditional Chinese and multilingual texts in specific proportions, including 20B tokens of Traditional Chinese text. 𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁: This is a fine-tuned conversational model based on the foundation model. This Llama-3.2-Taiwan open-source project is currently a one-person effort (yes, I did everything from text preparation — so exhausting!). If you're interested, feel free to join the Discord server for discussions. 🅱🅴🅽🅲🅷🅼🅰🆁🅺🅸🅽🅶 The evaluation was conducted using https://huggingface.co./datasets/ikala/tmmluplus, though the README page does not yet reflect the latest results. The performance is close to the previous versions, indicating that further improvements might require adding more specialized knowledge in the datasets. 🅰 🅲🅰🅻🅻 🅵🅾🆁 🆂🆄🅿🅿🅾🆁🆃 If anyone is willing to provide compute resources, it would be greatly appreciated to help this project continue and grow. 💪 --- 🏔️ Foundation model: https://huggingface.co./lianghsun/Llama-3.2-Taiwan-3B 🤖 Instruction model: https://huggingface.co./lianghsun/Llama-3.2-Taiwan-3B-Instruct ⚡ GGUF: https://huggingface.co./lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF

View all activity

Organizations

lianghsun's activity

liked a model 7 days ago

itlwas/Llama-3.2-Taiwan-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 9 days ago • 24 • 1

liked a dataset 8 days ago

instruction-pretrain/ft-instruction-synthesizer-collection

Viewer • Updated Dec 2, 2024 • 249k • 1.13k • 60

liked a dataset 10 days ago

benchang1110/Taiwan-pretrain-9B

Viewer • Updated 10 days ago • 9.28M • 33 • 2

liked a model 13 days ago

lianghsun/Llama-3.2-Taiwan-3B

Text Generation • Updated 15 days ago • 419 • 16

liked a dataset 16 days ago

win10/clean_lmsys_chat_1m-v2

Viewer • Updated 21 days ago • 14.6k • 11 • 1

liked a dataset 17 days ago

lianghsun/tw-instruct-500k

Viewer • Updated 14 days ago • 500k • 137 • 13

liked a model 18 days ago

DevQuasar/lianghsun.Llama-3.2-Taiwan-3B-Instruct-GGUF

Text Generation • Updated 18 days ago • 185 • 1

liked 2 datasets 25 days ago

Isotonic/agentinstruct-1Mv1-combined

Viewer • Updated Nov 20, 2024 • 1.04M • 71 • 5

microsoft/orca-agentinstruct-1M-v1

Viewer • Updated Nov 1, 2024 • 1.05M • 6.88k • 413

liked 2 datasets 27 days ago

togethercomputer/Long-Data-Collections

Viewer • Updated 19 days ago • 4.12M • 492 • 134

Open-Orca/OpenOrca

Viewer • Updated Oct 21, 2023 • 2.91M • 9.23k • 1.36k

liked a dataset 28 days ago

TheSkullery/Aether-Lite-v1.8.1

Viewer • Updated Jun 23, 2024 • 125k • 49 • 10

liked a dataset 29 days ago

nvidia/ChatQA2-Long-SFT-data

Viewer • Updated Sep 9, 2024 • 117k • 118 • 20

liked a dataset 30 days ago

Hello-SimpleAI/HC3-Chinese

Viewer • Updated Jan 21, 2023 • 25.7k • 1.25k • 156

liked a model about 1 month ago

lianghsun/Llama-3.2-Taiwan-1B-Instruct

Text Generation • Updated 25 days ago • 4 • 2

liked 5 datasets about 1 month ago