19 3 106

Csaba Kecskemeti PRO

csabakecskemeti

https://devquasar.com/

csabakecskemeti

AI & ML interests

None yet

Recent Activity

updated a model 2 minutes ago

DevQuasar/teknium.SD-PrompTune-v1-GGUF

published a model 14 minutes ago

DevQuasar/teknium.SD-PrompTune-v1-GGUF

updated a model 14 minutes ago

DevQuasar/teknium.OpenHermes-2-Mistral-7B-GGUF

View all activity

Organizations

Posts 17

Post

535

I found if we apply the reasoning system prompt (that has been published on the NousResearch/DeepHermes-3-Llama-3-8B-Preview model card) other models are also react to it and start mimicking reasoning. Some better some worse. I've seen internal monologue and self questioning.

Here's a blogpost about it:
http://devquasar.com/ai/reasoning-system-prompt/

Post

1823

Check out my idea:
LLmaaS - Local LLM as a Service

With LLmaaS, I propose leveraging locally running LLMs as a service, providing a standardized way for websites to access and utilize them for LLM-powered operations directly on the user’s device.

Demo, code, more detailed description.
https://devquasar.com/llmaas/
https://github.com/csabakecskemeti/LLmaaS
https://youtu.be/OOWGr8jcP5Q

Call for contributors
Join me a develop the LLmaaS proxy to make this a generic purpose tool to leverage local LLMs on web. Build in security measures.
I'm looking for help to make the proxy more generic support multiple local LLM services without any change on the HTML side.
Also looking for ideas how to make the HTML par more modular and easy to use.

View all Posts

models 1

csabakecskemeti/bert-base-case-yelp5-tuned-experiment

Text Classification • Updated Apr 5, 2024 • 120

datasets

None public yet