Post
1923
📢For those who wish to quick start with reasoning / cot application over rows of tabular data but with minimal dependencies, this post would be valuable.
🔎 I found that the problem is that given a bulk of Chain-of-Though (CoT) 🔗 queries for remotely accessed LLM 🤖 (like openrouter / Replicate / OpenAI) might result in connection loss which may lead exception 💥 and challenges with generated content restoration.
Here, is where I contribute with the bulk-chain.
⭐ https://github.com/nicolay-r/bulk-chain
Currently working on 0.24.3 version, in which I am happy to announce the API for developing your apps that are based on CoT schema declaration in JSON (details in attached images 📸)
All you have to do is:
✅ 1. Declare CoT-schema in json
✅ 2. Declare the model or use the preset
✅ 3. Launch code
One example is to use ReplicateIO provider:
https://github.com/nicolay-r/bulk-chain/blob/master/ext/replicate.py
Each model has a wrapped call for inference in try-catch block
🔎 I found that the problem is that given a bulk of Chain-of-Though (CoT) 🔗 queries for remotely accessed LLM 🤖 (like openrouter / Replicate / OpenAI) might result in connection loss which may lead exception 💥 and challenges with generated content restoration.
Here, is where I contribute with the bulk-chain.
⭐ https://github.com/nicolay-r/bulk-chain
Currently working on 0.24.3 version, in which I am happy to announce the API for developing your apps that are based on CoT schema declaration in JSON (details in attached images 📸)
All you have to do is:
✅ 1. Declare CoT-schema in json
✅ 2. Declare the model or use the preset
✅ 3. Launch code
One example is to use ReplicateIO provider:
https://github.com/nicolay-r/bulk-chain/blob/master/ext/replicate.py
Each model has a wrapped call for inference in try-catch block