YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co./docs/hub/model-cards#model-card-metadata)

Gradio app to run QA on a given website

What does the app do :

  • Get input prompt (text or transcribed audio)
  • Similarity search in a vector DB, returns top k chunks
  • Run llm based on context (using basic prompt - langchain not used yet)
  • Return response and metadata (url, scores, text chunks...)

Setup process:

  • vector store (FAISS) a given website (sitemap) using langchain
  • download a llm
  • containarise stt (faster-whisper) due to os incompatibility
  • build Gradio app

To build Faster-whisper docker image name "fasterwhisper"

docker build -t . fasterwhisper

Create python env 'llama'

conda create --name="llama" python=3.10
conda activate llama
pip install -r requirements.txt

To run the app:

bash run.sh

To push to hugging face (including large files) use this command:

git lfs migrate import --everything

git add .; git commit -m "message"; git push -f origin

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model's library. Check the docs .