Sitelet https://github.com/Kavin66/Foundry-Local
Skip to content

Repository files navigation

🤖 Simple RAG Chat Application with Foundry Local

A minimal Retrieval-Augmented Generation app with Streamlit and Foundry Local.

Setup

  1. Make sure Foundry Local is running on http://localhost:8000

  2. Copy .env.example to .env and configure:

FOUNDRY_API_KEY=your-foundry-api-key
FOUNDRY_API_URL=http://localhost:8000
FOUNDRY_MODEL=llama2
FOUNDRY_EMBEDDING_MODEL=nomic-embed-text
  1. Install dependencies:
pip install -r requirements.txt
  1. Run:
streamlit run app.py
  1. Upload a document (PDF, DOCX, or TXT) and ask questions about it!

Features

  • 📄 Upload documents in multiple formats
  • 🔍 Semantic search via Foundry embeddings
  • 💬 Chat with local Foundry LLM
  • 📖 View source citations

Files

  • app.py - Main Streamlit application
  • config.py - Foundry configuration
  • document_manager.py - Document processing
  • vector_store.py - Embeddings and search

About

No description, website, or topics provided.

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages