Skip to content
#

vector-cache

Star

Here are 4 public repositories matching this topic...

Language: All
Filter by language
All 4 Python 2 C++ 1 Rust 1

rohith-nandan-6 / LLM-Cascade-Router

Star 0

Intelligent LLM router that dynamically routes prompts between local Ollama (Qwen) and cloud models (Gemini) using complexity scoring, semantic caching, and cost-aware decisioning.

devtools ai-agents cost-optimization gemini-api fastapi llm semantic-cache hybrid-ai local-llm llm-inference qwen ai-gateway llm-router llm-orchestration ai-infrastructure ai-tooling openai-compatible ollamma prompt-routing vector-cache
  • Updated May 15, 2026
  • Python

Improve this page

Add a description, image, and links to the vector-cache topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the vector-cache topic, visit your repo's landing page and select "manage topics."

Learn more