Introduction

A modern template for agentic orchestration — built for rapid iteration and scalable deployment using highly customizable, community-supported tools like MCP, LangGraph, and more.

Visit the Github:

Core Features

is an open protocol that standardizes how apps provide context to LLMs.

• Seamlessly integrates LLM with growing list of community integrations found here
• No LLM provider lock in

for Customizable Agentic Orchestration

• Native streaming for UX in complex Agentic Workflows
• Native persisted chat history and state management

Technology Stack and Features

• for Python backend API
• for Python SQL database interactions (ORM + Validation).
  • Wrapper of
• for LLM Observability and LLM Metrics
• for Data Validation and Settings Management.
• for DB RBAC
  • Relational DB
  • Vector Store
• Reverse Proxy
• for development and production.

Planned Features

• for scraping Metrics
• for visualizing Metrics
• SaaS for Authentication and Authorization with OIDC & JWT via OAuth 2.0
• CI/CD via Github Actions
  • 💵 Deploy live demo to
  • Provision with IaC
  • Push built images to ECR and Dockerhub

info

Click above to view live update on star history as per their article:

Ongoing Broken Live Chart you can still use this website to view and download charts (though you may need to provide your own token).