Developer Tools·Standings
LLM Application Development Frameworks
LLM application development frameworks help you build software around large language models; the choice depends on the features you need and where the framework can run.
Compare free-plan and paid-price details, primary language, retrieval-augmented generation (RAG), agent and tool use, workflow graphs, prompt optimization, license, and JavaScript or TypeScript support. The signal score is out of 10; API, open-source, and free-tier marks help you scan those details.
- 49 platforms
- 2 with a public API on this page
- 25 with a free tier
- Checked 9 Oct 2026
- 1 VVellumvellum.ai
Vellum is a personal AI assistant that can read files, manage calendars, control computers, take calls, perform transactions, and retain personal context.
- 2 S
Scanopyscanopy.netScanopy scans networks, discovers hosts and services, and maintains interactive documentation maps on a schedule.
- 3 Ttxtaineuml.github.io
txtai is an all-in-one AI framework for semantic search, LLM orchestration, and language model workflows.
- 4 LLangflowlangflow.org
Langflow is an open-source, Python-based framework for building customizable AI applications, including agent and MCP applications.
- 5 OOpenRAGopen-rag.ai
A free AGPL framework for document-grounded RAG with citations, hybrid search, and distributed processing.
- 6 FFlowiseflowiseai.com
An open-source visual tool for AI assistants and workflows; service is due to end August 31, 2026.
- 7 H
Haystackhaystack.deepset.aiA free toolkit that links components such as search, routing, memory, and text generation into pipelines.
- 8 L
LlamaIndexllamaindex.aiA freemium document framework that parses files, extracts data, and builds retrieval indexes.
- 9 L
LangChainlangchain.comA free, open-source toolkit with ready-made agent designs and connections to models and tools.
- 10 CACrewAI AMPcrewai.com
CrewAI AMP is an agent management platform for building, deploying, governing, and scaling AI agent workflows across enterprise applications, with or without…
- 11 V
Vercelvercel.comVercel describes itself as infrastructure for building, deploying, securing, observing, and scaling apps and agents.
- 12 DDSPydspy.ai
DSPy is a Python framework for building AI systems by expressing tasks as structured signatures instead of prompts.
- 13 PLPathway Live Data Frameworkpathway.com
A freemium Python framework that processes batch and live streams for analytics, ETL, and RAG.
- 14 LLettaletta.com
- 15 NNNVIDIA NeMo Guardrailsgithub.com
- 16 AAgentScopeagentscope.io
- 17 GGenkitgenkit.dev
- 18 LLMQLlmql.ai
A free, open-source Python framework with agents, tools, and RAG support.
- 19 ABApache Burrburr.apache.org
A free, open-source Python framework for agents, RAG, and workflow graphs.
- 20 AAutoGenmicrosoft.github.io
A free toolkit for agent setups that run on Linux, macOS, or Windows and connect to models and APIs.
- 21 ASAWS Strands Agentsstrandsagents.com
- 22 LLangChain4jdocs.langchain4j.dev
A free framework available for Linux, macOS, and Windows.
- 23 LLangroidlangroid.github.io
A free, open-source Python framework with agents, tools, RAG, and workflow graphs.
- 24 MGMicrosoft GraphRAGmicrosoft.github.io
A free, open-source Python framework for RAG with prompt optimization.
- 25 OOrchestradocs.orchestra.org
A free, open-source Python framework with agents, tools, and RAG support.
Places #1, #2, #3, #4, #5 on this board are open to sponsors. Take #1 · Other ways to advertise
How to choose
Which platforms does it need to run on?
Start with the platform you plan to use. The board lists Linux, Windows, macOS, web, API, and self-hosted support, so check the framework's entry against your setup.
Which framework features do I need?
Choose based on the work you need to do. Compare RAG support, agent and tool use, workflow graphs, and prompt optimization rather than treating them as interchangeable features.
Which programming language should I look for?
Check the primary language and whether JavaScript or TypeScript support matters for your project. The board lists both so you can compare them before choosing.
How do I compare free plans and paid prices?
Check whether a free plan is available, then compare the paid starting price where one is listed. For example, Agno lists paid plans from $150 per month with a 14-day trial, while Flowise lists paid plans from $35 per month.
What should I check about the API and license?
If you need a public API, check its mark on the board. If you need to read or change the code, check the open-source mark and the license details before deciding.
Questions
How can I tell whether a framework has a free plan?
Check the free-tier mark and pricing details. A free plan and a free trial are separate details, so look for both.
What does RAG support mean on this framework list?
RAG stands for retrieval-augmented generation. The board compares whether frameworks support it.
Which platforms should I compare before choosing a framework?
Check Linux, Windows, macOS, web, API, and self-hosted support against the environment you need.
How do I check whether a framework is open source?
Check the open-source mark and the listed license. The mark alone does not tell you the license terms.
Some top positions on this board can be paid placements, standing where they were sold. The facts on each platform are not for sale. How we rank · Disclosure