Free and open first
Best LLM Application Development Frameworks in 2026
Frameworks for LLM applications let you create software that uses language models. They may provide RAG, agent and tool calling, workflow graphs, prompt tuning, and JavaScript or TypeScript SDK options.
- 49 apps
- Research read 9 Oct 2026
- How the order is worked out
- 1
Scanopy
Free plan Open source APILinuxMac+3Scanopy focuses on documenting network assets and relationships, with self-hosted and cloud options and plan-dependent sharing tools.
- 2
Vellum
Free plan Open source AndroidAPIExtension+5Vellum offers a personal assistant with saved context, skills, integrations and approval controls.
- 3
Flowise
Free plan APILinuxMac+3Flowise offers visual workflow construction, integrations, and deployment options, but its wind-down is a central consideration.
- 4
CrewAI AMP
Free plan APISelf-hostedWebChoose CrewAI AMP if your team needs several ways to build multi-agent workflows alongside tracing and governance controls.
- 5
LlamaIndex
Free plan APILinuxSelf-hosted+1LlamaIndex combines document parsing, extraction, classification, and retrieval pipelines for teams building document-centered AI workflows.
- 6
Haystack
Free plan APISelf-hostedHaystack provides a free framework for assembling AI systems from modular pipelines, with integrations and self-hosted deployment options.
- 7
LangChain
Free plan APISelf-hostedChoose LangChain to build agents around models and tools using its configurable harness, middleware, and wide range of integrations.
- 8
Langflow
Free plan APILinuxMac+3Langflow offers visual workflow building alongside Python extensibility, API use, and agent and MCP support. Its execution and isolation model requires care, particularly for multi-tenant deployments.
- 9
DSPy
Free plan APISelf-hostedChoose DSPy if you are building AI programs in Python and want task signatures, composable modules, and prompt optimization.
- 10
OpenRAG
Free plan APISelf-hostedWebOpenRAG combines document retrieval, source-linked answers and self-managed deployment in a free framework.
- 11
txtai
Free plan APILinuxMac+2txtai brings search, language model pipelines, workflows, and agents into one open-source framework.
- 12
Pathway Live Data Framework
Free plan APISelf-hostedChoose Pathway if you need Python or SQL pipelines that combine live data processing with analytics or AI tooling.
- 13
AgentScope
Free plan LinuxMacWeb+1 - 14
- 15
Apache Burr
Free plan LinuxMacWindows - 16
AutoGen
Free plan LinuxMacWindows - 17
AWS Strands Agents
Free plan LinuxMacWindows - 18
Genkit
Free plan LinuxMacWeb+1 - 19
Letta
Free plan LinuxMacWeb+1 - 20
BAML
Free plan Web - 21
LangChain4j
Free plan LinuxMacWindows - 22
LMQL
Free plan LinuxMacWeb+1 - 23
NVIDIA NeMo Guardrails
Free plan LinuxMacWindows - 24
Agno
Free plan Web - 25
Langroid
Free plan LinuxMacWindows
#1Places #1, #2, #3, #4, #5 on this list can be bought by the makers of the software on it. See the price
Compare free access, starting prices, trial periods, main languages, supported platforms, and open-source licences. Before selecting one, verify support for Linux, Windows, macOS, web, API, or self-hosted deployment.
Questions
Are free plans available for these frameworks?
Some frameworks on the list include a free plan. Check the plan terms for the framework you are considering.
Do any of these frameworks publish open-source code?
Several listed tools provide open-source code. Review the licence for the framework you choose.
Can I try a framework before paying?
Some entries include a free trial; Agno specifies a 14-day trial.
Where can these frameworks run?
The list includes Linux, Windows, macOS, web, API, and self-hosted options. Confirm the platform support for your chosen tool.
Which comparison fields are provided?
Fields include free plan, paid-from price, primary language, RAG, agent and tool use, workflow graphs, prompt optimization, licence, and JavaScript or TypeScript SDK.
More in Developer Tools
- Localization Management Software63
- Low Code No Code Software26
- Low-Code Business Process Management28
- No Code Platform29
- PaaS tools31
- Repository Management Software22
- Site Reliability Engineering Platforms13
- Software Development Analytics Tools22
- Source Code Management30
- Video Platform as a Service (VPaaS) Software23
- Website Development tools30
- WebSocket Tools55