Free and open first
Best AI Model Explainability Software in 2026
These tools let you inspect the path a model follows to produce predictions. Available views may include feature attribution, counterfactual explanations, fairness analysis, and audit reports.
- 29 apps
- Research read 9 Oct 2026
- How the order is worked out
- 1
Arthur
Free plan APISelf-hostedWebArthur combines agent discovery, observability, and policy controls with hosted, on-premises, and hybrid deployment choices.
- 2
Fiddler AI
Free plan APISelf-hostedWeb - 3
AIX360
Free plan APILinuxMac+2 - 4
Aequitas
Free plan APILinuxMac+3 - 5
auditor
Free plan LinuxMacWindows - 6
DiCE
Free plan LinuxMacWindows - 7
ExplainerDashboard
Free plan LinuxMacWeb+1 - 8
ELI5
Free plan LinuxMacWindows - 9
Arize AI
Free plan APISelf-hostedWeb - 10
fastshap
Free plan LinuxMacWindows - 11
InterpretML
Free plan LinuxMacWindows - 12
OmniXAI
Free plan LinuxMacWindows - 13
PDPbox
Free plan LinuxMacWindows - 14
Responsible AI Toolbox
Free plan LinuxMacWindows - 15
Captum
Free plan LinuxMacSelf-hosted+1 - 16
DALEX
Free plan - 17
Fairlearn
Free plan - 18
modelStudio
Free plan Web - 19
SAS Advanced Analytics
by SAS Advanced AnalyticsFree trial APISelf-hostedChoose SAS Advanced Analytics if your organization needs broad analytics and model-management capabilities with governance tools and flexible deployment.
- 20
treeshap
Free plan LinuxMacWindows - 21
Vertex AI Vector Search
Free trial APIWebChoose Vertex AI Vector Search for cloud search, recommendations or generative AI retrieval when its embedding modes, filters and endpoint choices fit your application.
5.6 Visit site - 22
Shapash
Free plan Web - 23
SHAP
Free plan - 24
What-If Tool
Free plan Web - 25
Zeno
Free plan Web
#1Places #1, #2, #3, #4, #5 on this list can be bought by the makers of the software on it. See the price
When selecting software, review free-plan limits, trial terms, paid starting prices, supported model types, and deployment choices such as Linux, macOS, Windows, web, API, or self-hosting. For code you may read or modify, review the licence.
Questions
Are free plans available?
Tools such as Aequitas, AIX360, Captum, DALEX, DiCE, ELI5, ExplainerDashboard, and Fairlearn provide free plans. Check plan limits before choosing.
Can I use these tools on my own server?
Some category options support self-hosting. Confirm the specific tool's deployment method and operating-system support.
What explainability features should I compare?
Review each tool's support for feature attribution, counterfactual explanations, fairness analysis, and audit reports. The right mix depends on how you review model decisions.
What paid starting prices are listed?
Arize AI lists paid plans from $50 per month, and Arthur lists paid plans from $60 per month. Alibi lists pricing on request.
Can I inspect or change the source code?
Check the software licence for the tool you choose. Licence terms determine whether you can read, modify, and redistribute its code.
More in AI Tools
- AI Music Apps22
- AI Music Plugins27
- AI Music Prompt Generators23
- AI Music Video Generators23
- AI Orchestration Software20
- AI Outfit Generators31
- AI Podcast Music Generators36
- AI Poem Generators26
- AI Powered Cybersecurity Compliance Software13
- AI Powered Regulatory Compliance Software18
- AI Rap Generators28
- AI Reggaeton Music Generators28