Free and open first
Best AI Model Explainability Software in 2026
- 29 apps
- Research read 9 Oct 2026
- How the order is worked out
- 1
Arthur
Free plan APISelf-hostedWebArthur combines agent discovery, observability, and policy controls with hosted, on-premises, and hybrid deployment choices.
- 2
Fiddler AI
Free plan APISelf-hostedWeb - 3
AIX360
Free plan LinuxMacWindows - 4
Aequitas
Free plan LinuxWeb - 5
auditor
Free plan LinuxMacWindows - 6
DiCE
Free plan LinuxMacWindows - 7
ExplainerDashboard
Free plan LinuxMacWeb+1 - 8
ELI5
Free plan LinuxMacWindows - 9
Arize AI
Free plan Web - 10
fastshap
Free plan LinuxMacWindows - 11
InterpretML
Free plan LinuxMacWindows - 12
OmniXAI
Free plan LinuxMacWindows - 13
PDPbox
Free plan LinuxMacWindows - 14
Responsible AI Toolbox
Free plan LinuxMacWindows - 15
Captum
Free plan - 16
DALEX
Free plan - 17
Fairlearn
Free plan - 18
modelStudio
Free plan Web - 19
SAS Advanced Analytics
by SAS Advanced AnalyticsFree trial APISelf-hostedChoose SAS Advanced Analytics if your organization needs broad analytics and model-management capabilities with governance tools and flexible deployment.
- 20
treeshap
Free plan LinuxMacWindows - 21
Vertex AI Vector Search
Free trial APIWebChoose Vertex AI Vector Search for cloud search, recommendations or generative AI retrieval when its embedding modes, filters and endpoint choices fit your application.
5.6 Visit site - 22
Shapash
Free plan Web - 23
SHAP
Free plan - 24
What-If Tool
Free plan Web - 25
Zeno
Free plan Web
#1Places #1, #2, #3, #4, #5 on this list can be bought by the makers of the software on it. See the price