Rankings

LLM Evals

#	Tool	Support Rate	95% CI	Trend	Models	Prompts
1	LALangSmith	33.0%(330/1000)	30-36%	0.0%	84%	100%
2	BRBraintrust	30.3%(303/1000)	28-33%	0.0%	53%	100%
3	ARArize AI	4.7%(47/1000)	4-6%	0.0%	37%	100%
4	RARagas	4.7%(47/1000)	4-6%	0.0%	63%	100%
5	WEWeights & Biases	3.9%(39/1000)	3-5%	0.0%	32%	100%
6	DEDeepEval	3.7%(37/1000)	3-5%	0.0%	16%	83%
7	LALangChain	2.7%(27/1000)	2-4%	0.0%	26%	83%
8	LALangfuse	2.2%(22/1000)	1-3%	0.0%	26%	67%
9	HUHumanFirst	1.8%(18/1000)	1-3%	0.0%	5%	100%
10	HUHumanloop	1.7%(17/1000)	1-3%	0.0%	26%	83%
11	OPOpenAI	1.3%(13/1000)	1-2%	0.0%	26%	67%
12	LLLlamaIndex	1.2%(12/1000)	1-2%	0.0%	5%	100%
13	PRPromptfoo	1.1%(11/1000)	1-2%	0.0%	21%	83%
14	HEHelicone	0.6%(6/1000)	0-1%	0.0%	16%	50%
15	ARArize Phoenix	0.6%(6/1000)	0-1%	0.0%	21%	67%
16	VEVellum	0.5%(5/1000)	0-1%	0.0%	5%	33%
17	UPUpTrain	0.4%(4/1000)	0-1%	0.0%	5%	33%
18	DADatadog	0.4%(4/1000)	0-1%	0.0%	11%	33%
19	MLMLflow	0.3%(3/1000)	0-1%	0.0%	5%	33%
20	TRTruLens	0.3%(3/1000)	0-1%	0.0%	11%	50%
21	TRTruEra	0.2%(2/1000)	0-1%	0.0%	11%	33%
22	LMLMSYS Chatbot Arena	0.2%(2/1000)	0-1%	0.0%	5%	33%
23	PAPatronus AI	0.2%(2/1000)	0-1%	0.0%	11%	33%
24	PRPromptLayer	0.1%(1/1000)	0-1%	0.0%	5%	17%
25	FIFireflies.ai	0.1%(1/1000)	0-1%	0.0%	5%	17%
26	GCGCP Vertex AI	0.1%(1/1000)	0-1%	0.0%	5%	17%
27	ZEZendesk	0.1%(1/1000)	0-1%	0.0%	5%	17%

Loading rankings...

#	Tool	Support Rate	95% CI	Trend	Models	Prompts
1	LALangSmith	33.0%(330/1000)	30-36%	0.0%	84%	100%
2	BRBraintrust	30.3%(303/1000)	28-33%	0.0%	53%	100%
3	ARArize AI	4.7%(47/1000)	4-6%	0.0%	37%	100%
4	RARagas	4.7%(47/1000)	4-6%	0.0%	63%	100%
5	WEWeights & Biases	3.9%(39/1000)	3-5%	0.0%	32%	100%
6	DEDeepEval	3.7%(37/1000)	3-5%	0.0%	16%	83%
7	LALangChain	2.7%(27/1000)	2-4%	0.0%	26%	83%
8	LALangfuse	2.2%(22/1000)	1-3%	0.0%	26%	67%
9	HUHumanFirst	1.8%(18/1000)	1-3%	0.0%	5%	100%
10	HUHumanloop	1.7%(17/1000)	1-3%	0.0%	26%	83%
11	OPOpenAI	1.3%(13/1000)	1-2%	0.0%	26%	67%
12	LLLlamaIndex	1.2%(12/1000)	1-2%	0.0%	5%	100%
13	PRPromptfoo	1.1%(11/1000)	1-2%	0.0%	21%	83%
14	HEHelicone	0.6%(6/1000)	0-1%	0.0%	16%	50%
15	ARArize Phoenix	0.6%(6/1000)	0-1%	0.0%	21%	67%
16	VEVellum	0.5%(5/1000)	0-1%	0.0%	5%	33%
17	UPUpTrain	0.4%(4/1000)	0-1%	0.0%	5%	33%
18	DADatadog	0.4%(4/1000)	0-1%	0.0%	11%	33%
19	MLMLflow	0.3%(3/1000)	0-1%	0.0%	5%	33%
20	TRTruLens	0.3%(3/1000)	0-1%	0.0%	11%	50%
21	TRTruEra	0.2%(2/1000)	0-1%	0.0%	11%	33%
22	LMLMSYS Chatbot Arena	0.2%(2/1000)	0-1%	0.0%	5%	33%
23	PAPatronus AI	0.2%(2/1000)	0-1%	0.0%	11%	33%
24	PRPromptLayer	0.1%(1/1000)	0-1%	0.0%	5%	17%
25	FIFireflies.ai	0.1%(1/1000)	0-1%	0.0%	5%	17%
26	GCGCP Vertex AI	0.1%(1/1000)	0-1%	0.0%	5%	17%
27	ZEZendesk	0.1%(1/1000)	0-1%	0.0%	5%	17%