Open-source framework

DeepEval and Confident AI: pricing and features

Name: DeepEval and Confident AI
Author: Confident AI

by Confident AI

Prices and features checked 2026-10-17 on the vendor's own pages. Anything we could not confirm says “not verified”.

What is DeepEval and Confident AI? DeepEval is an open-source Python framework for unit-testing LLM apps; Confident AI is the hosted platform for test reports, tracing, datasets, annotation and prompt versioning.

Best for: Python teams that want pytest-style LLM tests with ready-made RAG and agent metrics, with an optional hosted platform.

Pricing

Free tier: Free: 2 seats, 1 project, 5 test runs/week, 1 GB-month of trace spans [source, checked 2026-10-17]
Entry paid price: Starter $200/month per organization: unlimited seats, 5 projects, 5 GB-months, then $1 per GB-month [source, checked 2026-10-17]
What you pay for (meter): Flat monthly fee per organization plus trace spans in GB-months [source]
Licence: DeepEval: Apache-2.0. Confident AI: hosted service [source]
Self-hosting: DeepEval runs locally; Confident AI on-prem on Enterprise [source]
Data retention: Retention billed in GB-months; adjustable [source]

Prices are list prices in USD as shown on the vendor page on the checked date. Vendors change plans often; follow the source link before you buy.

Features

OpenTelemetry	Confident AI docs include an Integrations & OTEL section [source]
CI gating	Unit testing in CI/CD [source]
LLM-as-judge	G-Eval and LLM-judged RAG and agent metrics [source]
Human annotation	Annotation queues on Starter and above [source]
Prompt management	Prompt versioning on the free plan [source]
Dataset versioning	Metric and dataset versioning on Team ($2,000/month) [source]
SOC 2 / HIPAA	SOC 2 on Team; HIPAA on Enterprise [source]

“not verified” means we did not find it on a vendor page; it may still exist. Corrections with a source link are welcome via the submit form.

More on DeepEval

Our directory entry covers what DeepEval tests, its licence and how to run it: DeepEval on Evals Review.

Compare

Other tools: Langfuse · Braintrust · LangSmith · Arize AX and Phoenix · Promptfoo · Galileo (Splunk Agent Observability) · Maxim AI · Helicone · Comet Opik · W&B Weave · Ragas

Vendors: want a labelled featured slot on tool pages like this one? Sponsorships are always marked “Sponsored” and never change table order, verdicts or facts. See placements and how to book.

Sources

Last checked 2026-10-17. Data: tools.json · tools.csv (CC BY 4.0). Canonical: https://evalsreview.com/tools/deepeval