AI evaluation

AI evaluation that shows
what to fix first.

Latent Lens measures the quality of AI answers the way an engineer would: claim by claim, instruction by instruction, with scores you can reproduce and a concrete fix for every failure.

What AI evaluation means

AI evaluation is the practice of judging the answers an AI system produces, separately from the system that produced them. A model that writes an answer cannot be trusted to grade it. An evaluation platform keeps the judge apart, fixes the rubric and stores every run so results can be compared over time.

How Latent Lens evaluates an answer

  1. Instructions: explicit constraints are extracted from the prompt (length, format, JSON, language, things to include or avoid) and checked one by one.
  2. Claims: the response is split into atomic factual claims.
  3. Grounding: each claim is matched to your ground truth and labeled supported, partial, contradicted or unsupported. Numeric drift, invented entities and flipped facts are caught deterministically, and an open hallucination model (HHEM) checks meaning.
  4. Scoring: faithfulness, hallucination rate, instruction adherence, relevance and an overall score are computed in code from those labels, never guessed by a model.

Every report ends with a failure taxonomy and a remediation step per failure type, so your team knows what to change in the prompt, the retrieval or the guardrails.

Why scores computed in code matter

When a model invents the score, the same answer can get 72 today and 81 tomorrow. Latent Lens only lets models assign labels. The maths is fixed and versioned (the rubric version is stamped on every run), so a change in score always means a change in the answer.

Where to start

Questions

Frequently asked

What is AI evaluation?

AI evaluation is judging the quality of answers an AI system produces, with a judge kept separate from the generator, a fixed rubric and stored runs that can be reproduced and compared.

Which metrics does Latent Lens report?

Faithfulness, hallucination rate, instruction adherence, relevance and an overall score, plus a failure taxonomy with a fix for each failure type.

Do I need an API key to use it?

No. The free checker runs the full engine with no key. An LLM judge from OpenAI, Anthropic or Google can be added for deeper meaning-level checks.

See it on your own answer

Paste a prompt, the AI response and optional ground truth. You get the scored report in seconds, free.

Open the free checker