Home / Scoring

A score you can read, question and challenge.

Every Lab answer is scored on five anchored dimensions, through three passes, against a rubric we publish — with a human appeal if you disagree.

The scoring pipeline

  1. Input

    Your answer

    Scored against the question's rubric anchors and dimension weights.

  2. Pass 1

    Evaluator

    Scores each dimension against the anchored rubric, citing evidence from the answer.

  3. Pass 2

    Challenger

    Reviews adversarially: technical errors, invented techniques or CVEs, inflated scores.

  4. Pass 3

    Reconciler

    Resolves disagreements, applies weighting, writes the model answer.

  5. Output

    Score + confidence

    Final score with a High, Medium or Low confidence flag.

Answers are evaluated with Anthropic's Claude API; Anthropic does not train models on API inputs. See the Privacy Policy.

Five dimensions

What gets scored, 1–10 each.

01 · TI

Threat Identification

Attack vectors, techniques and attacker behaviour — precise ATT&CK mapping at top scores.

02 · CR

Containment & Response

Limits blast radius while preserving evidence, aware of obligations such as CERT-In, GDPR and DPDPA.

03 · AB

Architecture & Blast Radius

How components connect, what an attacker can reach, where segmentation helps.

04 · CQ

Communication Quality

Clear, structured and right for the audience — board briefing to technical deep-dive.

05 · FA

Framework Application

ATT&CK, NIST, CIS and ISO 27001 applied correctly — and knowing when they don't apply.

→

Weighted per question

Each question category weights the dimensions differently. See the weighting matrix.

Reading a score

Every score maps to a plain-language band.

Bands are visible from day one, before there is enough cohort data for percentiles.

Developing1.0–3.9
Foundation4.0–5.9
Proficient6.0–7.4
Advanced7.5–8.9
Expert9.0–10
Confidence levels
ConfidenceWhen it applies
HighPass 1 and Pass 2 agree within one point on all five dimensions; no critical errors.
MediumOne or two dimensions disagree by 2 points; no critical errors.
LowA disagreement of 3+ points or a critical error. Flagged "Review recommended" and queued for internal review.
Human appeal

Challenge any score within 14 days.

Email your session ID and what you believe was mis-scored. A security engineer reviews the full transcript and rubric application within 7 business days.

What we don't score

Reasoning, not polish.

Not grammar beyond clarity, not typing speed, not accent in voice mode, not tool or vendor preference, and not agreement with our model answer.

Read the full rubric.

Score anchors, weighting, confidence and worked examples.