AI screening · Candidate interview scoring
Candidate interview scoring with an interview scorecard and rubric
The short answer
Candidate interview scoring means grading each answer against a written rubric rather than a gut impression, so two candidates who gave the same quality answer get the same number. InterviewAgent.ai scores every first-round interview against anchored 1 to 5 criteria you define, links each score to the transcript line that earned it, and ranks the shortlist. A recruiter reviews the evidence and decides.
Last updated July 2026
Candidate interview scoring goes wrong the moment two interviewers grade the same answer differently. Without a shared rubric, scores reflect the reviewer mood and biases as much as the candidate, and the results are impossible to compare or defend.
InterviewAgent.ai brings rubric-based candidate interview scoring to the first round. The agent conducts a structured screen, then scores each answer against the same rubric for every candidate, producing comparable scorecards with the transcript evidence behind each rating. Recruiters review the ranked results and make the final decision, while the scoring stays transparent, consented, AI-disclosed, and bias-audited for EEOC and NYC Local Law 144.
Interview · score · rank · recruiter reviews · from $149/mo
First-round interview
Candidate consented · AI-conducted00:00 · AI Interviewer
Run the sample interview to watch the AI ask, follow up and score against your rubric.
Scored report
RubricThe report assembles after the interview: overall score, rubric, highlights and a recommendation. You make the final call.
Highlights
Recommendation only · a recruiter makes the final decision
Ranked shortlist
Live, interactive · consent-first · no signup needed
Structured & consistent · bias-audited (EEOC / NYC Local Law 144) · you make the final call
Human-in-the-loop you decide
EEOC and LL144 bias-audited
Why it works
What your team gets with candidate interview scoring
One rubric for all
Every answer is scored against the same rubric, so candidates are compared on identical criteria rather than on who interviewed them.
Evidence per score
Each rating links to the transcript moment that earned it, so a scorecard is explainable rather than a number you have to trust blindly.
Defensible results
Consistent, transparent scoring with bias auditing gives you results you can stand behind under EEOC and NYC Local Law 144.
What it handles
Interviewed, scored and shortlisted on autopilot
The agent invites each applicant, runs a role-tailored screening interview by voice or video, asks smart follow-ups, scores every answer against your rubric, and advances the strongest candidates into a ranked shortlist for your recruiters to review.
- Scores every answer against a consistent rubric
- Produces comparable scorecards across all candidates
- Links each score to transcript evidence
- Ranks a shortlist for recruiter review
- Keeps scoring transparent and bias-audited
Why InterviewAgent.ai
One agent that runs the whole first round
Not a one-way video tool, not a six-figure assessment suite, and not a staffing agency. Interview, score, rank and hand off in one place, shaped to the roles and rubric you already hire on.
Interviews every applicant
A role-tailored screening interview runs by voice or video, with smart follow-ups, on the candidate's schedule. Applicants consent and are told they are speaking with AI, so no qualified person waits days for a first call.
Scores to your rubric
Every answer is scored against the same structured rubric, with transcripts and highlights, so candidates are compared consistently and the scoring stays bias-audited against EEOC guidance and NYC Local Law 144.
Ranks the shortlist
The strongest candidates are advanced into a ranked shortlist your recruiters review. The agent never auto-hires or rejects, it only surfaces who to talk to next, and your team makes every decision.
At a glance
A 1 to 5 interview scoring scale, with anchors that mean something
| Score | What it means | What the answer looked like |
|---|---|---|
| 1 | Well below the bar | No relevant example. Talks about the topic in general terms, never about anything they did |
| 2 | Below the bar | A real example, but thin: no context, no specifics, no outcome, and it falls apart under a follow-up |
| 3 | Meets the bar | A concrete example with situation, action and result. Answers the follow-up without prompting |
| 4 | Above the bar | Specific, quantified, and shows reasoning about the trade-offs they chose between |
| 5 | Well above the bar | All of the above, plus what they would do differently and what the experience changed about how they work |
Anchors are written before screening starts. A scale without anchors is just five different opinions.
How do you score a candidate in an interview?
You score against defined criteria, not against the other candidates and not against your impression of the person. Pick the three to five competencies the job genuinely requires, write what a weak, adequate and strong answer looks like for each one, and grade every candidate on that. The scale itself matters less than the anchors: a 1 to 5 with written descriptions beats a 1 to 10 where nobody knows what a 7 means.
Score answer by answer while the evidence is in front of you, and record the quote that drove the rating. That last part is what turns a score into something you can defend, whether the person asking is a hiring manager who disagrees or, less comfortably, a lawyer. We publish a copyable interview scorecard template with the anchors already written.
What is an interview scorecard?
An interview scorecard is a single sheet, per candidate, that lists the competencies being assessed, the score given for each, the evidence behind that score, and an overall recommendation. It exists so that the hiring conversation is about what candidates actually said rather than who is remembered most vividly by whoever spoke last.
A good scorecard has weights, because not every competency matters equally. If technical judgment is twice as important as written communication for the role, say so on the card and weight the score. What must never appear on a scorecard is anything about a protected characteristic, or a proxy for one: age, accent, where someone went to school if it is not a genuine requirement, or a note about culture fit that really means the person felt unfamiliar.
Can AI score an interview fairly?
It can be more consistent than a panel of humans, which is a lower bar than it sounds. Human interview scores drift with fatigue, with who was interviewed immediately before, and with how similar the candidate feels to the interviewer. Applying one rubric identically to 400 people is precisely the kind of task software does not get bored of.
Consistency is not the same as fairness, though, and this is where the diligence goes. A model trained on past hiring can inherit past bias, which is why the scoring here is audited for adverse impact under EEOC guidance and NYC Local Law 144, why every score shows its evidence, and why the agent never rejects anyone. It ranks and explains; a human reads the transcript and decides.
What should you never score a candidate on?
Anything not required to do the job. That covers the obvious protected characteristics under US law, and it also covers the proxies people slip into scorecards without noticing: how polished someone sounds, whether they seemed confident, whether they would be fun to grab a beer with. Confidence is not competence, and comfort is not a competency.
Scoring appearance, tone of voice or facial expression is a specific trap in video interviewing, and one of the reasons some vendors quietly retired their facial analysis features. We score the substance of the answer against your rubric, from the transcript. If a criterion cannot be written down and defended as job-relevant, it does not belong on the card.
How do you automate interview scorecards?
You automate a scorecard by moving the scoring to the moment the answer is given rather than the moment someone finds time to write it up. The card is generated as the interview happens, each criterion is scored against anchors you wrote before applications opened, and the transcript line that produced each rating is attached to it. Nobody types a card from memory two days later, which is where most of the inconsistency in interview scoring actually comes from.
What you cannot automate is the rubric itself. Someone has to decide which four to six competencies the role genuinely requires and write what a 1, a 3 and a 5 look like for each, in job-related terms. That is an hour of work per role family and it is the hour that determines whether the automation produces something defensible or something that merely looks tidy. A candidate assessment scorecard filled automatically against vague criteria is faster, not better.
The practical difference shows up at the debrief. When every card was produced the same way and cites evidence, the conversation is about what candidates said. When cards were written from recollection, the conversation is about who remembers the interview most vividly, which is usually whoever spoke last.
- Write four to six job-related competencies with anchored 1 to 5 levels before applications open
- Score each answer as it is given, not from memory afterwards
- Attach the transcript line that produced every rating
- Weight the competencies, because they are rarely equally important
- Keep protected characteristics and their proxies off the card entirely
Good questions
Questions about candidate interview scoring
Explore more
More ways hiring teams screen with InterviewAgent.ai
AI recruiter interview
Give every applicant an AI recruiter interview, then rank the results.
Learn moreFirst round interview screening
Own the first round: every applicant screened, scored, and ranked.
Learn moreHigh-volume hiring software
Screen thousands of applicants without thousands of phone calls.
Learn moreStop running first-round calls by hand. Put screening on autopilot.
Set your role and rubric and the agent interviews every applicant, scores each answer, and ranks a shortlist for your team. The agent advances candidates, your recruiters make every hiring decision.
Role-tailored questions · bias-audited to EEOC and LL144 · human-in-the-loop