Supplier scorecard
The structured, periodically-reviewed performance rating that drives whether a supplier stays on the approved supplier list — combining quality, delivery, service and compliance metrics into a tier that controls audit frequency, sourcing volume and escalation. What 21 CFR 820.50, ICH Q7 §17, ISO 13485 §7.4, ISO 9001 §8.4 and the GFSI schemes actually require, and the scorecard shape that survives FDA, Notified Body and certification-body inspection.
01What a supplier scorecard actually is
A supplier scorecard is a structured, periodically-reviewed rating that aggregates a supplier's measurable performance across quality, delivery, service, compliance and risk into a single tier that drives downstream decisions. The downstream decisions are not advisory: they control whether the supplier stays on the approved supplier list, how often they are audited, what volume of business they can be awarded, how strict the incoming inspection regime is, and whether sourcing teams must dual-source against them.
The scorecard is not a one-page PowerPoint your buyer writes at year end. It is a quality-system control with the same evidence rules as any other QMS record: defined inputs, defined calculation, defined review cadence, documented sign-off, retained history, audit-trail-compliant change records. It is one of the records an inspector will ask for early — often immediately after the approved supplier list itself.
02Why regulators expect scorecards even when they don't name them
No regulation uses the word 'scorecard' as a clause heading, but every major regime requires the substance: ongoing evaluation of suppliers, with documented criteria, with action taken when performance degrades. 21 CFR 820.50(a)(2) requires manufacturers to 'establish and maintain records of acceptable suppliers, contractors and consultants' — 'acceptable' is the operative word. ISO 13485 §7.4.1 requires re-evaluation 'at planned intervals or upon changes affecting the supplier's ability'. ICH Q7 §17.40 requires that 'the quality of materials supplied by these intermediaries should be evaluated and periodically reassessed'.
The scorecard is the artefact that satisfies all of these. It demonstrates ongoing evaluation, with documented criteria, with traceable performance data, with a defined re-evaluation interval, with named owners of the decision. Without it, 'acceptable' is just a yes/no flag with no audit trail of how the yes/no was reached.
There is a second, commercial reason. Supplier failures are one of the largest sources of recall, market-action and revenue loss for regulated manufacturers. A 2022 PWC supply-chain study found that 65% of pharmaceutical recalls had a root cause in a supplier or contract manufacturer. A scorecard that flags performance degradation before it produces a quality incident is the cheapest insurance any QMS can buy.
03Regulatory map — who requires what
Supplier evaluation and re-evaluation is one of the most consistent QMS expectations across regimes. The shape varies (some require named scorecards, some require any periodically-reviewed evaluation record); the substance is identical.
| Regime | Clause | What it requires |
|---|---|---|
| FDA devices (QSR/QMSR) | 21 CFR 820.50(a) | Establish requirements that suppliers / contractors / consultants must meet; evaluate and select on the basis of their ability to meet specified requirements; define the type and extent of control to be exercised based on evaluation results. |
| FDA devices | 21 CFR 820.50(a)(2) | Maintain records of acceptable suppliers — re-evaluation triggers must be defined. |
| FDA drugs | 21 CFR 211.84(d)(2) | Each lot of a component subject to identity testing or, if reliance on the supplier's CoA is justified, at least one specific identity test per lot — that 'justification' rests on supplier qualification status. |
| FDA drugs | FDA 2016 Quality Agreement guidance | Quality Agreements with contract manufacturers should specify performance metrics, communication, change-notification, and termination triggers. |
| FDA food | 21 CFR 117.420 / FSVP | Importers must verify that foreign suppliers' food is produced consistently with US food-safety requirements — periodic re-evaluation is explicit. |
| ICH | Q7 §17.40 | Agents / brokers / traders / distributors must be 'evaluated and periodically reassessed' for quality. |
| ICH | Q9 / Q10 | Supplier risk and quality management are PQS pillars — periodic risk reassessment expected. |
| EU GMP | Chapter 5 §5.27-5.30 | Selection, qualification, approval and maintenance of suppliers of active substances and excipients. |
| EU GMP | Chapter 7 | Outsourced activities — written contract, defined responsibilities, evaluation. |
| ISO 13485 | §7.4.1 | Documented criteria for evaluation and selection; criteria for re-evaluation; records of evaluation. |
| ISO 9001 | §8.4.1 | Determine and apply criteria for evaluation, selection, monitoring of performance, and re-evaluation of external providers. |
| EU MDR / IVDR | Annex IX | Notified Body oversight extends to critical suppliers; the manufacturer must show evidence of supplier control. |
| GFSI (BRCGS / SQF / FSSC) | Various | Each scheme requires approved-supplier programmes with performance monitoring and risk-based re-audit frequency. |
| DSCSA | FDA US drug-supply chain | Trading-partner verification — only authorised trading partners may exchange product; supplier qualification is part of the verification chain. |
04The five dimensions of a defensible scorecard
A scorecard that survives inspection has at least five dimensions, each with its own input metrics and weighting. Single-dimension scorecards (e.g. 'on-time delivery only') are widely cited as inadequate by Notified Bodies and FDA QSIT investigators because they miss the quality and compliance picture.
| Dimension | Typical metrics | Source |
|---|---|---|
| Quality | Lot acceptance rate, CoA accuracy, NCR rate per 1000 lots, OOS rate, complaint linkage rate | QC / LIMS, NCR module, complaint module |
| Delivery | On-time-in-full %, lead-time variance, schedule-adherence %, expedite frequency | Goods-receipt module, purchasing system |
| Service | RFQ response time, technical-query response time, complaint-resolution time, change-notification timeliness | Communication / portal logs |
| Compliance | Audit-finding count + class, regulatory action against the supplier, certification status currency, Quality Agreement in place + current revision | Audit-management module, regulator databases, document control |
| Risk | Geopolitical risk score, single-source flag, financial-health indicator, business-continuity capability, cyber-security posture (for service / data suppliers) | External risk feeds, supplier self-assessment |
Some organisations add a sixth dimension for sustainability / ethics — REACH, RoHS, conflict minerals, Modern Slavery Act, EU CSRD — particularly for raw-material and packaging suppliers. The number of dimensions is less important than the explicit documentation that every dimension has a defined input, a defined weighting and a defined tier-trigger threshold.
05Weighting and tiers — turning metrics into action
A scorecard is only useful if the score maps to an action. The standard pattern is a four-tier scheme that determines how the supplier is managed:
| Tier | Typical band | Action |
|---|---|---|
| Preferred | ≥ 90 | Award expansion eligible; audit every 24 months by desk audit; standard incoming inspection reduced to skip-lot. |
| Approved | 75-89 | Maintain current volume; audit every 18 months (mix of on-site and desk); standard incoming inspection. |
| Watch | 60-74 | Volume freeze; quarterly performance review; audit within 6 months on-site; enhanced incoming inspection. |
| Probationary / disapproved | < 60 | Containment plan triggered; CAPA opened against supplier; sourcing transitioned to alternates; removal from approved supplier list if not recovered within agreed period. |
The dimension weighting drives whether a single quality incident moves a supplier from Preferred to Watch in one period, or whether it takes a quality + delivery dual degradation. Defaults that survive scrutiny put quality + compliance at 60-70% of the total weight and delivery + service at 30-40%. Pure-delivery scorecards (the classic procurement metric) are now widely rejected by quality auditors as inadequate.
06Trigger events — when the periodic cadence isn't enough
Scorecards are usually scored on a quarterly cadence, but quarterly is too slow for some events. A defensible programme defines explicit trigger events that re-score the supplier immediately and force a documented review:
- Any critical or major NCR linked to material from the supplier.
- Any product complaint with root cause attributed to the supplier.
- Any recall (regulator-initiated or voluntary) involving the supplier.
- Any regulator action against the supplier (FDA Warning Letter, EU GMP non-compliance status, Notified Body certificate suspension).
- Any supplier-initiated change notification that affects a critical attribute (manufacturing site, sub-supplier of a critical input, QC method, release specification).
- Any failure to provide a Certificate of Analysis on time or to specification.
- Any change in ownership, financial-health flag, or business-continuity event affecting the supplier.
- Any cyber-security or data-integrity incident at a service / data supplier.
Trigger-event handling needs three things to be inspection-ready: timestamped logging of the trigger, a documented re-score within a defined SLA (usually 5 business days), and an explicit decision on whether tier changes and whether containment is needed. 'We knew, but didn't get around to re-scoring' is the response that gets you a Form 483.
07Supplier criticality and review cadence
Not every supplier gets the same scorecard treatment. ISO 13485 §7.4.1 and 21 CFR 820.50 both require that the type and extent of control be 'based on the evaluation results' and proportional to risk. The standard pattern is a three-tier criticality scheme that is independent of the performance tier above:
| Criticality | Definition | Scorecard cadence | Audit cadence |
|---|---|---|---|
| Critical | Material or service directly affects product safety, efficacy or compliance; single-source or limited-source; affects a regulatory filing | Monthly | 12-24 months on site |
| Major | Material or service affects product quality but with alternates available; or service has GxP impact | Quarterly | 18-36 months mix of on-site and desk |
| Standard / non-critical | Material or service does not affect product quality (e.g. office supplies, general cleaning supplies) | Annual | Self-assessment questionnaire every 2-3 years |
Criticality is not a performance metric — a critical supplier with poor performance moves to the Watch performance tier but stays at critical criticality. The two axes drive different decisions: criticality drives review depth and frequency, performance drives volume and containment.
08Quality Agreement integration
FDA's 2016 Contract Manufacturing Quality Agreement guidance and EU GMP Chapter 7 both expect a written Quality Agreement with every supplier whose output materially affects product quality. The Quality Agreement is the document that makes scorecard metrics enforceable — without it, an incoming-quality NCR is your problem; with it, it is a contractually-defined breach that triggers an agreed remediation path.
A Quality Agreement that integrates with a scorecard typically defines:
- Specifications that apply (referenced from controlled documents).
- Acceptance criteria (CoA contents, sampling plan, OOS handling).
- Change-notification triggers (manufacturing site, sub-supplier of a critical input, QC method, release specification, ownership).
- Notification SLAs (usually 30 days advance notice for major changes, immediate notice for safety / regulatory events).
- Performance commitments (on-time delivery %, lot-acceptance %, complaint-response time).
- Audit rights (frequency, notice period, for-cause unannounced audits).
- Escalation path and termination triggers tied explicitly to scorecard tiers.
09Data sources — what feeds the scorecard automatically
A scorecard that depends on manual data entry will drift; a scorecard that is fed automatically from the QMS subsystems and the ERP will not. The data sources that matter:
- Goods-receipt and incoming-inspection module: lot-acceptance rate, CoA accuracy, on-time-in-full %, lead-time variance.
- QC / LIMS module: incoming-QC results, OOS / OOT rate, sampling escalations.
- NCR module: NCRs opened against each supplier, classification, ageing, root-cause linkage.
- Complaint module: complaints with root cause attributed to the supplier.
- Audit-management module: audit findings by class, audit-result trend, scheduled vs actual audit dates.
- Document control module: Quality Agreement currency, supplier-CoA template currency, supplier-SOP review status.
- Change-control module: supplier-initiated change-notification volume and timeliness.
- Communication / supplier-portal logs: response times to RFQ, technical query, change request, CAPA assignment.
- External risk feeds (where subscribed): financial-health, geopolitical, regulator-action feeds.
Each data source needs an auditable connection — manual exports into a spreadsheet are not auditable in the Part 11 / Annex 11 sense. Either the scorecard pulls from the source system through a controlled integration with audit-trail continuity, or the source data is captured directly in the same system that owns the scorecard.
10Review cadence and governance
ISO 13485 §7.4.1 and ISO 9001 §8.4.1 both require re-evaluation 'at planned intervals'. The standard governance shape:
- Monthly: critical-supplier scorecard refresh; trigger-event re-scores within 5 business days.
- Quarterly: major-supplier scorecard refresh; tier-change decisions documented and signed by QA; supplier review meeting with the owning category manager.
- Annual: full re-qualification of all suppliers on the approved supplier list, including a formal supplier-management review with QA leadership and procurement.
- On trigger: ad-hoc re-scores and tier reviews per the trigger-event list above.
Supplier scorecards are a standing input to QMS management review (ISO 9001 §9.3 / ISO 13485 §5.6). The management-review pack should include: % of approved suppliers in each tier, count of tier changes in the period, count of trigger-event re-scores, supplier-CAPA status, top-10 highest-risk suppliers by combined criticality + tier.
11Common failure modes and 483 themes
Reading FDA Warning Letters, Notified Body deficiency reports and certification-body reports surfaces the same supplier-scorecard failure modes repeatedly:
- No re-evaluation at all — suppliers approved once at qualification, never reassessed. Direct breach of ISO 13485 §7.4.1 / 21 CFR 820.50(a).
- Single-dimension scorecards (delivery only, or quality only) — adequate for procurement, inadequate for the QMS.
- Manual scorecards in a spreadsheet — no audit trail, no controlled version history, no Part 11 compliance.
- Tier changes without documented decision rationale — the score moved, but no one signed the tier change.
- Trigger events not re-scored — a critical NCR opened against the supplier, scorecard still reads 'Preferred' three months later.
- Tier upgrades automated equally with downgrades — supplier laundering one good month back into Preferred status.
- Quality Agreement not aligned with scorecard — performance commitments in the agreement that are not measured in the scorecard, or scorecard metrics with no contractual basis.
- Approved supplier list still shows suppliers whose scorecard has been Probationary for 6+ months without explicit disposition.
- Sub-supplier changes notified by the supplier never reflected in the scorecard — the supplier's manufacturing site moved, your scorecard still shows the old risk profile.
- Foreign supplier verification gaps — for FDA-regulated food importers, missing or stale FSVP records on suppliers.
12Programme-level metrics that matter
Beyond the per-supplier score, the supplier-management programme itself needs metrics. A management-review-grade dashboard tracks at least six, trended quarterly:
- Approved supplier list size — total active suppliers by criticality tier.
- Distribution across performance tiers — % Preferred / Approved / Watch / Probationary, trended.
- Re-evaluation adherence — % of scheduled scorecard refreshes completed on plan, by criticality.
- Audit-schedule adherence for the supplier-audit programme — % of scheduled supplier audits completed on plan.
- Quality Agreement currency — % of critical suppliers with a current Quality Agreement under review-due date.
- Supplier-driven incident rate — number of NCRs / complaints / deviations / recalls in the period with root cause attributed to a supplier, trended.
13How V5 Ultimate handles supplier scorecards
Supplier scorecards in V5 are not a separate module bolted onto purchasing — they are a live aggregation of every supplier-relevant data point already captured by the QMS, with explicit links to the actions the score drives. The capabilities, end to end:
- Each approved supplier record carries criticality, current performance tier, score by dimension, contributing data points by row (clickable through to the source NCR, complaint, CoA, audit finding, change notification), Quality Agreement version + due date, contracted commitments + current performance against each, audit history with last finding count, and next scheduled audit date.
- Five-dimension scorecard out of the box (quality, delivery, service, compliance, risk) with configurable weighting per material category — critical APIs weighted differently than packaging differently than non-GxP service suppliers.
- Live data feeds from goods-receipt, QC, NCR, complaint, audit-management, change-control, document-control and the supplier portal — no manual data entry, full audit-trail continuity on every contributing data point.
- Trigger-event re-scores: NCRs above defined severity, complaints linked to a supplier, supplier-initiated change notifications, regulator-action feeds and Quality Agreement breaches all force a re-score within a documented SLA.
- Tier downgrades automatic; tier upgrades require explicit QA sign-off with documented decision rationale.
- Approved supplier list auto-updates from tier transitions: a supplier moved to Probationary is automatically marked 'hold for new POs' until QA disposition.
- Supplier portal — the supplier sees their own scorecard, their open CAPAs, their pending change requests and their Quality Agreement renewal status. Inbound change notifications enter directly into the V5 change-control system on the receiving side.
- Management-review pack auto-generated: tier distribution, re-evaluation adherence, supplier-driven incident rate, top-10 supplier risk list, all exportable for the quarterly QMS management-review meeting.
- Audit-management integration: a supplier moved to Watch or Probationary automatically schedules an on-site audit within 6 months; scorecard data feeds the auditor's pre-audit pack so the audit can be targeted at the actual risk pattern.
- Part 11 / Annex 11 by construction: every scorecard change carries an audit trail, every tier change is e-signed, every escalation triggers a controlled record.
Frequently asked questions
Q.How often should we re-score a supplier?+
Risk-based. Defaults that survive scrutiny: critical suppliers monthly, major suppliers quarterly, non-critical suppliers annually — plus immediate trigger-event re-scores for NCRs, complaints, regulator action, change notifications and Quality Agreement breaches. The cadence itself is auditable: an inspector will ask 'why monthly here, quarterly there?' and the answer must reference criticality.
Q.What weighting should we put on each dimension?+
There is no single right answer — the right weighting depends on the supplier category, the regulated regime and the risk profile of the materials involved. Sensible defaults for a regulated manufacturer put quality + compliance at 60-70% of the total and delivery + service at 30-40%. Pure-delivery scorecards (the classic procurement weighting) are widely rejected by quality auditors as inadequate for a regulated QMS.
Q.Can we share our scorecard with the supplier?+
Yes, and you usually should. Sharing the scorecard makes performance commitments visible, gives the supplier an early-warning signal before tier downgrades, and converts an adversarial 'you have a problem with our materials' conversation into a structured 'here is your tier, here are the contributing metrics, here is the trend' conversation. Most modern supplier portals — including V5's — make the scorecard supplier-visible by default, with the manufacturer in control of what's shown.
Q.What happens when a single-source critical supplier degrades?+
Single-source critical supplier degradation is one of the highest-impact events in a QMS. The standard response: immediate containment (review of recent lots in stock, hold on suspect material), CAPA opened against the supplier with named senior QA owner, accelerated audit on site within 30 days, dual-sourcing project initiated as a preventive action, increased incoming-inspection regime, and explicit risk acceptance documented at the management-review level if continued sourcing is needed before the corrective actions complete. Tier change to Probationary regardless of headline score.
Q.How does the scorecard interact with the Approved Supplier List?+
The Approved Supplier List (ASL) is the binary 'allowed to buy from' control. The scorecard is the graded 'how well are they doing' control. A supplier moving below the Probationary threshold should automatically suspend new POs and trigger a documented disposition decision: recover the supplier, transition to alternates, or remove from the ASL. ASL changes are themselves change-control events (per ISO 13485 §7.4.1 and 21 CFR 820.50).
Q.Do we need a scorecard for every supplier on the ASL?+
Substantively, yes — ISO 13485 §7.4.1 / 21 CFR 820.50 / ISO 9001 §8.4.1 all require re-evaluation at planned intervals for all suppliers. In practice, non-critical suppliers (office supplies, general cleaning supplies, non-GxP service providers) get a lightweight annual scorecard rather than the full five-dimension monthly treatment. The principle is proportionality, not exemption.
Q.How does supplier scorecard relate to supplier audit programme?+
They are two sides of the same loop. Audits feed the scorecard's compliance dimension; scorecard tier drives the audit-schedule frequency. A supplier moving to Watch automatically pulls forward the next on-site audit; a critical audit finding automatically moves the supplier toward Watch or Probationary. See our companion page on [audit management](/glossary/audit-management) for the audit side.
Q.What records do we keep, and for how long?+
Each scorecard refresh, each tier change with its sign-off, every contributing data point with full lineage to the source record (NCR, complaint, audit finding, CoA), the Quality Agreement history and the supplier audit history. Retention: as long as the supplier remains on the ASL, plus 5 years after de-approval, with longer retention if the supplier-related records support regulatory submissions or are referenced in a recall. ISO 13485 §4.2.5, 21 CFR 820.180 and EU GMP Chapter 4 §4.10 set the floor.
Primary sources
- 21 CFR 820.50 — Purchasing controls (medical devices)
- ICH Q7 §17 — Agents, brokers, traders, distributors, repackers and relabellers (APIs)
- ISO 13485:2016 §7.4 — Purchasing
- ISO 9001:2015 §8.4 — Control of externally provided processes, products and services
- EU GMP Chapter 5 §5.27-5.30 — Supplier qualification
- FDA Guidance — Contract Manufacturing Arrangements for Drugs: Quality Agreements (2016)
- FDA — Foreign Supplier Verification Programs (FSVP) under FSMA
- ISO 28000:2022 — Security and resilience: Security management systems for the supply chain
Further reading
- Audit managementSupplier audit results feed the scorecard; scorecard tier drives next audit frequency.
- NCREach incoming-quality NCR contributes to the scorecard's quality dimension.
- CAPASupplier CAPAs open against scorecard-driven trigger thresholds.
- ISO 13485Device QMS standard with explicit supplier-evaluation requirement in §7.4.
- Change controlA supplier-initiated change notification opens a change-control entry on the receiving side.
- DSCSADrug supply-chain integrity rests on the same supplier-qualification machinery.
- FSMA 204Food traceability requirements depend on qualified, monitored suppliers at every node.
- How V5 Ultimate runs supplier scorecardsLive scorecard fed by goods-receipt, QC, deviations, complaints and audit outcomes.
Explore this topic
Supplier scorecard sits inside this topic cluster in our glossary. Every neighbour is one click away.
Root-cause toolkit, SPC, capability and the rest of the QA practitioner's bench.
V5 Ultimate ships with the Supplier scorecard controls already wired in — audit trail, e-signatures, validation evidence. Free trial, no credit card, onboard in days, not months.
