IntelligenceSep 26, 2026 · 8 min

Building Supplier Scorecards From Returns Data

DA
Defne Aksoy
Data Lead

Quality inspection tells you whether a batch met a specification. Returns tell you whether customers accepted the product. Those are different questions, and the second one is the one that costs you money. Most merchants collect the second signal in enormous volume and never route it back to the people who made the goods.

A supplier scorecard built from returns closes that loop. Done properly it changes supplier conversations from opinion to evidence, and it changes what you can reasonably ask for in a contract.

Start by Separating Supplier Faults From Everything Else

The scorecard is only credible if it excludes what the supplier cannot control. A customer who changed their mind, ordered two sizes deliberately, or received the item late is not a supplier quality event, and including those returns produces a number the supplier will rightly dismiss.

The attributable set is narrower: defects, construction failures, colour or material mismatch against the approved sample, measurement deviation outside tolerance, and labelling errors. Getting this split right is the whole foundation, and it depends on a reason taxonomy that distinguishes cause from category, as set out in attributing returns to root cause.

Return reasonSupplier attributable?Note
Seam failure, defectYesCore quality metric
Measurement outside toleranceYesNeeds a documented tolerance
Colour differs from sampleYesCompare to approved sample, not to photo
Colour differs from website photoNoYour photography
Wrong size orderedNoSizing communication
Damaged in transitNoCarrier or packaging
Changed mindNoExclude entirely

Normalise Before You Compare

A raw defect rate ranks suppliers by what they make rather than by how well they make it. A supplier producing structured outerwear will always show more construction issues than one producing jersey basics, and comparing them directly is meaningless.

Normalise within category, and where volumes allow, within price band. The useful comparison is between suppliers making similar things, or between the same supplier across seasons. The second comparison is often the more actionable one, because it removes category effects entirely and shows whether a relationship is improving or decaying.

Volume Thresholds Prevent Nonsense

A supplier with sixty units shipped and two defects has a defect rate of three percent and a confidence interval wide enough to drive a truck through. Publishing that number in a scorecard invites an argument you will lose on statistics.

Set a minimum unit volume before a supplier appears in the ranking, and show the interval rather than a bare point estimate. Suppliers below the threshold still get their raw incident list, which is often more useful to them than a rate anyway. This is the same discipline that keeps product-level return rate reporting honest at low volumes.

  • Exclude non-attributable reasons before computing anything.
  • Normalise within category and price band, never across the whole catalogue.
  • Set a minimum volume before a supplier enters the ranking.
  • Report an interval, not a single number.
  • Send the underlying incident list, not only the score.
A scorecard the supplier can argue with is a scorecard you have to defend. A scorecard with photographs attached is one they act on.

Evidence Beats Aggregates

The score opens the conversation; the evidence closes it. A supplier presented with a percentage will question your methodology. The same supplier presented with forty photographs of the same seam failing in the same place will start fixing the seam.

This is the strongest practical argument for collecting return photo uploads and for grading consistently. Photographs from customers, plus condition notes from your own grading, plus the unit identifiers that tie them to a production batch, turn a statistical claim into a physical one. Standard product identification such as GS1 keys is what makes the batch link possible in the first place.

Batch Linkage Is the Force Multiplier

Without batch data, a defect rate is an average across everything a supplier ever sent you. With it, you can often show that ninety percent of the defects came from one production run, which is a completely different conversation: not "your quality is poor" but "something changed in week nineteen".

Suppliers respond far better to the second framing, because it is solvable and does not indict their whole operation. It also protects you from over-correcting a relationship that is fine except for one bad run, which is a real risk when the only number you have is an annual average.

Putting It Into the Commercial Relationship

Once the scorecard is credible, it can carry weight in the contract. Common structures include quality thresholds tied to payment terms, defect-rate ceilings that trigger a joint review, and chargeback mechanisms for attributable returns above an agreed level.

Chargebacks are the sharpest instrument and the easiest to misuse. They work when the attribution is unambiguous and the evidence travels with the claim; they poison relationships when applied to a mixed bucket of returns that includes change-of-mind. If you are recovering cost from suppliers, the mechanics belong in a documented return to vendor workflow rather than in ad hoc deductions.

The best outcome is usually not recovery at all. It is a supplier who changes a construction detail before the next production run, which is worth more than any chargeback because it prevents the returns instead of paying for them.

Which returns should count against a supplier?

Only those the supplier could have prevented: defects, construction failures, measurement outside a documented tolerance, colour or material mismatch against the approved sample, and labelling errors. Change-of-mind returns, wrong size ordered, transit damage and photography mismatches all belong elsewhere. Including them produces a number the supplier will correctly dismiss, and you lose the argument before it starts.

How do I compare suppliers making different products?

Normalise within category and, where volume allows, within price band. A supplier making structured outerwear will always show more construction issues than one making jersey basics, so a raw ranking measures product mix rather than quality. Comparing the same supplier across seasons is often more actionable, because it removes category effects entirely.

What if a supplier disputes the numbers?

Send the evidence rather than defending the percentage. A supplier shown forty photographs of the same seam failing in the same place will start fixing the seam; a supplier shown a rate will question your methodology. This is why photographs, consistent grading notes and batch identifiers matter more than the statistical sophistication of the score itself.

Should scorecards trigger chargebacks?

They can, but only where attribution is unambiguous and the evidence travels with the claim. Chargebacks applied to a mixed bucket that includes change-of-mind returns damage the relationship and are usually reversed under pressure. The more valuable outcome is a supplier changing a construction detail before the next run, which prevents returns rather than paying for them.

See it on your own returns.

Start free