Glotari
Install on Shopify

SCORE

What a Translation Score measures, and what it does not

The formula, the weights per finding type and why a score from 12 fields is not a score from 12.000.

· 9 min read · score.version 1

A translation score is a single number between 0 and 100. High is good. That is the whole reason it exists: an error rate of 3 % needs a moment of thought, a score of 87 does not. This article explains how the Glotari Translation Score is built, so that you can decide how much weight to give it.

GLOTARI TRANSLATION SCORE
87
Good, a few fields to fix
Sample
based on 87 fields
Language pair
English → German
Checked
checked 2 min ago
score.version 1

One number, built from findings that already exist

The score triggers no model call of its own. It is an aggregation of findings the Judge has already produced for each field: category, severity, reasoning, kept for 90 days. Calculating the score costs nothing.

For any set of checked fields, a job, a language, a whole shop or a period, the score is 100 × (1 − Σ gᵢ / n). Here n is the number of checked fields and gᵢ is the weight of the most severe finding in field i. A field without findings has gᵢ = 0. Several findings in one field count once, with the highest weight, so a single broken field cannot dominate the result.

The weights

Four of the five heaviest finding types come from deterministic checks that cost nothing. A quick check without any model call is therefore already a solid base for the score. The Judge refines it.

Weights are versioned. A score always states which version produced it. Changing a weight creates a new version, old scores are not recalculated.

What the score cannot tell you

It cannot tell you whether a translation sells. Tone and style carry a weight of 0,15 because they are a matter of taste, not an error. It cannot replace a native reader for legal texts. And it is only as good as the sample it was calculated on.

Sample size is part of the number

A score from 12 fields is not the same as one from 12.000. Below 30 fields Glotari shows the score in grey, marked preliminary, with no band. Between 30 and 199 fields the band appears together with the sample size. From 200 fields the addition disappears. No confidence interval, the sample size is enough.

Weights per finding type, score.version 1
FINDINGORIGINWEIGHT
Translation missingdeterministic1,0
Identical to sourcedeterministic1,0
Numbers differdeterministic1,0
HTML structure brokendeterministic1,0
Never-translate term translateddeterministic0,8
Meaning flaggedJudge0,7
Grammar flaggedJudge0,3
Tone or style flaggedJudge0,15
No verdict, source outdated, not checkablestatusnot counted in n
A second opinion is a check, not proof of correctness. Different model families disagree, and that disagreement is the signal.

Bands

95 to 100
Ready to publish
85 to 94
Good, a few fields to fix
70 to 84
Review before publishing
0 to 69
Not ready

An example: 87 from 87 fields

Three findings in the diff below, plus a handful of grammar and tone notes across the sample.

SOURCE (DE)TRANSLATION (EN)FINDING
Inhalt: 250 g, reicht für etwa 18 Tassen.Contents: 250 g, enough for about 16 cups.Numbers differ: 18 in source, 16 in target.weight 1,0
Natur Bohne Espresso, Röstung Nr. 3Nature Bean Espresso, Roast No. 3Term from the never-translate list was translated: Natur Bohne.weight 0,8
Versand innerhalb Deutschlands kostenlos ab 39 €.Free shipping worldwide from 39 €.Meaning changed: shipping scope widened from Germany to worldwide.weight 0,7

Source: Glotari test shop, judge findings, September 2026

What you do in the app

follows

Three numbered steps once the app screens are final.

Sources

  1. Weglot, Translation accuracy, blog
  2. Weglot, AI translation quality, product page
  3. Shopify, Translating content with the Translations API