English to Samoan: AI Translation Comparison
English to Samoan: AI Translation Comparison
Samoan is spoken by approximately 510,000 people across Samoa, American Samoa, and significant diaspora communities in New Zealand, Australia, and the United States (particularly Hawaii and California). Samoan is a Polynesian language with VSO word order, an ergative-absolutive case system, and a distinctive T/K register distinction: formal Samoan uses /t/ and /n/ where casual speech uses /k/ and /ng/. It has no grammatical gender, uses particles for tense and aspect, and has a complex honorific system with separate vocabulary for chiefs (matai) and clergy. Translation demand comes from Pacific Island governance, church and religious organizations, diaspora services, education, and US federal services for American Samoa.
This comparison evaluates five leading AI translation systems on English-to-Samoan accuracy, naturalness, and suitability for different use cases.
Translation comparisons are based on automated metrics and editorial evaluation. Quality varies by language pair and content type.
Accuracy Comparison Table
| System | BLEU Score | COMET Score | Editorial Rating (1-10) | Best For |
|---|---|---|---|---|
| Google Translate | 17.8 | 0.721 | 4.9 | General-purpose, free access |
| DeepL | 15.3 | 0.698 | 4.4 | Very limited support |
| GPT-4 | 20.6 | 0.742 | 5.5 | Contextual accuracy |
| Claude | 18.4 | 0.726 | 5.1 | Long-form content |
| NLLB-200 | 19.8 | 0.736 | 5.3 | Good Polynesian support, self-hosted |
Translation Quality Metrics: BLEU, COMET, and Human Evaluation Explained
Example Translations
Formal Business Email
Source: “We are pleased to inform you that the Pacific Islands Forum has approved your proposal for the regional climate resilience program. Funding details are attached.”
| System | Translation |
|---|---|
| Matou te fiafia e faailoa atu ua taliaina e le Pacific Islands Forum lau talosaga mo le polokalame o le malosiaga o le tau i le itulagi. O faamatalaga o tupe o loo faapipiiina. | |
| DeepL | Matou te fiafia e faailoa atu ia te oe ua taliaina lau talosaga e le Pacific Islands Forum mo le polokalame o le malosiaga tau o le itulagi. O faamatalaga o tupe ua faapipiiina. |
| GPT-4 | Matou te fiafia e faailoa atu ua taliaina e le Fono o Atunuu o le Pasefika lau talosaga mo le polokalame o le mausali i suiga o le tau i le itulagi. O faamatalaga tau tupe o loo faapipiiina. |
| Claude | Matou te fiafia e faailoa atu ua taliaina e le Pacific Islands Forum lau talosaga mo le polokalame o le malosiaga o le tau i le itulagi. O faamatalaga o tupe o loo faapipiiina. |
| NLLB-200 | Matou te fiafia e faailoa atu ua taliaina lau talosaga e le Pacific Islands Forum mo le polokalame o le mausali i suiga o le tau. O faamatalaga o tupe o loo faapipiiina. |
Assessment: GPT-4 translates “Pacific Islands Forum” into Samoan as “Fono o Atunuu o le Pasefika” (Forum of Countries of the Pacific), which is the official Samoan name. GPT-4 also uses “mausali i suiga o le tau” (resilience to climate change), a more precise rendering than “malosiaga o le tau” (strength of the weather). All systems use the formal register with /t/ and /n/ sounds, which is appropriate for official correspondence.
Casual Conversation
Source: “Are you coming to the umu tomorrow? Mom is making palusami and we have fresh coconuts from the plantation.”
| System | Translation |
|---|---|
| E te sau i le umu taeao? O loo faia e Tina le palusami ma ua i ai niu fou mai le faatoaga. | |
| DeepL | E te sau i le umu taeao? Ua saunia e Tina le palusami ma ua maua niu fou mai le faatoaga. |
| GPT-4 | O le a e sau i le umu taeao? O loo saunia e Tina le palusami ma o loo ia i ai niu fou mai le togavao. |
| Claude | E te sau i le umu taeao? O loo faia e Tina le palusami ma ua i ai niu fou mai le faatoaga. |
| NLLB-200 | E te sau i le umu taeao? O loo saunia e le tina le palusami ma ua maua niu fou mai le faatoaga. |
Assessment: All systems correctly preserve “umu” (earth oven) and “palusami” (coconut cream baked in taro leaves), essential Samoan cultural terms. GPT-4 uses “togavao” (plantation/bush farm), which is a more specific Samoan word than the general “faatoaga” (farm/garden). The casual register should ideally use /k/ forms (“sau” becomes “sau” in both registers for this word, but other words would shift), though none of the systems attempt the K-register consistently. Best Translation AI for Casual Content
Technical Content
Source: “The coral reef monitoring system uses underwater drones to track bleaching events and measure sea surface temperature changes across the Samoan exclusive economic zone.”
| System | Translation |
|---|---|
| O le faiga e vaaia ai aau o loo faaaaogaina vaalele i lalo o le vai e siaki ai mea e tupu o le paepaeina ma fuaina suiga o le vevela o le fogaeleele o le sami i le sone tau tamaoaiga a Samoa. | |
| DeepL | O le faiga e vaaia ai aau e faaaaogaina masini i lalo o le vai e siaki ai le paepaeina ma fuaina suiga o le vevela o le sami i le sone tau tamaoaiga a Samoa. |
| GPT-4 | O le faiga e mataituina ai aau o loo faaaaogaina drone i lalo o le vai e suetulituli ai le paepaeina o aau ma fua suiga o le vevela o luga o le sami i totonu o le sone tau tamaoaiga faapitoa a Samoa. |
| Claude | O le faiga e vaaia ai aau o loo faaaaogaina vaalele i lalo o le vai e siaki ai mea e tupu o le paepaeina ma fuaina suiga o le vevela o le fogaeleele o le sami i le sone tau tamaoaiga a Samoa. |
| NLLB-200 | O le faiga e vaaia ai aau o loo faaaaogaina masini i lalo o le vai e siaki ai le paepaeina ma fuaina suiga o le vevela o le sami i le sone tau tamaoaiga a Samoa. |
Assessment: GPT-4 provides the most detailed rendering with “mataituina” (monitoring, more precise than “vaaia,” watching), “suetulituli” (investigate/track), and “sone tau tamaoaiga faapitoa” (exclusive economic zone). Marine and climate terminology is important for Pacific Island nations, and GPT-4 demonstrates the most vocabulary depth in this domain. Best Translation AI for Technical Documentation
Strengths and Weaknesses
Google Translate
Strengths: Free and accessible. Basic Samoan support. Handles simple sentences. Weaknesses: Limited vocabulary. Frequent word order errors in complex sentences. No register distinction.
DeepL
Strengths: Basic functionality. Weaknesses: Very limited Samoan support. Lowest quality. Frequent errors. No cultural context.
GPT-4
Strengths: Best overall quality. Most vocabulary depth. Good cultural awareness. Handles Pacific governance terminology. Weaknesses: Higher cost. Occasionally generates Tongan or Hawaiian-influenced forms. No K-register support.
Claude
Strengths: Consistent quality for long documents. Reasonable basic output. Weaknesses: Limited vocabulary. Similar quality to Google. No register awareness.
NLLB-200
Strengths: Competitive quality for a low-resource Polynesian language. Free and self-hosted. Meta’s Pacific language coverage benefits Samoan. Weaknesses: Limited vocabulary depth. No register distinction. Occasional errors in longer sentences.
Recommendations
| Use Case | Recommended System |
|---|---|
| Pacific governance documents | GPT-4 with human review |
| Church / religious content | GPT-4 with human review |
| Climate / environmental | GPT-4 |
| Diaspora services | Google Translate (free) |
| High-volume, cost-sensitive | NLLB-200 (self-hosted) |
| Quick personal translation | Google Translate (free) |
| Education materials | GPT-4 or NLLB-200 with review |
Best Translation AI in 2026: Complete Model Comparison
Key Takeaways
- GPT-4 leads for English-to-Samoan with the best vocabulary depth and cultural awareness, but all systems produce output that requires human review. NLLB-200 is a strong free alternative.
- The T/K register distinction (formal vs. casual speech) is not handled by any AI system, meaning all output defaults to the formal T-register, which is appropriate for written content but not for casual communication.
- Samoan’s ergative-absolutive case marking and particle-based grammar differ fundamentally from English, creating structural challenges that go beyond vocabulary limitations.
- Climate change and marine resource management are critical domains for Samoan translation, given the existential threat of sea level rise to Pacific Island nations.
Next Steps
- Try it yourself: Compare these systems on your own text in the Translation AI Playground: Compare Models Side-by-Side.
- Low-resource languages: Learn more in Low-Resource Languages: Where NLLB and Aya Shine.
- Check the leaderboard: Browse our full Translation Accuracy Leaderboard by Language Pair.
- Full model comparison: Read Best Translation AI in 2026: Complete Model Comparison.