Version Number: 2019/12/18

Background Knowledge

BLEU (bilingual evaluation understudy) is an algorithm for evaluating the quality of text which has been machine-translated from one natural language to another. Quality is considered to be the correspondence between a machine’s output and that of a human: “the closer a machine translation is to a professional human translation, the better it is” – this is the central idea behind BLEU. BLEU was one of the first metrics to claim a high correlation with human judgements of quality, and remains one of the most popular automated and inexpensive metrics.
Thus, for translations to serve its’ purpose properly, there is no place for any mistranslations, omissions, additions and other translation issues.

Delivery Requirement:

General Guidelines

BLEU test translation is often provided to evaluate the machine translation’s performance in e-commerce, like Aliexpress, 1688 and Lazada. The product page mainly includes:

1. Product Title
2. Product Offer
3. Product Feedbacks/Comments

Product Title Test Set:

Product titles represent a number of phrases that describe products, product shipment methods, sales discount, etc. usually without any punctuation separating them. During translation, it is vital to discriminate those syntactical phrases one by one and translate each of the phrases in the title.

1. Determine product nouns
   Open the product link to see the product category bread crumbs and product images to determine the correct product noun. Other words other than product nouns can be viewed as product modifiers.
   e.g.
   Category: Kitchen Tools & Gadgets
   Product link:https://www.aliexpress.com/item/Multifunctional-Kitchen-Tool-Fondue-Cheese-Grater-Lemon-Zester-with-Non-slip-Handle/32720504616.html
   Product title: Multifunctional Kitchen Tool Fondue Cheese Grater Lemon Zester with Non-slip Handle
   Specific operating steps:

According to the category information “Kitchen Tools & Gadgets”, and the picture of the goods page, determine the product name is grater, so product nouns of the title are - “Tool”, “Grater” and “Zester”.
The other words in the title “Multifunctional Kitchen”, “Fondue Cheese”, “Lemon” and “with Non-slip Handle” are a modifiers of the product nouns.
Operating results:
Product nouns: “Tool”, “Grater”, “Zester”
Product modifiers: “Multifunctional Kitchen”, “Fondue Cheese”, “Lemon”, “with Non-slip Handle”

1. Combining syntactical phrases
   Combine 1 product noun and product modifiers before it into one syntactical phrase. If there are product modifiers after the last product noun in the title, they should be included into one syntactical phrase with the forgoing product name. Product modifiers that start with a preposition should be included into one syntactical phrase with the forgoing product name.
   e.g. On the basis of operating step 1
   Product nouns: “Tool”, “Grater”, “Zester”
   Product modifiers: “Multifunctional Kitchen”, “Fondue Cheese”, “Lemon”, “with Non-slip Handle”
   Specific operating steps:
   Modifier “Multifunctional Kitchen” is before “Tool” and there are other 2 product nouns after it - “Grater”, “Zester”, so the first syntactical phrase could be combined - “Multifunctional Kitchen Tool”.
   Modifier “Fondue Cheese” is before “Grater” and there are other product noun after it - “Zester”, so the second syntactical phrase could be combined - “Fondue Cheese Grater”.
   Modifier “Lemon” is before “Zester” and there are no other product noun after it, so the third syntactical phrase could be combined - “Lemon Zester with Non-slip Handle”.
   Operating results:

   “Multifunctional Kitchen Tool”, “Fondue Cheese Grater”, “Lemon Zester with Non-slip Handle”.

2. Translating phrases in the title
   Translate syntactical phrases of the source one by one. The number and the order of phrases in the target should be the same as in the source title. Only the first letter of the target title should be capitalized (except for proper name, abbreviation or acronym).
   e.g. On the basis of operating step 2
   Title phrases: “Multifunctional Kitchen Tool”, “Fondue Cheese Grater”, “Lemon Zester with Non-slip Handle”.
   Specific operating steps:
   Translate phrases one by one and combine them together according to their order in the source title.

Product Offer Test Set:

Product offer consists of several types of content, including title, parameter, function, package of the product and greetings, promotion, contact info, etc.. If you find some product title strings in the translation, please refer to the above title instruction.
（below marked area is an example of product offer, which means the detailed description)

Product Feedbacks/Comments Test Set:

Comments, generally speaking, reflect the feelings of customers for the order they placed. It may contain praise, criticism, complaint, etc.. Since it is edited by buyers, the source may have spelling, grammar or syntactic issues, and some can be really colloquial with the omission of subjects and the use of SMS language. The translation of comments should be in an informal and gender-neutral style. If the translation is too formal or gender-specific, QA will log them as Word Form or Style issues.
（below marked area is an example of product comments)
_

Special Notes:

1. Machine translation is prohibited.
2. Capitalization: follow the local style guide.
3. Punctuation: follow source as long as it meets the requirements of target language style guide.
   For example,
   (1) If there is no period at the end of the sentence, do NOT add one in the translation.
   (2) If the punctuation is wrongly used at the beginning or the end of the source , do NOT correct it in the translation and keep consistency with the source.
   (3) If one sentence in the source is split into two (or two combined into one) in the translation, you may add (or delete) new punctuation for the sake of fluency.
4. Minor issue: If the source has minor spelling or grammar issue which is recognizable, please translate it in a correct way. For example,
   (1) It is very goood.-> It is very good.
   (2) I am really interesting in it. -> I am really interested in it.
   But if the source has serious spelling or grammar issue, which makes it unintelligible, please mark “####” in the translation as source error.

5. Duplication in source should not be fixed in translation:

   ladies womens shoes -> дамские женские туфли / zapatos de mujer de señora
   womens shoes for ladies -> женские туфли для дам / zapatos de mujer para señora
   好好好好好 -> good good good good good
   Huawei/华为 Mate 20 手机壳 -> Huawei/Huawei Mate 20 phone case

6. Brand name:
   

   (1) Use the local official brand translation if possible.
   (2) If there’s no local translation for the brand, use the English brand name that is internationally acceptable.
   (3) If the brand is less well-known, please use the English brand name or the PinYin (if the source is in Chinese)
   So the priority should be like: Local official brand translation -> Official brand name in English -> Pinyin （If the Chinese brand is less well-known）

7. People/place name: if the source name has equivalent translation in target language, translate as it is, and if the source name has no equivalent in target, keep the name in English.

   E.g. Source: สมชาย 11/11ม.1ม.พรร่มเย็น ต.คูคต อ.ลำลูกกา จ.ปทุมธานี 12150 1111111111
   Target: 颂猜，巴吞他尼府兰卢加县 Khu Khot 镇，Panromyen 村 1 组 11/11 号 12150 1111111111

8. SMS language: It may contain SMS language such as “u2”, “4u”, “TQ” etc, please translate them clearly.

9. No extra information**:** Translate fluently but do NOT paraphrase or provide explanatory information.

Source: Hi Tiffany, The material is made out of 100% food-grade silicone.
Wrong translation: Chào Tiffany, chất liệu của sản phẩm là 100% silicon đa năng (loại dùng trong quá trình bảo quản và vận chuyển thức ăn)
Explanation: “loại dùng trong quá trình bảo quản và vận chuyển thức ăn” is explanatory information and belongs to Addition issue.

1. Abbreviation: Please follow the target language style guide. If the abbreviation is widely used in the local, please keep the abbreviation and do not add explanation information unless it is included in source.

   E.g. Source: WTO
   Correct translation 1: WTO
   Correct translation 2: 世界贸易组织
   Wrong translation 1: 世界贸易组织 (WTO)
   Wrong translation 2: WTO（世界贸易组织）
   E.g. Source: WTO (World Trade Organization)
   Correct translation: WTO（世界贸易组织）

2. Unit measurements should be translated into target language. Imperial system units should NOT be transformed into metric unless there is no translation for the unit in the target language.

e.g. source: 120 斤大码女装
target: 60 kg large size women clothes

1. Incomplete source: If the sentence is incomplete, please translate it as long as it is translatable.

For example,
(1) I am satisfied with this, but
But if the broken part is unable to translate, please mark the whole sentence “####” as source error.

1. Non specified source language: For other language than the assigned source language, you can translate it into target language if you understand what’s the real meaning of that language and add a note to make it clear, otherwise, keep as it is.
2. Style guide: For more style information, please refer to https://www.yuque.com/alibaba-translate/hgdw9e/gpzad3

QA Notes:

please refer to the guideline in https://www.yuque.com/alibaba-translate/htquality/hxy3cv
Please note that

1. all Capitalization issue can be ignored;
2. all issues about space can be ignored, for example, adding double blank and no space between two half-width characters;
3. In title translation, if you find the translator wrongly added the punctuation in the whole translation, please contact with PM.