boost your qa productivity with smart sampling (sien accou, yamagata europe)
TRANSCRIPT
www.yamagata-europe.com
SMART QA HOW TO BOOST YOUR QA PRODUCTIVITY WITH SMART SAMPLING
MARCH 2016
www.yamagata-europe.com 2
YAMAGATA EUROPE
EUROPE
INDIA USA
USA Sales
JAPAN
Southeast ASIA
CHINA
www.yamagata-europe.com 3
WHAT DO WE DO?
We writeWe translateWe do the layoutWe printWe package & shipWe create software
www.yamagata-europe.com 4
WHY SMART QA?
5
TO MEASURE IS TO KNOW
Amount of mistakes
per match rate per vendor per project per customer per language
Experience of the translator
Type of mistakes
Omissions Formatting Inconsistencies Terminology Spelling Tags
Conclusions such as best performers and worst performers
www.yamagata-europe.com
6
MISTAKES PER MATCH RATE
Figures 2015 for a customer with 1,785,506 translated words
Indication to reduce checks in a certain category
Match Rate Error %
100% 0.50%
High fuzzy matches
95-99% 8.00%
85-94% 6.50%
Low fuzzy matches
75-84% 7.00%
50-74% 2.50%
No match 75.50%
www.yamagata-europe.com
7
MISTAKES PER QA CATEGORYQA Category Errors %Quotes 36.81%Terminology 14.94%Pattern match 13.86%Number formatting 6.60%Inconsistent translation 5.24%Consecutive spaces 4.68%Number value 4.32%Punctuation 2.92%Capitalisation 1.69%Corrupt character 1.52%Search: match found 1.32%Brackets 1.13%Forgotten translation 1.10%Punctuation spacing 1.07%Partial forgotten translation 0.66%Skipped translation 0.65%Empty translation 0.58%Incomplete translation 0.45%Explicit Tab 0.26%Leading/trailing spaces 0.16%Word spacing 0.05%
Figures 2015 for all jobs Indication to reduce checks for certain types of errors
www.yamagata-europe.com
www.yamagata-europe.com 8
MISTAKES PER VENDOR
Figures 2015 (for vendors with > 10 QA reports / > 50,000 words) Indication to reduce checks for certain vendors
Best QAVendor % QA ErrorsVendor A 0,00%Vendor B 0,00%Vendor C 0,00%Vendor D 0,00%Vendor E 0,00%Vendor F 0,00%Vendor G 2,04%Vendor H 3,09%Vendor I 3,70%Vendor J 5,11%Vendor K 7,96%Vendor L 12,20%Vendor M 12,50%Vendor N 13,16%Vendor O 14,29%Vendor P 14,91%Vendor Q 15,38%Vendor R 17,07%Vendor S 17,24%Vendor T 17,56%
Worst QAVendor % QA Errors # Reports with ErrorsVendor A‘ 100,00% 11Vendor B‘ 92,86% 13Vendor C‘ 89,66% 26Vendor D‘ 85,71% 12Vendor E‘ 85,00% 17Vendor F‘ 81,82% 18Vendor G‘ 81,82% 9Vendor H‘ 76,00% 19Vendor I‘ 75,00% 12Vendor J‘ 75,00% 9Vendor K‘ 75,00% 15Vendor L‘ 73,91% 17Vendor M‘ 73,08% 19Vendor N‘ 72,00% 18Vendor O‘ 71,43% 10Vendor P‘ 70,27% 26Vendor Q‘ 68,75% 22Vendor R‘ 68,42% 26Vendor S‘ 66,67% 8Vendor T‘ 66,67% 16
www.yamagata-europe.com 9
HOW DOES SMART SAMPLING WORK?
Several parameters
Smartly selected sections QA approach
target audience content type type of product target language TM leverage volume of the assignment vendor experience …
= indication of overall quality
www.yamagata-europe.com 10
EXAMPLE 1
Target audience: internal communication
Content type: general
Sampling!
New vendor
No sampling!
www.yamagata-europe.com 11
EXAMPLE 2
Content type: highly technical
Product: medical device
No sampling!
www.yamagata-europe.com 12
EXAMPLE 3 Content: camera user manual
High word count
Mostly full matches
Same translator for years
Sampling!
Analyse QA reportPass or fail score
Pass?Deliver to customer
Fail?Restart full QA cycle
SCORING
www.yamagata-europe.com
www.yamagata-europe.com 14
QA DISTILLER First version developed by Yamagata Europe in 2003
Standalone tool for checking bilingual files with default settings for over 90 languages
Automatic detection of formal errors in translations
Allows checking of high text volumes within limited time frame
Studies prove that results of QA Distiller check also give a good indication of overall linguistic quality
In the industry considered as a valid method to serve the 4-eyes-principle
www.yamagata-europe.com 15
SMART SAMPLING WITH QAD
New feature: based on percentage of text