two unique challenges netapp has tackled while implementing machine translation, by yukako ueda,...
TRANSCRIPT
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---1
Two Unique Challenges NetApp has tackled while Implementing Machine Translation
Yukako Ueda APAC Global Content Lead, NetApp & Chapter Manager, Women in Localization Japan Apr. 19, 2016
Company Snapshot
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---2
Providing with software, systems, and services to manage and store data
FY15 revenue: $6.1 billion
Over 12,000 employees in more than 150 offices worldwide
13 consecutive years on FORTUNE Magazine's "100 Best Companies" list
FORTUNE 500® Company
Creator of Data ONTAP, the worlds #1 branded storage operating system2
Member of S&P 500 and NASDAQ
Recognized by Great Place to Work Institute3
#1 “Best Companies to Work for in Europe” list #4 “World’s Best Multinational Workplaces” list #5 “Best Companies to Work for in APAC” list #9 “Great Place to Work in Japan” list
1. From FORTUNE® Magazine, June 15, 2015 ©2015 Time Inc. FORTUNE®, and FORTUNE 500® are registered trademarks of Time Inc. and are used under License. FORTUNE and Time Inc. are not affiliated with, and do not endorse products or services of, NetApp.
2. IDC Worldwide Quarterly Enterprise Storage Systems Tracker 2015 Q4, March 2016 (Open Networked Enterprise Storage Systems revenue)3. Copyright © 2015 GREAT PLACE TO WORK® INSTITUTE, INC.
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---3
Questions to start using Machine Translation…
What type of content would you choose? Technical? Marketing ? We chose both!
Which language would you select? French? German? Spanish? Portuguese? Chinese? Japanese? We chose Japanese and Simplified Chinese
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---4
To determine what type of content we should choose…
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---5
To determine what type of content we should choose…
STEP 1• Pilot Raw MT
Project for KB Articles
STEP 2• Pilot MT+PE
Projects for both Marketing and Technical contents
STEP 3• Deploy MTPE
for production
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---6
STEP1: MT deployed for KB Articles for 5 languagesSelect the language
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---7
STEP1: MT deployed for KB Articles for 5 languagesLatest or frequently-viewed Japanese articles are shown
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---8
STEP1: MT deployed for KB Articles for 5 languagesThe article is shown in English if MT has never run before
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---9
The article is Machine Translated into Japanese as soon as you select “ 日本語” STEP1: MT deployed for KB Articles for 5 languages
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---10
STEP2: MT+PE Pilot projects for productionPerform Full and Light PE for both Marketing and Technical projects
MT Engine Retraining
Quality Level Definition
Post Edit Guidelines
Post Edit evaluation Form
Form for MT output feedback
Pricing and SLAs
Which vendor is best for PE for which content type
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---11
STEP 3: Deploy MTPE for productionReady for various projectsCurrent Content Classification
Customer Success Story
Epic Story
Product & Solutions Customer Presentation
Video
Product UI
Legal (currently) Option with waiver, no QA (exception as NO SLAs are ensured) NDA, good for small # of languages
GUI Test
Community
Social Media
Knowledge Base Article
Customer Support Self-Service
Chat
Instant Messaging
Online Help
Express Guide
Technical Report
Technical White Paper
Product Manual
Customer Support Site
Datasheet, Solution Brief, Service Brief
Marketing White Paper
Level 2 & 3 Web
NetAppU
Campaign Landing Page
Web Landing Page
Banner
Press Release
Demand Gen Email
Highly Creative Brand Educational Technical/Support High Volume Real Time Fast Track
Well-defined process in place In progress Process needs development In progress Process needs development
Localization Model
QA Model
Teams
Workflow Model
Traditional
100% Review
Certified Translation Teams
TMS
Traditional
50-70% Review
Certified Translation Teams
TMS
Traditional
30-50% Review
Certified Translation Teams
TMS
Machine Translation + PE
Post Edit and Spot Check
MT Post Editors and GCM
TMS & MT
Raw Machine Translation
Post Edit if needed
MT Post Editors
TMS & MT
Raw Machine Translation Traditional
No Review
n/a
TMS Vendor Portal
Approved Vendor
No Review
© 2015 NetApp, Inc. All rights reserved. NetApp Proprietary. Internal Use Only12
STEP 3: Deploy MTPE for productionDecision matrix
Content survey Is OK to RAW MT Is OK to PE Is HT
Content repository Yes Yes Yes
Languages All* (7 Trained ) 7 Languages 12 Core languages
MT engine quality (based on TMs leveraging) and reuse Only High confidence 7 languages All
Content type based on the content classification
Technical, low visibility, low traffic Any technical
High visibility, banners, High touch Marketing, etc.,
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---13
Which language to start using MT for?
NetApp Confidential - Internal Use Only14
Japanese and Simplified Chinese were selectedStarted MT with 2 APAC Languages
Starting from the languages with the highest volume to get the highest outcome
Choosing the languages having the biggest corpus for both Marketing and Technical projects for the effective training of the MT engine
Starting from the toughest languages to leverage the successful methods easy to the remaining languages
© 2015 NetApp, Inc. All rights reserved. NetApp Proprietary. Internal Use Only15
NetApp’s QA model
To comply with NetApp’s high quality standards, additional review step was added after PE
NetApp’s GCMs conduct review and compile feedback
Feedback is being categorized and submitted to engine training team for retraining and shared with vendors for learning (feedback loop)
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---16
Basic Workflow
TMS Project is kicked off
MT is run by NetApp PM
Post Editor is assigned by Vendor
PM
Post Edit is done following Post Edit
Guidelines
Post Edited content is submitted with the MT engine
quality Feedback form
Post Edit is evaluated by
NetApp Global Content Manager
DTP is done by Vendor Engineer
DTPed content is reviewed by NetApp GCM (and the local
stakeholder)
Update is made and the project is completed.
Final file is submitted to the
requester
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---17
Acrolinx
NetAppU – fully implemented
Marketing – in progress
Product Manuals – to be trained next
Technical Reports – to be planned
Effort is being made by a specific project
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---18
Feedback LoopForm was created and communicated with the vendors
© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---19
Thank You.
© 2015 NetApp, Inc. All rights reserved. NetApp Confidential – Limited Use 20
Come and join us! ~ Women in Localization Japan ~