open domain question answering a guide by chip heath & …

23
OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & Dan Heath

Upload: others

Post on 22-Jan-2022

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

OPEN DOMAIN QUESTION ANSWERING

A guide by Chip Heath & Dan Heath

Page 2: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

1. Intro➔ Retrieval Task

Use Sentence Embeddings to retrieve the correct document.

➔ Comprehension TaskBERT is a bi-directional transformer released in 2018, achieved state of the art results in NLP tasks.

➔ PipelineSentence Embeddings on top of BERT. This helps to extract the right document and then find the relevant phrase.

Page 3: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

Can we use this model for other tasks?

Page 4: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

How it looks like in action!

Page 5: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

Steps of Document Retrieval:1. Train on SQUAD

(Stanford Question Answering Dataset) to make model learn how to find correct phrase within the context.

Tip

Don’t wait till the end of the presentation to give the bottom line.

Reveal your product or idea (in this case a translation app) up front.

Page 6: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

Steps of Document Retrieval:

2. Perform Matrix Computations between sentence embeddings and documents, and calculate relevance scores

Tip

Don’t wait till the end of the presentation to give the bottom line.

Reveal your product or idea (in this case a translation app) up front.

Page 7: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

Steps of Document Retrieval:

3. Retrieve the top-k related documents with cosine similarity metric

Tip

Don’t wait till the end of the presentation to give the bottom line.

Reveal your product or idea (in this case a translation app) up front.

Page 8: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

Tip

Don’t wait till the end of the presentation to give the bottom line.

Reveal your product or idea (in this case a translation app) up front.

Page 9: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

2. ExamplesBy the end of this section, your audience should be able to visualize:

➔ WhatWhat is the pain you cure with your solution?

➔ WhoShow them a specific person who would benefit from your solution.

Page 10: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

Meet Alberto.

He recently moved from Spain to a small town in Northern Ireland.

He loved soccer, but feared he had no way to talk to a coach or teammates.

Tip

Tell the audience about the problem through a story, ideally a person.

Page 11: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

Meet Marcos.

He recently opened a camera shop near the Louvre in Paris.

Visitors to his store, mostly tourists,

speak many different languages

making anything beyond a simple transaction a challenge.

Tip

If one example isn’t sufficient to help people understand the breadth of your idea, pick a couple of examples.

Story for illustration purposes only

Page 12: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

A translation barrier left Alberto feeling lonely and hurt Marco’s business.

Tip

Ideally, speak of people in very different situations, but where each could benefit from your solution.

Page 13: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

Then, Marcos discovered Google Translate

He has his visiting customers speak their camera issues into the app.

He’s able to give them a friendly, personalized experience by understanding exactly what they need.

Page 14: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

A simple gesture

Coaches Gary and Glen knew no Spanish.

They used Google Translate to invite Alberto to join in... “Do you want to play?”... “Can you defend the left side?”

Tip

Show how your solution helps the person in the story reach his or her goals.

Page 15: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

From outsider to starAlberto scored 30 goals in 21 games. He is now being scouted by several professional clubs in the Premier League. And he’s a favorite of the other boys on the team.

See a short video on Alberto’s story

Tip

Stories become more credible when they use concrete details such as the specific complex moves Alberto learned through Translate and his 30 goals in 21 games performance stats.

Page 16: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

3. ExamplesPeople need to understand how rare or frequent your examples are.

Pick 1 or 2 statistics and make them as concrete as possible. Stats are generally not sticky, but here are a few tactics:

➔ RelateDeliver data within the context of a story you’ve already told

➔ CompareMake big numbers digestible by putting them in the context of something familiar

Page 17: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

It’s no surprise Marcos uses Google Translate in his shop regularly.

There are 23 officially recognized languages in the EU.

Source: theguardian.com

Tip

Don’t let data stand alone. Always relate it back to a story you’ve already told, in this case, Marco’s shop.

Page 18: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

More than 50 million Americans travelled abroad in 2015

THAT’S MORE THAN THE

POPULATION OF CALIFORNIA AND

TEXAS COMBINED

Tip

When a number is too large or too small to easily comprehend, clarify it with a comparison to something familiar.

Source: travel.trade.gov

Page 19: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

4. ClosingBuild confidence around your product or idea by including at least one of the these slides:

➔ MilestonesWhat has been accomplished and what might be left to tackle?

➔ TestimonialsWho supports your idea (or doesn’t)?

➔ What’s next?How can the audience get involved or find out more?

Page 20: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

Milestones

2014 2015

October 2014Translate web pages with

Chrome extension

August 2015Translate conversations

through your Android

watch

October 2015Translate text within an app

November 2015Translate written text from

English or German to Arabic

with the click of a camera

Page 21: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

What people are saying

Translate has officially inspired me to learn French

Abby Author, NYC

With this app, I’m confident to plan a trip to rural Vietnam

Wendy Writer, CA

Visual translation feels like magic

Ronny Reader, NYC

Quotes for illustration purposes only

Page 22: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

Know a 2nd language? Make Google Translate even better by joining the community.

Tip

Inspire your audience to act on the information they just learned.

Depending on your idea, this can be anything from downloading an app to joining an organization.

Page 23: OPEN DOMAIN QUESTION ANSWERING A guide by Chip Heath & …

Good luck!We hope you’ll use these tips to go out and deliver a memorable pitch for your product or service!

For more (free) presentation tips relevant to other types of messages, go toheathbrothers.com/presentations

For more about making your ideas stick with others, check out our book!