non-trivial pursuits: learning machines and forgetful humans
TRANSCRIPT
![Page 1: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/1.jpg)
Chris Heilmann (codepo8), PNWPHP conference, Seattle, September 2017
![Page 2: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/2.jpg)
Machine Learning, Deep Learning, Artificial Intelligence, Big Data…
![Page 3: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/3.jpg)
![Page 4: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/4.jpg)
![Page 5: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/5.jpg)
![Page 6: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/6.jpg)
We live in a post-data leak world. We have been recorded and categorised
![Page 7: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/7.jpg)
Lots of companies are using this data.
![Page 8: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/8.jpg)
Some in amazing ways, others in shady ones.
![Page 9: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/9.jpg)
There should not be only a few that have access and do something with it.
![Page 10: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/10.jpg)
Let’s democratiseintelligent machines and human interfaces.
![Page 11: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/11.jpg)
How do we remember and learn?
![Page 12: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/12.jpg)
![Page 13: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/13.jpg)
Repetition
![Page 14: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/14.jpg)
RepetitionComparison
![Page 15: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/15.jpg)
RepetitionComparisonExplanation
![Page 16: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/16.jpg)
RepetitionComparisonExplanationAssociation
![Page 17: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/17.jpg)
![Page 18: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/18.jpg)
complex and erratic leaps
![Page 19: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/19.jpg)
we are terrible at repetition
bored
![Page 20: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/20.jpg)
![Page 21: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/21.jpg)
![Page 22: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/22.jpg)
![Page 23: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/23.jpg)
![Page 24: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/24.jpg)
That the returned data is fit for human consumption
![Page 25: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/25.jpg)
![Page 26: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/26.jpg)
Where do I find a nice restaurant around here that is open tomorrow around lunch time?
![Page 27: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/27.jpg)
nice restaurant here that is open tomorrow around lunch time?
Search term
![Page 28: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/28.jpg)
nicerestaurant here that is open tomorrow around lunch time?
What is nice?Search term
![Page 29: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/29.jpg)
nicerestaurant here
tomorrow around lunch time?
What is nice?Search term
Location
![Page 30: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/30.jpg)
nicerestaurant here
tomorrow around lunch time
What is nice?Search term
Location
Calculated time frame
![Page 31: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/31.jpg)
Where nicerestaurant here
tomorrow around lunch time
What is nice?Search term
Location
Calculated time frame
Calculated result
![Page 32: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/32.jpg)
Our current hype around Artificial Intelligence is driven by Sci-Fi concepts.
![Page 33: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/33.jpg)
The age-old dream of a ubiquitous, all-knowing computer butler.
![Page 34: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/34.jpg)
One that understands all human communication quirks and also has a delicious sense of sarcasm.
![Page 35: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/35.jpg)
In essence: a human, that isn’t human but appears to be.
![Page 36: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/36.jpg)
Which is how we set ourselves up for failure.
![Page 37: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/37.jpg)
Ubiquitous computing easily becomes a nuisance when it records without giving us the right answers.
![Page 38: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/38.jpg)
It is very easy to create a creepy, annoying chat bot. We are not forgiving with them as we are with humans.
![Page 39: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/39.jpg)
Artificial Intelligenceis most effective when it enhances in the background.
![Page 40: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/40.jpg)
RepetitionComparisonExplanationAssociation
![Page 41: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/41.jpg)
RepetitionComparisonExplanationAssociation
![Page 42: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/42.jpg)
What you can use AI for in your interfaces right now:
Visual RecognitionVoice RecognitionNatural Language ProcessingEmotion RecognitionEntity Recognition
![Page 43: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/43.jpg)
Visual recognition
![Page 44: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/44.jpg)
Visual recognition (positives)
Automated tagging and
clustering of images
Accessibility benefit of
automated alternative content
Biometric login
Automated “art direction”
Automated moderation
![Page 45: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/45.jpg)
Visual recognition (negatives)
Privacy issues
Wrong and possibly offensive
automated labeling
False moderation and failed
moderation
Connection / Upload latency
Insufficiently trained models
![Page 46: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/46.jpg)
Voice recognition
![Page 47: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/47.jpg)
Voice recognition (positives)
Visual impairment or no screen
Hands-free interaction (phone,
car, headsets…)
Faster than typing, more natural
Magical “Star Trek” factor
![Page 48: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/48.jpg)
Voice recognition (negatives)
Intrusive as hell
Disappointing error handling
Language and accent issues
Low sound quality or loud
surrounding
Latency in recognition
![Page 49: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/49.jpg)
Natural Language Processing
![Page 50: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/50.jpg)
NLP (positives)
Allowing humans to ask human
questions
Proper translation of content
not word-by-word, but by
meaning
Conversational interfaces that
keep the user engaged
![Page 51: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/51.jpg)
NLP (negatives)
Users are conditioned to think in
clicks and to enter keywords –
natural language feels out of
place
Language differences are still a
problem, not all people speak
English
![Page 52: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/52.jpg)
Emotion recognition
![Page 53: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/53.jpg)
Emotion recognition (positives)
Feedback channel for product
tests
React to the most annoyed
customers first
Find happy quotes and
customers to promote
Navigate media by emotion
![Page 54: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/54.jpg)
Emotion recognition (negatives)
False recognition results in
hurtful messaging
Quality issues can result in very
wrong results
Voice emotion recognition is still
a tough one to crack
![Page 55: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/55.jpg)
Entity recognition
![Page 56: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/56.jpg)
Entity recognition (positives)
Automated tagging and cross
referencing
Opportunity to add third party
content (Wikipedia is the classic)
Intelligent auto-complete
![Page 57: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/57.jpg)
Entity recognition (negatives)
False recognition
Language differences
Lack of value of automated
content
![Page 58: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/58.jpg)
![Page 59: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/59.jpg)
![Page 60: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/60.jpg)
You can REST easy…
![Page 61: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/61.jpg)
You can REST easy…
![Page 62: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/62.jpg)
You can REST easy…
![Page 63: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/63.jpg)
https://en-gb.wordpress.org/plugins/cloudinary-image-management-and-manipulation-in-the-cloud-cdn/
![Page 64: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/64.jpg)
Everything counts in large amounts
![Page 65: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/65.jpg)
![Page 66: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/66.jpg)
RepetitionComparisonExplanationAssociation
![Page 67: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/67.jpg)
Language Understanding Intelligence Service (LUIS)https://docs.microsoft.com/en-us/azure/cognitive-services/LUIS/Home
Brazilian
Portuguese
Chinese
Dutch
English
French
French
Canadian
German
Italian
Japanese
Korean
Spanish
Spanish
Mexican
![Page 68: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/68.jpg)
Custom Vision Servicehttps://azure.microsoft.com/en-us/services/cognitive-services/custom-vision-service/
![Page 69: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/69.jpg)
https://azure.microsoft.com/en-us/services/cognitive-services/custom-speech-service/
Custom Speech Service (CRIS)
![Page 70: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/70.jpg)
Intelligent systems will not go away. If anything, they’ll be part of any platform soon.
![Page 71: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/71.jpg)
We can own part of this and create human interfaces for all.
![Page 72: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/72.jpg)
Or we can hope that others use this power only for good.
![Page 73: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/73.jpg)
I – for one, don’t consider this a good bet. I’d rather play and be part of this revolution. And so can you.
![Page 74: Non-trivial pursuits: Learning machines and forgetful humans](https://reader034.vdocuments.site/reader034/viewer/2022051318/5a64e88e7f8b9abd5b8b45f1/html5/thumbnails/74.jpg)
https://www.flickr.com/photos/bcymet/3356449350
https://www.flickr.com/photos/marcja/3583398125
https://www.flickr.com/photos/frogman2212/3970181993
https://www.flickr.com/photos/johnath/7356295658
https://www.flickr.com/photos/doggybytes/4194394234
https://www.flickr.com/photos/monophonicgirl/3985633864
Chris Heilmann
@codepo8