复旦大学大数据学院School of Data Science, Fudan University Introduction to Artificial Intelligence
魏忠钰
February 27th 2019
复旦大学大数据学院School of Data Science, Fudan UniversityOutline
▪ What is artificial intelligence?
▪ What can AI do and can not do?
▪ What is this course about?
复旦大学大数据学院School of Data Science, Fudan University
Sci-Fi AI
复旦大学大数据学院School of Data Science, Fudan University
Definition
“It is the science and engineering of making intelligent
machines, especially intelligent computer programs. It is
related to the similar task of using computers to
understand human intelligence, but AI does not have to
confine itself to methods that are biologically observable,”
by John McCarthy, 1956.
“Broadly, AI is the computer-based exploration of methods
for solving challenging tasks that have traditionally
depended on people for solution. Such tasks include
complex logical inference, diagnosis, visual recognition,
comprehension of natural language, game playing,
explanation, and planning” by Eric Horvitz, 1990.
复旦大学大数据学院School of Data Science, Fudan University
Turing Test
▪ 1950 – Alan Turing (1912 - 1954)
A. M. Turing (1950) Computing Machinery and Intelligence. Mind 49: 433-460.
Can machines think?
Q: Please write me a sonnet on the subject of the Forth Bridge.
A : Count me out on this one. I never could write poetry.
Q: Add 34,957 to 70,764.
A: (Pause about 30 seconds and then give as answer) 105,621.
Imitation Game
复旦大学大数据学院School of Data Science, Fudan University
AI Timeline
▪ Age of Mythology
▪ 1770 : The Turk by Wolfgang von Kempelen (Hungarian)
复旦大学大数据学院School of Data Science, Fudan University
AI Timeline
▪ 1940 – 1950 Early days
▪ 1943: McCulloch & Pitts: Boolean circuit model of brain
▪ 1950: Turing's “Computing Machinery and Intelligence”
复旦大学大数据学院School of Data Science, Fudan University
AI Timeline
▪ 1950 - 70: Excitement
▪ 1956: Dartmouth meeting: “Artificial Intelligence” adopt by John McCarthy, Marvin Minsky
▪ 1961: The first industrial robot “Unimations” in GM
复旦大学大数据学院School of Data Science, Fudan University
AI Timeline
▪ 1970—90: Knowledge-based approaches
▪ 1979: Medical diagnosis program by Jack Myers Harry Pople
▪ 1980: Expert systems industry booms
复旦大学大数据学院School of Data Science, Fudan University
AI Timeline
▪ 1990 - 2000: Statistical approaches
▪ Probability, uncertainty
▪ Statistical machine learning
How about theweather?
Traffic?Queue forbreakfast?
Seats on the bus?
复旦大学大数据学院School of Data Science, Fudan University
AI Timeline
AI is born
1956
Marvin Minsky atDartmouth meeting
1961
First IndustrialApplication
“Unimations”The first industrial robot in
GM
1970 — 80
Rule-based AI
Expert systems Inmedical domain
1990 – Now
Graphical modelsMachine learning
复旦大学大数据学院School of Data Science, Fudan University
What we talk about when we talk about AI
https://36kr.com/p/5065727.html
复旦大学大数据学院School of Data Science, Fudan University
Outline
▪ What is artificial intelligence?
▪ What can AI do and can not do?
▪ What is this course about?
复旦大学大数据学院School of Data Science, Fudan University
AI Application
▪ Vision Recognition
▪ Machine translation
▪ Autonomous driving
▪ Human vs Machines
复旦大学大数据学院School of Data Science, Fudan University
Handwriting recognition
1983 1989
United States Postal Service (USPS) and the University of Buffalo started a collaborationfor handwritten zip code digits recognition. Yann LeCun and
colleagues published the first paper using CNN.
1997 Today
First systems was deployed.
83% of the 70 million handwritten addresses are automatically sorted.
复旦大学大数据学院School of Data Science, Fudan University
Face recognition
2014Facebook produce an accuracy of 99%
2017Accuracy around 99.80%Pingan、Tecent rank top 1 in theworld
On a closed test set LFW (Labeled Faces in the Wild)
复旦大学大数据学院School of Data Science, Fudan University
Machine translation
1960 1990 – 2000
Machine translation research started in the 1960s.
Statistical machine translation
Future
Google translate serves 200 million people daily
2015
No jobs for human translators ?
复旦大学大数据学院School of Data Science, Fudan University
Autonomous driving
1980s 2005
Research started
DARPA Grand Challenge
2007 2015 - 2018
DARPA Urban Challenge
Uber built a team for self-driving. Baidu and other companies announced similar project
2009
Google started a self-driving car program
复旦大学大数据学院School of Data Science, Fudan University
Human Versus Machines
IBM1997 Deep Blue VS Garry Kasparov
Deepmind2016 Alpha GO VS Lee Sedol
CMU2017 Libratus VS Human playersno limit Texas hold 'em
复旦大学大数据学院School of Data Science, Fudan University
Human Versus Machines
Deepmind2019 AlphaStar VS Mana
OpenAI2017 AI VS Denti
复旦大学大数据学院School of Data Science, Fudan University
Human Versus Machines
2011 IBM Watson vsBrad Rutter and Ken Jennings on Jeopardy
Baidu2017 Xiaodu vs Super Human Brainon face recognition and speech recognition
复旦大学大数据学院School of Data Science, Fudan University
Is AI dominant the world?
复旦大学大数据学院School of Data Science, Fudan University
Limitation of Current AI Technology
复旦大学大数据学院School of Data Science, Fudan University
Limitation of Current AI Technology
复旦大学大数据学院School of Data Science, Fudan University
Limitation of Current AI Technology
◼ Closed VS Open environmentHigh accuracy is produced in a closed dataset
◼ Sensitive to noisy datae.g. speech recognition
◼ Pattern Recognition VS Real UnderstandingThe way machine make progress is different from whatpeople do
◼ Heavily rely on labeled dataArtificial intelligence is built on top of human annotator
复旦大学大数据学院School of Data Science, Fudan University
AI Winter
▪ 1966 – ALPAC report cuts off funding for translation in US
▪ 1974 – Lighthill report cuts off funding in UK
▪ 1987 – collapse of Lisp market, government funding cut in US
▪ When will be the next?
复旦大学大数据学院School of Data Science, Fudan University
Financial Application of AI
Calm indexon Twitter
Dow Jones Industrial Average
Johan Bollen, Huina Mao, Xiaojun Zeng. 2011. Twitter mood predicts the stock market, Journal of Computational Science 2:1, 1-8. 10.1016/j.jocs.2010.12.007.
复旦大学大数据学院School of Data Science, Fudan University
Financial Application of AI
◼ Kensho: Event driven financial support system
https://www.kensho.com/
复旦大学大数据学院School of Data Science, Fudan University
Medical Application of AI
Enlitic uses machine learning approach to make diagnosisautomatically.
https://www.enlitic.com/
复旦大学大数据学院School of Data Science, Fudan University
Outline
▪ What is artificial intelligence?
▪ What can AI do and can not do?
▪ What is this course about?
复旦大学大数据学院School of Data Science, Fudan University
AI: The science thinking
Think like people
Act like people
Think rationally
Act rationally
Rational Decision
复旦大学大数据学院School of Data Science, Fudan University
Rational Decisions
▪ Rational: maximally achieving pre-defined goals
▪ Rationality only concerns what decisions are made
(not the thought process behind them)
▪ Goals are expressed in terms of the utility of outcomes
▪ Being rational means maximizing your expected utility
复旦大学大数据学院School of Data Science, Fudan University
Course goal
▪ An agent is an entity that perceives and acts.
▪ A rational agent selects actions that maximize its (expected) utility.
▪ Characteristics of the percepts, environment, and action space dictate techniques for selecting rational actions
▪ This course is about:▪ General AI techniques for a variety of problem types▪ Learning to recognize when and how a new problem can be
solved with an existing technique
Age
nt
?
Sensors
Actuators
Enviro
nm
en
t
Percepts
Actions
复旦大学大数据学院School of Data Science, Fudan University
AI Tasks
...
Web searchSpeech recognition Handwriting recognition Machine translation Information extraction Document summarization Question answering Spelling correction Image recognition3D scene reconstruction Human activity recognition Autonomous driving Music information retrieval Automatic composition Social network analysis ...
...Product recommendation Advertisement placement Smart-grid energy optimization Household robotics Robotic surgeryRobot explorationSpam filteringFraud detectionFault diagnosticsAI for video gamesCharacter animation Financial trading Protein folding Medical diagnosis Medical imaging…
复旦大学大数据学院School of Data Science, Fudan University
How to tackle these AI tasks?
Real-world task
Formal task (model)
Program
Modeling
Algorithms
复旦大学大数据学院School of Data Science, Fudan University
What topics will you learn?
▪ Part I: Search▪ Informed Search
▪ Uninformed Search
▪ Adversarial Search
▪ Constraint Satisfactory Problem
▪ Part II: Graphical Model▪ Hidden Markov Model
▪ Bayes Nets
▪ Part III: Reinforcement Learning▪ Markov Decision Process
▪ Reinforcement Learning
▪ Part IV: Logic▪ First-order logic
▪ Propositional logic
复旦大学大数据学院School of Data Science, Fudan University
Course Staff
▪ Instructor▪ WEI, Zhongyu 魏忠钰
▪ Office:Zibin Building N202 子彬院北202
▪ Office Hour: Thu. 4 – 5:30pm
▪ Email: [email protected]
▪Tutor▪ Fan, Zhihao 范智昊
▪ Gao, Yixu 叶蓉
▪ Wang, Siyuan 王思远
复旦大学大数据学院School of Data Science, Fudan University
Course Information
▪ Check E-Learning platform for all the assignments
▪ Course website▪ http://www.sdspeople.fudan.edu.cn/zywei/DATA130008/index.html
▪ Work and Grading (tentative)▪ 4 programming assignments: Python▪ 1 final project▪ 1 Final Exam▪ 3 - 4 Labs with programming tasks
复旦大学大数据学院School of Data Science, Fudan University
Text Book
▪ Artificial Intelligence: A Modern Approach Russell & Norvig, 3rd Ed., Prentice Hall, 2009
复旦大学大数据学院School of Data Science, Fudan University
Course Material
▪We will use some materials from the following twocourses.▪ Artificial Intelligence: Principles and Techniques, Stanford
CS221
▪ Introductory Artificial Intelligence, UC Berkeley CS 188