future with machine vision
TRANSCRIPT
Art of the Tech
Future with Machine Vision
Nazli Temur
Computer Vision Engineer @ ATP
#dfist #Devfest17
Outline
Computer Vision Introduction
Teaching Machines Human Perceived World.
Challenges of Visual Perception
Computer Vision through Deep Learning
Conclusion
Demo
#dfist #Devfest17
Computer Vision IntroductionVision
#dfist #Devfest17
#dfist #Devfest17
“Computer Vision” is about
extracting semantic information
through visual perceptions.
#dfist #Devfest17
Domain Examples
#dfist #Devfest17
How did we come here
Orthographic Projection
Perspective Projection
Photography
#dfist #Devfest17
Where we are..
Stereo Projection(Epipolar)
Fisheye Projection
#dfist #Devfest17
Where we go through
We run after an enhanced way of
capturing the visual information
#dfist #Devfest17
Human Machine Interaction
Teaching machines humans’
visual world.
#dfist #Devfest17
Judgements Perceptions+ = Thinking
can explain the past ,
understand the present,
estimate the future
Cause and Effect
[Activities/Happenings] [Visual Information]
Visual Perceptions
-detection/tracking/recognition
Video Activity Recognition
?
#dfist #Devfest17
It is quoted by Professor David Derkins from Harvard University: ‘’up to 90% of errors in thinking are in perception not judgement’’.
When visual information is perceived or processed incorrectly, it cannot be matched or integrated with our other
senses.
#dfist #Devfest17
For a machine which is capable
of thinking like a human, the
ultimate need is ;
Because it combines our visual perception
with our judgements.
“Video Activity Recognition”
14
So, for a machine what is “activity recognition” about?
#dfist #Devfest17
Activity Recognition
#dfist #Devfest17
Activity Recognition
#dfist #Devfest17
For machine easiest way to achieve “activity recognition” is copying
cognitive subprocess underlying our visual perception and judgements
#dfist #Devfest17
Artificial Intelligence
Computer Vision through Deep
Learning
#dfist #Devfest17
What is Deep Learning?
Deep Learning is a subfield of machine learning concerned with
algorithms inspired by the structure and function of the brain called
artificial neural networks.
#dfist #Devfest17
Deep Learning Examples on Art
#dfist #Devfest17
Is the deep learning complete ?
The knowledge about physical properties of the objects can not be gained by perception…
[Kant]
#dfist #Devfest17
Deep Learning Examples on Art
#dfist #Devfest17
So, what do we expect from deep learning (AI) ?
#dfist #Devfest17
#dfist #Devfest17
or by This!
#dfist #Devfest17
or by This!
#dfist #Devfest17
Available Deep Learning
Frameworks - ToolsSoftware Development
#dfist #Devfest17
caffe
theano
torch
tensorflow
mxnet
#dfist #Devfest17
Challenges - Visual PerceptionComputer Vision
#dfist #Devfest17
Calibration
We need to ensure that everybody sees
straight line straight and curvature as curve.
An example with honeybee on mobile robots is here
https://www.ncbi.nlm.nih.gov/pubmed/12009050
12
3
31
Occlusions
Perspective effect
Noise
Detection Challenges
12
3
32
Re-identification
Noise
Real-time Processing
Tracking Challenges
#dfist #Devfest17
Activity Recognition Challenges
Human is a complex & complicated.
Activities are compositional.
Environment is unconstrained.
Context impact the level of detail.
Realtime happenings require high computation
#dfist #Devfest17
Futurism
Concluding with Brave New
Future with Machine Vision
#dfist #Devfest17
Heraclitus said ‘’expect the unexpected’’http://www.mirror.co.uk/news/uk-news/killer-robots-use-facial-recognition-11557764
#dfist #Devfest17
Conclusion
•Machines are getting smarter, mobile and intractable
•We create them to involve our lives , so they will be following our rules.
•If only we design them according to human visual perception and judgements.
• Deep Learning is in-directly associated with human judgement.
•Deep learning can help us better defining activities and knowing about human s
•For a better future we need to convince Computer Scientists and AI Geeks :D
#dfist #Devfest17
Audience
Poll LinkReset
Thank you!Questions?Questions?
Twitter: @DahaNlr
Gmail: [email protected]
Linkedin: https://www.linkedin.com/in/nazlitemur/
39