detecting m o aerial i unmanned a v - mathworks...detecting moving objects in aerial imagery...
TRANSCRIPT
![Page 1: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/1.jpg)
DETECTING MOVING OBJECTS IN
AERIAL IMAGERY CAPTURED FROM
UNMANNED AERIAL VEHICLE (UAV)
Padma Priya V
University of Canberra
![Page 2: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/2.jpg)
UNMANNED AERIAL VEHICLES
Extends human reach
Can be programmed to complete the mission
autonomously
Large area covered
High resolution images at varying altitudes
Multi modal imagery – Thermal and Visible
Clear Aerial overview
Discrete and Silent – Low noise levels as opposed
to helicopters
Low Cost
![Page 3: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/3.jpg)
UAVS AND COMPUTER VISION
Surveillance – Security and Defence Systems
Traffic Analysis
Wildlife Monitoring
Disaster Response
Search and Rescue
Path Planning, Navigation Control
Maybe Amazon delivery!
![Page 4: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/4.jpg)
SURVEILLANCE AND TRAFFIC MONITORING
Reconnaissance, Tactical and Security
applications
Border patrol
Compute traffic metrics automatically
Detect unusual activities
Dutch Government deploys drones to get real
time traffic information on route to Concert at
Sea festival in Zeeland
Drones deployed on Mumbai-Pune expressway to
monitor traffic and the cause for accidents
![Page 5: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/5.jpg)
WILDLIFE MONITORING
Wildlife Monitoring, Population Estimate
Namibia Kuzikus Wildlife Reserve
Shark patrol
Detecting wildlife in agricultural land
Low noise, does not disturb the animals
![Page 6: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/6.jpg)
MOVING OBJECT DETECTION
Detect moving foreground
Track them over next few frames
![Page 7: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/7.jpg)
THE FOREGROUND DETECTION PROBLEM
Global Vs. Local motion(UCF dataset - Actions
sample)
![Page 8: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/8.jpg)
CHALLENGES
Constantly moving background
Altitude and perspective variations
Camera jitter
Changing weather conditions
![Page 9: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/9.jpg)
METHODS FOR ESTIMATING GLOBAL
MOVEMENT
KLT points tracker
Optical flow
Moments
![Page 10: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/10.jpg)
ORIGINAL VIDEO – UAV123 DATASET
Matthias Mueller, Neil Smith and Bernard Ghanem, “A Benchmark and
Simulator for UAV Tracking”, European Conference on Computer Vision
(ECCV 2016 )
![Page 11: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/11.jpg)
APPROACH USED
![Page 12: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/12.jpg)
KLT FEATURE TRACKER
SURF Points extracted from the initial frame
detectSURFFeatures
extractFeatures
Track features between frame
Create object vision.PointTracker
Initialize with SURF points
Track across adjacent frames
![Page 13: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/13.jpg)
ROLL PITCH AND YAW
![Page 14: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/14.jpg)
ESTIMATE GEOMETRIC TRANSFORMATION
Fit geometric transformation to control point
pairs between the Fixed and Moving Frame
Estimate ‘Projective’ Geometric transformation -fitgeotrans
Apply the transformation to Moving frame - imwarp
Adjust the X and Y bounds of the Fixed and Moving
Frames
![Page 15: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/15.jpg)
GEOMETRIC TRANSFORMATION
![Page 16: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/16.jpg)
FRAME DIFFERENCING
![Page 17: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/17.jpg)
IMAGE NORMALIZATION
![Page 18: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/18.jpg)
MORPHOLOGICAL OPERATIONS AND
CONNECTED COMPONENT ANALYSIS
Erosion and dilation - imdilate imerode
imclose
Fill holes in binary image - imfill
Remove all connected components that have
fewer than p no. of pixels to remove noise -bwareaopen
Find Connected Components - bwconncomp
Measurements - regionprops
![Page 19: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/19.jpg)
RESULTS VIDEO
![Page 20: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/20.jpg)
Questions?
![Page 21: DETECTING M O AERIAL I UNMANNED A V - MathWorks...DETECTING MOVING OBJECTS IN AERIAL IMAGERY CAPTURED FROM UNMANNED AERIAL VEHICLE (UAV) Padma Priya V University of Canberra](https://reader034.vdocuments.site/reader034/viewer/2022042411/5f28ea50b7be101d234652e8/html5/thumbnails/21.jpg)
Thank You!