artificial intelligence: computer vision
TRANSCRIPT
1
AI WizardsArtificial Intelligence: Computer Vision
Our promise: Increasing productivity with fewer errors; increasing safety & security of your premises; understand your customers
We use CCTV feeds inside the premises to analyse asset and process deviation while mapping deviations
2
Our AI software can analyze anything that a CCTV camera can see/detect using “deep learning models”
Our software plugs into existing CCTVoutput to provide seamless monitoring
The software provides data for (a) realtime alerts (mishandling, fire,disturbances, process deviation etc.);and (b) analytical information(utilization, productivity, idle-time etc.)
Automatic alerts are sent on emails,SMS and push notifications whiledashboard are generated end of day onwhich periodic analysis is done toidentify trend-lines
Our Deep learning model works whilemaintaining complete IP secrecy as it isrun completely in on-premise mode
People behind the company
B.Tech., IIT Bombay with 15 years experience in industrial IOT, automation and
Machine Learning
Worked as chief integration architect at Antenna Software, integration specialist
at Oracle etc
B.Tech. + M.Tech., IIT Bombay and MBA, IIM Lucknow
15 years experience primarily in investment banking (YES Bank and Kotak
Securities) and private equity (ICICI Venture)
Been Board nominee of Indian and international companies as well
B.Tech., IIT Bombay with 15 years experience
Instrumental role in establishing OYO Rooms Western India operations
Serial entrepreneur with AIW being his third venture
Nitin Jain
Head - Operations
Job Philip
Head – Marketing
Kunal Kislay
Head - Technology
North America Europe APAC
Customers
Most of Retail Outlets, Manufacturing premises,Warehouses, Yards, Power Plants have CCTV Cameras formonitoring and surveillance
CCTVs are everywhere – do we use them effectively?
It is estimated that there are over 500 Million CCTV Camerastoday. The number is expected to be around 1B by end of2021
IOT HubTMS
Cache SQL NO SQL
GPU
RTMP, RTSP, HTTP, UDP etc.
Device Touchpoints
Business Layer
Presentation Layer
Web App Reporting Engine Native Mobile App
Polling Adapter
REST Adapter
SOAP Adapter
SAML Adapter
Notification Listener
Rule Engine MachineLearning
Real-time Location Engine
Authentication BusinessLogic
NotificationHub
JSON over MQTT
IOT Hub(Telemetry)
From Hub(Commands)
How does it work: Our solution architecture
6
ERP+
• MHE Utilization and Tracking• Vehicle/Truck Turn Around Time• Volume Calculation/ Pallet movement/ Packets
Counting• Personnel Utilization• Vehicle/Truck Turn Around Time• Dock Utilization
• Personnel Protective Equipment (PPE) compliance • SOP Compliance• Encroachment• MHE - Near miss• Presence of fire Extinguishers• Fire Detection• Person count in case of Fire Drill/Actual Fire• Ergonomics/SOP Adherence• Vehicle Speed/Vehicle Safety• Face Mask detection• Social Distancing• Temperature Monitoring
HSE Productivity Safety
Health and Safety Productivity
IRIS Use-cases
Security
• Human intrusion at periphery• Pilferage• Crowd formation• Unverified access in restricted areas• Facial recognition-based attendance• Access control through facial recognition
Health and Safety
View use case video
https://www.youtube.com/watch?v=4m01tWLnUZ0&feature=emb_logo
Personnel Protective Equipment complianceA
larm
can
be
rai
sed
in t
he
even
t o
f n
on
co
mp
lian
ce
Sup
po
rted
PP
E’s
Helmet, hair cap Safety glasses Safety shoes Face Masks Gloves Apron/Coveralls
Sample Videos – https://drive.google.com/open?id=1GyYm-lPqtj1UTZSQD8ZQG5Taa2shCwuI
Compliance
SOP Compliance Encroachment Fire Extinguishers Ergonomics
Sample Videos – https://drive.google.com/open?id=1PsuyrK-NltNpzMjnj9heQH3yBMiyLUsr
Need to ensure the presence of fire extinguishers in designated areas. When one is not located, an alarm is raised.
A virtual boundary is used to define encroachment free areas. Whenever the Camera detects individuals or objects placed in the encroachment free zone an alarm is raised.
Encroachment Fire Extinguishers Ergonomics
Ergonomics based compliance like proper bending while lifting heavy load, moving up the stairs without holding the rails etc. need to be adhered to and exceptions are captured by the system
Fire Detection/DrillA
larm
can
be
rai
sed
in t
he
even
t o
f fi
re o
r sm
oke
Sup
po
rted
PP
E’s
Fire detection in under 5 secsSeamless integration with
fire departmentInterface with hooters Long distance monitoring
Counting entry and exit of people in drills
Sample Videos – https://drive.google.com/open?id=1lW_KgzE2TdSu2JujS8GVVs2n0pfLQBnf
https://drive.google.com/open?id=1zFDtZ5Z7B4X9rPqLuWm0hb6M178gpkm9https://drive.google.com/open?id=1lW_KgzE2TdSu2JujS8GVVs2n0pfLQBnf
AI Powered Incident and Near Miss Management
Use
rs e
mp
ow
ered
pro
acti
ve a
pp
roac
h t
ow
ard
s H
SE u
sin
g A
I.
Identification of Near miss Notification Follow up CAPA
AI powered HSE application.
Incident
Near Miss
Accident
Report History
Notifications Guaranteed Delivery
AI Analytics Potential Hazards
Info
rmat
ive
| In
tera
ctiv
e |
Easy
to
Fo
llow
| S
imp
le a
pp
roac
h
ProductivityView use case video
https://drive.google.com/open?id=1zbFoEebXpma7iqRkYFsEvQQ88SBkbOEt
Truck Space Utilization
Personnel Utilization
Load Preparation Area Utilization.
Truck TATForklift
UtilizationNear Misses Dock Utilization.
IRIS has the capability to interface with existing CCTV cameras to identify predefined scenarios and update enterprise systems
Truck Space Utilization Personnel Utilization Encroachment Truck Turn Around Time
Forklift Utilization Near Misses (Forklift Safety) Dock Utilization
IRIS has the capability to interface with existing CCTV cameras to identify predefined scenarios and update enterprise systems
Daily utilization and efficiency analytics for each warehouse.
IRIS for Warehouses/ Factories
Intrusion Detection
Defect Identification / Quality Control
A large FMCG player using IRIS AI to find out defects in Potato Chip during production and thereby accepting/ rejecting the potato lot
SOP/ Compliance Adherence
Real-time alerts on SOP deviations – For example
• Material mishandling
• Operator not following SOPs
• Safety Violations etc
Machine Utilization
Dock UtilizationR
olle
d u
p a
s w
ell a
s lo
w le
vel d
etai
ls a
vaila
ble
Sup
po
rted
PP
E’s
Utilization Loading time Unloading time Wait time Trip level details Truck level details
Sample Videos – https://drive.google.com/open?id=1r6q42T8fwbtUxqfYVLHDvTQBAw1PgYxJ
Personnel UtilizationR
olle
d u
p a
s w
ell a
s lo
w le
vel d
etai
ls a
vaila
ble
Sup
po
rted
PP
E’s
Utilization Loading time Unloading time Wait time Trip level details Truck level details
Sample Videos – https://drive.google.com/open?id=1dxZYL4P1x323YvkmBo6LLRg0aJ_Pv_YI
Truck TAT and Space UtilizationR
olle
d u
p a
s w
ell a
s lo
w le
vel d
etai
ls a
vaila
ble
Sup
po
rted
PP
E’s
Utilization Loading time Unloading time Wait time Trip level details Truck level details
Sample Videos –https://drive.google.com/open?id=1dxZYL4P1x323YvkmBo6LLRg0aJ_Pv_YI
Forklift/MHE utilizationR
olle
d u
p a
s w
ell a
s lo
w le
vel d
etai
ls a
vaila
ble
Sup
po
rted
PP
E’s
Distance Travelled Loaded Unloaded Utilization Number of pallets CBM Moved
Sample Videos –https://drive.google.com/drive/u/0/folders/1dxZYL4P1x323YvkmBo6LLRg0aJ_Pv_YI
SecurityView use case video
https://drive.google.com/open?id=1edgcem4dt_QzZ1VoqK5qHZfGiPWeFAv5
Intrusion Detection
CCTV Based Intrusion Virtual Boundary Autonomous Drones Notifications
Sample Videos – https://drive.google.com/open?id=1PsuyrK-NltNpzMjnj9heQH3yBMiyLUsr
Autonomous drones get the intrusion co-ordinates from the CCTV feed and move to the location
CCTV Cameras detect individuals loitering around or trespassing virtual boundaries defined
CCTV Based Intrusion detection Autonomous Drones Notifications
Notifications with the image of the intruder is sent to the concerned autority
Facial Recognition based attendanceG
et p
ers
on
ne
l att
end
ance
th
rou
gh C
CTV
Cam
era
s
Sup
po
rted
PP
E’s
Attendance Access Control Unauthorized entry
Sample Videos –https://drive.google.com/open?id=1cioMj74vWzM0uhfF1ueskFJRgWo9nm6U
Other Solutions
• COVID Solution
• Retail Stores Use Cases
Covid-19: Govt’s SOP for workplace
Guidelines from various Govt include:
Social distancing
o Seating atleast six feet away on job sites in gathering, meetings and training sessions
o Large gatherings or meetings of 10 or more is discouraged
o Not more than 2/4 people in lift or hoists etc
Visitors’ monitoring
o Complete ban on non-essential visitors at offices / sites
Mandatory wearing of face masks
Temperature screening
Our solution: Based on your existing CCTV network
1. Real-time information
Real-time alerts via mobile notifications (SMS, Whatsapp,Call, E-mail) to the concerned manager or publicannouncement on speaker depending on the criticality ofbreach around
o Social distancing:
Large gatherings
Physical distance between two people
Unauthorized outside visitors etc
o Masks: Scanning of faces and alerts on people notwearing masks
Our solution: Based on your existing CCTV network (Cont’d.)
2. Actionable insights on dashboard
Dashboard access to senior management (over the internet)which includes:
o Image snapshot of all alerts / deviations with time-stamps:downloadable dataset
o Real-time score on Physical Distancing as an index
Allows to measure the compliance on guidelines as ascore
Our solution: Based on your existing CCTV network (Cont’d.)
3. Integrating with existing set-ups
We could also integrate with your existing set-ups that youmight have to provide a one-stop solution for Covid-19monitoring
o Interface with your thermal cameras, if any, forscreening of employees / visitors entering thepremises
If you don’t have thermal cameras, we couldinstall as well (third party cameras) and integratewith our AI solution for alerts / dashboard
o People with temperature over 990C could beidentified on real-time basis (automatedidentification) and further processed based onapplicable Govt rules
Assert video analytics: Examples of use case (Cont’d.)
Number plate and facial recognition
• On boarding employees/ workers on the platform
• Automatic attendance using face recognition solution
Face Recognition based Attendance
Other Solutions
• COVID Solution
• Retail Stores Use Cases
Retail Solution
Footfall
Demographics
Emotions
Heat Maps
Employee Productivity
Select retail client use-cases
Customer analysis including demographics, heat-map, dwell-time, repeat behavior etc
Employee SoP on greeting, counter manning, store opening and closing time etc
Real-time alerts on queue formation, wait-time etc
Drone based image taking which is analyzed by our AI for stock tracking
Reduces time, human intervention and thereby reducing cost and errors
Queue monitoring at the billing counter
Unmanned stores alerts for a fallen/trapped person
Unsupervised Children entering stores
Customer experience including turn-around time, wait-time, meeting and greeting etc
SoP adherences at collection center on sample collection, dress code, attendance etc
Queue formation at petrol pumps including lost sales analysis
Repeat customer analysis and analysis of type of vehicles (car, bus, taxi, bike etc)
Employee SoP around protective equipment wear, decantation process adherences etc.
Customer feedback through a thumbs up/thumbs down gesture
Additional service monitoring in premium outlets like windscreen wiping etc.
Customer analysis on repeat pattern, wait-time, peak-time etc
Dining areas: Opening and closing time, cleanliness, alignment of chairs / tables etc
Early fire warning (much before fire alarm) in the kitchen area
Dashboard