irida labs - cross border technologies
TRANSCRIPT
Irida Labs
Embedded Video Processing
www.iridalabs.com
CONFIDENTIAL - Page 2
Irida Labs About us
IRIDA Labs is a platform-independent leading technology provider of software and silicon IPs for Embedded Video Processing.
Our product and technology portfolio includes video stabilization with rolling shutter correction, face detection and recognition, low-light image/video.
IRIDA Labs is a privately-held company with headquarters in Patras, Greece and worldwide sales support, backed by VC and private investors.
Acknowledged R&D excellence and USPTO patent pending technologies.
12 engineers, 8PhDs in Computer Vision
IRIDA Labs is partnered with Cadence/Tensilica, CEVA, and ARM.
Our vision is to become a Key Player in the Computer Vision market mainly aiming to grow through strategic partnerships.
Markets
Mobile phones
Home electronics
Wearable devices
Automotive
Supported platforms
CONFIDENTIAL - Page 3
Image
Pipeline
Scene
Analysis
ISP
Apps.
Face
detection
Gesture
Recognition
Object
detection
Augmented
reality
Super
resolution
Stabilizer
WDR
AAA
Raw-to-YUV
JPG
Saturation
enhancement
Embedded
Computer
Vision
Face
Recognition
Image
Understanding
EDoF
Emotion
Recognition
Low-Light
enhancement
Technologies Landscape
Irida Labs’s field of expertise
5
IRIS-Logo – Logo Detection and Recognition 5
IRIS-Gallery – Image Gallery Organization 6
Portfolio Extension Roadmap
6
IRIS-VISTA – Real time video stabilization
IRIS-EnLight – Low-Light Video Enhancement 2
1
3
4
iFaDe – Fast, High precision, Real Time Face
Detector
IRIS-FaRe – Face Recognition and Verification
Product Portfolio
1
2
3
4
Embedded Computer Vision Technologies
CONFIDENTIAL - Page 4
Product Portfolio
IRIS-FaRe – Face Recognition and Verification
2
1
3
4
Embedded video processing software and Silicon IPs
IRIS-EnLight – Low-Light Video Enhancement
iFaDe – Fast, High precision, Real Time Face Detector
IRIS-VISTA – Real time video stabilization IRIS-VISTA – Real time video stabilization
CONFIDENTIAL - Page 5
IRIS-VISTA
IRIS-VISTA Features
Real-time video stabilization for embedded devices
Corrects unwanted lateral, rotational, vertical
motion and movement towards/backwards
from the subject.
Corrects rolling shutter effects (bending,
“Jelly”) that is inherent to CMOS sensors.
Flexible and scalable solution based on
configuration parameters.
Motion aware.
Fully exploits the special architectural
characteristics of a given processing platform.
Compatible with fixed-point architectures.
CONFIDENTIAL - Page 6
IRIS-VISTA
Real-time video stabilization for embedded devices
IRIS-VISTA Technical Characteristics Summary
Characteristic Value
Degrees of Freedom Up to 9
Video Resolution Up to 4K*
Frame Rate Up to 60 fps*
Power Consumption As low as 30 mW*
Memory Buffer 2 video frames
Latency 1 frame
Rolling shutter correction Yes
Unwanted motion cancellation Yes
Input from Gyros Supported
Autonomous motion Estimation Supported
* Implementation on Cadence/Tensilica IVP
CONFIDENTIAL - Page 7
IRIS-VISTA
Real-time video stabilization for embedded devices
IRIS-VISTA Competitive Advantages
Motion
Estimation
Motion
Filtering
Motion
Correction
Advantages in Motion Estimation
Visual Motion Estimation
(Gyros not Needed)
Robust to outliers (moving
objects within camera FoV)
Optimal result for minimum
DoFs = Lower Power
Rolling Shutter distortion
estimation
Advantages in Motion Filtering
Special filtering allows for
fast response on motion
changes
No need for extended
buffering
Motion analysis and
automatic system adaptation
Control of black border
areas
Advantages in Motion Correction
Clear results: Special care
in image interpolation
Corrects also Translation
Rolling shutter rectification
Typical Video Stabilization System
Input Output
Advantages in System Level
Superior quality in
stabilization and image
quality
Low-power
Scalable
Complete software
solution
CONFIDENTIAL - Page 8
IRIS-VISTA
Real-time video stabilization for embedded devices
IRIS-VISTA Installation Process
Evaluation
•Irida Labs provides Android apk to client (under NDA) and eval instructions
•Client could provide test videos
Model
customization
•Customization on specific smartphone model or processing platform (SoC)
Model
Integration
•Integration of IRIS-VISTA library on the low level Android version of the client.
•I/Os implementation
2 weeks 2-4 weeks 6-8 weeks
Product Portfolio
IRIS-VISTA – Real time video stabilization
IRIS-FaRe – Face Recognition and Verification
2
1
3
4
Embedded video processing software and Silicon IPs
IRIS-EnLight – Low-Light Video Enhancement
iFaDe – Fast, High precision, Real Time Face Detector
CONFIDENTIAL - Page 10
IRIS-EnLight
IRIS-EnLight
Enhances images and videos taken:
In challenging lighting conditions
In low-shutter speeds especially in indoor enviroment (for reducing bluring
effects)
Enhances regarding contrast and intensity, restoring the original color content of the
scene
Features a denoising scheme both spatial and temporal, in order to reduce noise
appearing due to low-light perception of the image sensor
IRIS-EnLight: Video Low-Light Enhancement for embedded systems
CONFIDENTIAL - Page 11
IRIS-EnLight
IRIS-EnLight Features
Enhances images and videos taken in challenging
lighting conditions.
Features single and multi-frame video de-noising
(optional).
Real-time operation on Full-HD 30fps and 60fps
performance.
IRIS-EnLight: Video Low-Light Enhancement for embedded systems
Fully exploits the special architectural
characteristics of the any processing core.
Compatible with fixed-point architectures.
Exhibits small memory footprint.
Features low-power consumption.
CONFIDENTIAL - Page 12
IRIS-EnLight
IRIS-EnLight Competitive Advantages
IRIS-Enlight System
Input Tone
Mapping
Noise
Suppression
Output
Advantages in System Level
Superior image quality
Natural Colors
Many choices for porting
Noise Suppression
IRIS-EnLight: Video Low-Light Enhancement for embedded systems
Advantages in Noise suppression
Spatial (Intraframe) and
temporal (Interframe)
processing
Preserve the crispness of
the frames
Advantages in Tone Mapping
Preserves the color contents of
the images/videos
No color distrortion
Low-power performance
CONFIDENTIAL - Page 13
Business Model
Technology licensing.
Customization/NRE applies in the case we tailor the IP for specific design.
Technology licensing.
Plus royalties based on a predefined amount per device.
Irida Labs team is open and flexible in terms of business models:
Licensing plus Customization/NRE fees
Installation plus Royalties
CONFIDENTIAL - Page 14