george campbell david hawescarleton jillson joseph kalinowskikeith pray cue the pool critic
TRANSCRIPT
![Page 1: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/1.jpg)
George CampbellDavid Hawes Carleton Jillson
Joseph Kalinowski Keith Pray
CUECUEThe Pool
CriticThe Pool
Critic
![Page 2: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/2.jpg)
Project DescriptionProject Description
The goal of our project was to build a system which would model a live pool game. It would then analyze the model to critique each shot.
![Page 3: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/3.jpg)
Project DesignProject Design
Table State
Look Image
Video In Get StatusStatus
Video Source
Movie
Vision
Analyzer
UserInterface
![Page 4: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/4.jpg)
Project DesignProject Design
• User Interface
• Analysis
• Transformation
• Vision
![Page 5: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/5.jpg)
Project DesignProject Design
• User Interface
• Analysis
• Transformation
• Vision
![Page 6: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/6.jpg)
User InterfaceUser Interface
• Designed using MFC
• Multi-Document Application
• Easy to use for the novice and expert
• Intended to have minimal back-end communication
![Page 7: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/7.jpg)
User InterfaceUser Interface
![Page 8: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/8.jpg)
Project DesignProject Design
• User Interface
• Analysis
• Transformation
• Vision
![Page 9: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/9.jpg)
AnalysisAnalysis
The analysis is responsible for building and interpreting the model of the live pool game.The analysis is responsible for building and interpreting the model of the live pool game.
• Model Parts– Table State– Events– Shot
![Page 10: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/10.jpg)
AnalysisAnalysis
Vision User Interface Vision User Interface
Table StatesTable States
EventsEvents Called ShotCalled Shot
ResultResult
![Page 11: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/11.jpg)
Project DesignProject Design
• User Interface
• Analysis
• Transformation
• Vision
![Page 12: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/12.jpg)
TransformationTransformation
Using vanishing points, a video image of the table is divided into regions which are mapped to relative regions of a table model.
Using vanishing points, a video image of the table is divided into regions which are mapped to relative regions of a table model.
Perspective issues:–Room constraints –Program more robust
Perspective issues:–Room constraints –Program more robust
![Page 13: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/13.jpg)
TransformationTransformation
![Page 14: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/14.jpg)
TransformationTransformation
![Page 15: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/15.jpg)
TransformationTransformation
![Page 16: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/16.jpg)
TransformationTransformation
![Page 17: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/17.jpg)
TransformationTransformation
![Page 18: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/18.jpg)
Project DesignProject Design
• User Interface
• Analysis
• Transformation
• Vision
![Page 19: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/19.jpg)
Acquiring VideoAcquiring Video
• Vision can accept any of the following formats– Live Video
– AVI Files
– Directory of static images
![Page 20: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/20.jpg)
Vision IssuesVision Issues
• Vision uses the vast majority of the process time– In order to have acceptable detail, large
numbers of pixels must be processed– Very efficient algorithms needed to produce
accurate results without slowing down CUE to a crawl
![Page 21: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/21.jpg)
• Noise needs to be compensated for:– Reflectivity of balls– Shadows– Camera Noise
Vision IssuesVision Issues
![Page 22: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/22.jpg)
How Does Vision Work?How Does Vision Work?
• Calibration
• Processing each Image
![Page 23: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/23.jpg)
CalibrationCalibration
• Using one image from the image source
• Find the edges of the image
• Find the key lines (bumpers) of the table
• Map the four corners of the table to model space using lookup table module
![Page 24: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/24.jpg)
Calibration ImageCalibration Image
![Page 25: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/25.jpg)
Processing ImagesProcessing Images
• Find the edges of the image
• Find the circles on the table
• Identify balls based on color matching
• Set the table state with ball locations
• Return the table state for analysis
![Page 26: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/26.jpg)
• Sample Edge Image Sample Processed Image
Processed ImagesProcessed Images
![Page 27: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/27.jpg)
DemoDemo
![Page 28: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/28.jpg)
Future ProjectsFuture Projects
• Incorporate AI Aspects– Learns physics/rules of pool by watching
games in play– Uses strategy to critique and recommend shots
• Robotic Implementation– Learns by trial and error– Carries out recommended shots in a real game
![Page 29: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/29.jpg)
Special Thanks To...Special Thanks To...
• Professor Michael Gennert
• Spencer Billiards
• John Chaillet
• Lisa Cocozzella
• Worcester Telegram & Gazette
Thank YouThank You
![Page 30: George Campbell David HawesCarleton Jillson Joseph KalinowskiKeith Pray CUE The Pool Critic](https://reader035.vdocuments.site/reader035/viewer/2022062315/5697bffc1a28abf838cc182f/html5/thumbnails/30.jpg)
George CampbellDavid Hawes Carleton Jillson
Joseph Kalinowski Keith Pray
CUECUEThe Pool
CriticThe Pool
Critic