![Page 1: Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of](https://reader035.vdocuments.site/reader035/viewer/2022070408/56649e6c5503460f94b6a9a8/html5/thumbnails/1.jpg)
Multimedia Information Retrieval and Multimedia
Data Mining
Chengcui Zhang
Assistant Professor
Dept. of Computer and Information Science
University of Alabama at Birmingham
![Page 2: Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of](https://reader035.vdocuments.site/reader035/viewer/2022070408/56649e6c5503460f94b6a9a8/html5/thumbnails/2.jpg)
General Content-Based Image Retrieval (CBIR)
![Page 3: Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of](https://reader035.vdocuments.site/reader035/viewer/2022070408/56649e6c5503460f94b6a9a8/html5/thumbnails/3.jpg)
Object-Based Image Retrieval
Example – Query by two objects
Techniques used: Image segmentation Neural network Multiple instance
learning …
![Page 4: Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of](https://reader035.vdocuments.site/reader035/viewer/2022070408/56649e6c5503460f94b6a9a8/html5/thumbnails/4.jpg)
Research Issues …
Multiple object retrieval for image databases Learning of composite model Information fusion
Apply the developed techniques to other applications such as drug activity discovery, pattern recognition for medical image analysis, etc.
![Page 5: Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of](https://reader035.vdocuments.site/reader035/viewer/2022070408/56649e6c5503460f94b6a9a8/html5/thumbnails/5.jpg)
Video Data Mining
Example: Locate the interesting events (goals, corner kicks,
etc.) in a large amount of raw, unprocessed soccer videos
Facilitate automatic annotation and indexing of the high-level structures of soccer videos
Soccer videos
……
Corner kick eventGoal event
……
![Page 6: Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of](https://reader035.vdocuments.site/reader035/viewer/2022070408/56649e6c5503460f94b6a9a8/html5/thumbnails/6.jpg)
Research Issues …
Video event mining: Detect other types of soccer events like free kick
s, referees, and fouls, etc. Discover the underlying associations among diffe
rent events/subevents Develop a scalable soccer video database syste
m and a flexible user query interface Apply to other types of videos (TV news, Basket
ball, etc.)
![Page 7: Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of](https://reader035.vdocuments.site/reader035/viewer/2022070408/56649e6c5503460f94b6a9a8/html5/thumbnails/7.jpg)
A Soccer Video Retrieval System Using Temporal Relationships
![Page 8: Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of](https://reader035.vdocuments.site/reader035/viewer/2022070408/56649e6c5503460f94b6a9a8/html5/thumbnails/8.jpg)
Video Surveillance for Intelligent Transportation Systems (ITS)
Frame 132
Frame 138
Frame 142
![Page 9: Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of](https://reader035.vdocuments.site/reader035/viewer/2022070408/56649e6c5503460f94b6a9a8/html5/thumbnails/9.jpg)
Other Research Projects
Microarray image analysis …