Multimedia Information Retrieval and Multimedia

Data Mining

Chengcui Zhang

Assistant Professor

Dept. of Computer and Information Science

University of Alabama at Birmingham

General Content-Based Image Retrieval (CBIR)

Object-Based Image Retrieval

Example – Query by two objects

Techniques used: Image segmentation Neural network Multiple instance

learning …

Research Issues …

Multiple object retrieval for image databases Learning of composite model Information fusion

Apply the developed techniques to other applications such as drug activity discovery, pattern recognition for medical image analysis, etc.

Video Data Mining

Example: Locate the interesting events (goals, corner kicks,

etc.) in a large amount of raw, unprocessed soccer videos

Facilitate automatic annotation and indexing of the high-level structures of soccer videos

Soccer videos

……

Corner kick eventGoal event

……

Research Issues …

Video event mining: Detect other types of soccer events like free kick

s, referees, and fouls, etc. Discover the underlying associations among diffe

rent events/subevents Develop a scalable soccer video database syste

m and a flexible user query interface Apply to other types of videos (TV news, Basket

ball, etc.)

A Soccer Video Retrieval System Using Temporal Relationships

Video Surveillance for Intelligent Transportation Systems (ITS)

Frame 132

Frame 138

Frame 142

Other Research Projects

Microarray image analysis …