multimedia/video search
DESCRIPTION
Multimedia/Video Search. חיפוש מולטימדיה בדגש חוזי. אריאל פרנק מחלקה למדעי המחשב אוניברסיטת בר-אילן [email protected]. Contents. Multimedia (MM) and search/retrieval Text-based MM search in General SEs Text-based MM search in Vertical SEs Tag-based MM search Content-based MM search - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/1.jpg)
A. Frank
Multimedia/Video Search
חיפוש מולטימדיה בדגש חוזי
אריאל פרנקמחלקה למדעי המחשב
אוניברסיטת בר-אילן[email protected]
![Page 2: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/2.jpg)
A. Frank2
Contents
• Multimedia (MM) and search/retrieval
• Text-based MM search in General SEs
• Text-based MM search in Vertical SEs
• Tag-based MM search
• Content-based MM search
• Video downloads
![Page 3: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/3.jpg)
A. Frank3
Multimedia Resources
• ,Pictures, Photos, Maps, Graphics) תמונות Animations)
• (Audio, Sounds) שמע
• (Music, MP3)מוסיקה
• (Radio, Podcasts, Speeches) הקלטות
• (Video, Flash, Vlogs)חוזי
• (Movies, TV) סרטים
![Page 4: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/4.jpg)
A. Frank4
MM Search & Information Retrieval (MMIR)
• Search & information retrieval of multimedia objects is hard!!
• Using SEs to find relevant, quality MM objects can be difficult and frustrating.
• Sample query: find a movie that has a large mouse chasing a Persian cat with twins watching from above?
![Page 5: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/5.jpg)
A. Frank5
MM Search & Information Retrieval (MMIR)
• Common MM search is mainly text-based; the object text is derived from:– caption of the MM object
– text surrounding the MM object
– entire text of the containing page
– filenames of MM object and the containing page
– manual/automatic annotations
• Recently, tag-based MM search is becoming effective (social computing).
• Fortunately, long due, content-based MM search on the Web is forthcoming.
![Page 6: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/6.jpg)
A. Frank6
Contents
• Multimedia (MM) and search/retrieval
• Text-based MM search in General SEs
• Text-based MM search in Vertical SEs
• Tag-based MM search
• Content-based MM search
• Video downloads
![Page 7: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/7.jpg)
A. Frank7
General SEs Sample
• Google (general, video)
• Yahoo (general, audio)
• AOL (general, video)
• MSN/Live (images, video)
• AltaVista (images, audio, video)
![Page 8: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/8.jpg)
A. Frank8
Multimedia: Google
![Page 9: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/9.jpg)
A. Frank9
Multimedia: Google
![Page 10: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/10.jpg)
A. Frank10
Multimedia: Yahoo
![Page 11: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/11.jpg)
A. Frank11
Yahoo Audio Search
![Page 12: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/12.jpg)
A. Frank12
![Page 13: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/13.jpg)
A. Frank13
AOL Video Search
![Page 14: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/14.jpg)
A. Frank14
MSN Live
![Page 15: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/15.jpg)
A. Frank15
Multimedia: MSN Live
![Page 16: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/16.jpg)
A. Frank16
AltaVista Multimedia Search
![Page 17: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/17.jpg)
A. Frank17
Contents
• Multimedia (MM) and search/retrieval
• Text-based MM search in General SEs
• Text-based MM search in Vertical SEs
• Tag-based MM search
• Content-based MM search
• Video downloads
![Page 18: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/18.jpg)
A. Frank18
Vertical SEs Sample
• Picsearch (image)
• FindSounds (audio)
• SearchVideo (video)
• Clipblast! (video)
• Flurl (multimedia)
![Page 19: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/19.jpg)
A. Frank19
Images: Picsearch
![Page 20: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/20.jpg)
A. Frank20
Picsearch Advanced Interface
![Page 21: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/21.jpg)
A. Frank21
Audio: FindSounds
![Page 22: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/22.jpg)
A. Frank22
Types of Sounds
![Page 23: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/23.jpg)
A. Frank23
Video: SearchVideo
![Page 24: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/24.jpg)
A. Frank24
Video: Clipblast!
• Organizes and makes the video Web relevant, fast and simple to navigate.
• Video Search and Navigation technology makes it easy to search, browse and personalize the video that viewers want, when they want it.
• Crawls the entire Web for all video content available, indexing more video content providers than any other video search engine.
• Largest video distribution platform ever.
![Page 25: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/25.jpg)
A. Frank25
Video: Clipblast
![Page 26: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/26.jpg)
A. Frank26
Multimedia: Flurl
![Page 27: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/27.jpg)
A. Frank27
Flurl list of sites
![Page 28: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/28.jpg)
A. Frank28
Contents
• Multimedia (MM) and search/retrieval
• Text-based MM search in General SEs
• Text-based MM search in Vertical SEs
• Tag-based MM search
• Content-based MM search
• Video downloads
![Page 29: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/29.jpg)
A. Frank29
Tag-based Search Sample
• Flickr (image)
• Panoramio (image, maps)
• YouTube (video)
• Keotag (multimedia)
![Page 30: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/30.jpg)
A. Frank30
Flickr
![Page 31: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/31.jpg)
A. Frank31
Flickr
![Page 32: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/32.jpg)
A. Frank32
Flickr
![Page 33: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/33.jpg)
A. Frank33
Image/Maps: Panoramio
![Page 34: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/34.jpg)
A. Frank34
Image/Maps: Panoramio
![Page 35: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/35.jpg)
A. Frank35
Image/Maps: Panoramio
![Page 36: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/36.jpg)
A. Frank36
Video: YouTube
![Page 37: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/37.jpg)
A. Frank37
Keotag Meta-SE
![Page 38: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/38.jpg)
A. Frank38
Keotag Meta-SE
![Page 39: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/39.jpg)
A. Frank39
Contents
• Multimedia (MM) and search/retrieval
• Text-based MM search in General SEs
• Text-based MM search in Vertical SEs
• Tag-based MM search
• Content-based MM search
• Video downloads
![Page 40: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/40.jpg)
A. Frank40
“Content-based“ Image Search/Retrieval
• “Content based” image DB or Web site(s) that contain a large number of images.
• Image analysis techniques used to describe images by their extracted visual features such as color, texture, shape and orientation.
• These objects can be represented by sets of image features and then compared with the sets extracted from other images.
• Feature sets are described by their statistics, and the computer searches for statistically likely matches.
• Queries can be formulated in terms of visual features or by similarity options.
![Page 41: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/41.jpg)
A. Frank41
Content-based Search Sample
• Squid (image)
• retriever (image)
• Melodyhound (audio)
• Musipedia (music)
• Blinkx (video)
![Page 42: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/42.jpg)
A. Frank42
Image: Squid
• Has about 1100 images of marine creatures in its database.
• Each image shows one distinct species on a uniform background.
• Every image is processed to recover the boundary contour, which is then represented by three global shape parameters and the maxima of the curvature zero-crossing contours in its Curvature Scale Space (CSS) image.
![Page 43: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/43.jpg)
A. Frank43
Images: Squid
![Page 44: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/44.jpg)
A. Frank44
Images: Squid
![Page 45: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/45.jpg)
A. Frank45
Images: Squid
![Page 46: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/46.jpg)
A. Frank46
Images: Squid
![Page 47: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/47.jpg)
A. Frank47
Image: retriever
• Experimental service which lets you search and explore in a selection of Flickr images by drawing a rough sketch.
• Matches the most pronounced shapes and slabs of colors.
• The results are usually fairly good, sometimes even stunning,
• But it doesn't do object/face recognition of any kind, so if drawing an outline sketch of a chair, it almost certainly won't get you one back.
![Page 48: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/48.jpg)
A. Frank48
Images: retriever
![Page 49: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/49.jpg)
A. Frank49
Images: retriever
![Page 50: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/50.jpg)
A. Frank50
Images: retriever
![Page 51: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/51.jpg)
A. Frank51
MelodyHound
![Page 52: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/52.jpg)
A. Frank52
MelodyHound
![Page 53: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/53.jpg)
A. Frank53
MelodyHound
![Page 54: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/54.jpg)
A. Frank54
MelodyHound
![Page 55: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/55.jpg)
A. Frank55
Musipedia
![Page 56: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/56.jpg)
A. Frank56
Audio: MusiPedia
![Page 57: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/57.jpg)
A. Frank57
Music: Musipedia
![Page 58: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/58.jpg)
A. Frank58
Musipedia or Web Search?
![Page 59: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/59.jpg)
A. Frank59
Video: Blinkx
• World's largest and most advanced video search engine.
• Use of visual analysis and speech recognition to better understand rich media content.
• Advanced image and audio analysis techniques are used to automatically extract information about a video in real time and to create a rich index about the video content.
• Automatically and implicitly conducts searches based on the content being viewed by each individual user.
• With the advent of blinkx TV, users can now search and access news, movie trailers, popular multimedia segments and other video formats on demand.
![Page 60: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/60.jpg)
A. Frank60
Video: Blinkx
![Page 61: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/61.jpg)
A. Frank61
Video: Blinkx
![Page 62: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/62.jpg)
A. Frank62
Blinkx TV Architecture
![Page 63: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/63.jpg)
A. Frank63
Contents
• Multimedia (MM) and search/retrieval
• Text-based MM search in General SEs
• Text-based MM search in Vertical SEs
• Tag-based MM search
• Content-based MM search
• Video downloads
![Page 64: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/64.jpg)
A. Frank64
Video downloads
• Nearly none of the video search/sharing sites provide a simple one-click button to download video clips.
• If video download needed, various workarounds exist (ordered by preferred methods, if some not working):
1. Right-click on link -> “Save Target/Link As”.2. Install/use the Firefox VideoDownloader Extension,
from Mozilla addons site, to download video (and audio).3. Copy video link into KeepVid site and download from
the provided link (usually saving it as FLV file).4. View -> “(Page) Source”, locate video filename/format,
and look in its directory, or search for it (filetype:, contains:). 5. Use Applian Technologies streaming capture applications
to record streaming audio/video into a file.
![Page 65: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/65.jpg)
A. Frank65
VideoDownloader
• A Mozilla Firefox Extension that downloads all embedded MM objects on a page including video.
• Just click the icon to download the watched video.• VideoDownloader
![Page 66: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/66.jpg)
A. Frank66
Keepvid
![Page 67: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/67.jpg)
A. Frank67
“View Source” techniques
How to get playing VideoDownloader Flash file!?
![Page 68: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/68.jpg)
A. Frank68
“View Source” page
![Page 69: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/69.jpg)
A. Frank69
File name/path search & save
![Page 70: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/70.jpg)
A. Frank70
Applian’s A/V Streaming Capture Suite
• Replay A/V & Media Catcher are the simplest and most powerful ways to capture Video and Audio from the Web on your PC.
• Capture Windows Media, Real, Streaming MP3, Streaming Flash Animations and Video.
![Page 71: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/71.jpg)
A. Frank71
References
• Kate Greene, Better, More Accurate Image Search, Technology Review, April 9, 2007, http://www.technologyreview.com/Infotech/18501/
• Kate Greene, Surfing TV on the Internet, Technology Review, April 18, 2007, http://www.technologyreview.com/Infotech/18545/
• Amit Agarwal, 10 Interesting Things You Can Do with YouTube or Google Videos, Digital Inspiration (Blog), July 27, 2006, http://labnol.blogspot.com/2006/07/10-interesting-things-you-can-do-with.html
![Page 72: Multimedia/Video Search](https://reader035.vdocuments.site/reader035/viewer/2022062422/56813e33550346895da81829/html5/thumbnails/72.jpg)
A. Frank72
Still Up(loaded))?-: