co-advised thesis in etsetb mobility program slides online ... · deep learning for visual search...
TRANSCRIPT
Co-advised thesis in ETSETB mobility program
December 2015
Xavier Giró i Nieto
Slides online@DocXavi
Slides available right now
“xavier giro upc”
https://imatge.upc.edu/web/people/xavier-giro
https://www.facebook.com/ProfessorXavi
https://twitter.com/DocXavi
Research-oriented topics
Classic thesis
Classic thesis + mobility
?
Co-advised thesis + mobility
Co-advised thesis so far
Dublin, IrelandEva Mohedano, Kevin McGuinness, Noel O’Connor, Alan F. Smeaton
AdvisorsEva Mohedano and Noel O’Connor (Dublin City University)
Eva Mohedano Prof Noel O’Connor
Dublin City University
Insight Centre for Data Analytics
Previous experiencesEva Mohedano and Noel O’Connor (Dublin City University)
● Sergi Porta BSc thesis @ ETSETB 2015. Grade: 9/10● Conference paper at ICMR 2015 (Shanghai)
Deep learning for visual searchEva Mohedano and Noel O’Connor (Dublin City University)
When: Fall 2016, Spring 2017Target: AV, CITTEL, MET & MasterCVContact: [email protected]
● Description○ Big visual data.○ Deep learning.
● Goals○ Find objects in very large datasets.
● Candidate Requirements○ Good English○ Programming skills (Python is a plus).
AdvisorCathal Gurrin (Dublin City University)
Dublin City University
Insight Centre for Data AnalyticsProf Cathal Gurrin
Previous experiencesCathal Gurrin(Dublin City University)
● Sergi Imedio BSc thesis, DCU 2014
LifeloggingCathal Gurrin(Dublin City University)
When: Fall 2016, Sping 2017Target: AV, CITTEL, MET & MasterCVContact: [email protected]
● Description○ Wearable cameras.○ User interfaces.
● Goals○ Healthcare applications of wearable devices.○ Extend EyeAware platform.
● Candidate Requirements○ Good English○ Programming skills (Python is a plus).
AdvisorsAlan F. Smeaton & Gerard Moore (Dublin City University)
Prof Alan F Smeaton Dr Gerard Moore
Dublin City University
Insight Centre for Data Analytics
Wearhables: Wearable devices for addiction rehabAlan F. Smeaton & Gerard Moore (Dublin City University), Xavier Giró (UPC)
When: Fall 2016, Spring 2017Target: AV, CITTEL, MET & MasterCVContact: [email protected]
● Description○ Wearable cameras.○ Cognitive-Behavioural Therapy.
● Goals○ Reduce relapse in drug addiction.
● Candidate Requirements○ Good English○ Programming skills (Python is a plus).
Toulouse, FranceVincent Charvillat & Axel Carlier (ENSEEIHT), Xavier Giró (UPC)
Toulouse, FranceVincent Charvillat & Axel Carlier (ENSEEIHT), Xavier Giró (UPC)
Vincent CharvillatAxel Carlier
ENSEEIHT
Previous experiencesVincent Charvillat & Axel Carlier (ENSEEIHT), Xavier Giró (UPC)
● Amaia Salvador BSc thesis, ENSEEIHT, 2013. Final grade: 10/10● CrowdMM 2013 (workshop)● CrowdMM 2014 (workshop) ● Ferran Cabezas BSc thesis. ETSETB, 2015. Final grade: 9.6/10● ICIP 2015 (conference)● MTAP 2015 (Journal)
Smart visual interactionVincent Charvillat & Axel Carlier (ENSEEIHT), Xavier Giró (UPC)
When: Spring 16 (no grant), Fall 15 or Spring 16Target: AV, CITTEL, MET & MasterCVContact: [email protected]
● Description○ Multimedia retrieval○ Quality of Experience.
● Goals○ To be decided.
● Candidate Requirements○ Matlab & English
Smart citiesVincent Charvillat & Axel Carlier (ENSEEIHT)
When: Spring 16 (no grant), Fall 15 or Spring 16Target: AV, CITTEL, MET & MasterCVContact: [email protected]
● Description○ 3D models of streets○ Interactive house reconstruction
● Goals○ To be decided.
● Candidate Requirements○ Matlab & English
Boca Raton, Florida, USAOge Marques (Florida Atlantic University, USA), Xavier Giró (UPC)
AdvisorOge Marques (FAU), Xavier Giró (UPC)
Dr Oge MarquesFlorida Atlantic University
Previous experiencesOge Marques (Florida Atlantic University), Xavier Giró (UPC)
● Amaia Salvador BSc thesis, ENSEEIHT, 2013. Final grade: A+, 10/10● CrowdMM 2013 (workshop)● CrowdMM 2014 (workshop)● MTAP 2015 (Journal)
Human-in-the-loop solutions to computer vision problemsOge Marques (FAU), Xavier Giró (UPC)
When: Spring 17Target: AV, CITTEL, MET & MasterCVContact: [email protected]
● Description○ Work on a specific computer vision problem whose solution combines semi-
supervised machine learning techniques and user interaction through a game or a specialized friendly interface
● Goals○ Design, implement and test a prototype for the proposed solution
● Candidate Requirements○ Strong programming skills (Python, MATLAB, and/or Java)○ English
HUMAN
COMPUTER
Kaiserlautern, Germany
Kaiserlautern, GermanyDamian Borth (German Research Center for Artifical Intelligence-DFKI), Xavier Giró (UPC)
Damian Borth DKFI
Non-profitLargest Europen center on artifical intelligenceGoogle owns a part of it (Techncrunch 2015).
Multimedia Opinion MiningXavier Giró (UPC)
When: Spring 17Target: AV, CITTEL, MET & MasterCVContact: [email protected]
● Description○ Multimedia Opinion Mining○ Concept detection.○ Trending topic detection.○ Open data.
● Candidate Requirements○ English
Boston, Massachussets, USADenisz Erdogmusz and Dana Brooks (Norteastern University), Xavier Giró (UPC)
AdvisorsDenisz Erdogmusz and Dana Brooks (Norteastern University)
Denisz Erdogmus Dana Brooks Northeastern University
Biomedical Signal Processing and Brain-ComputerDenisz Erdogmusz and Dana Brooks (Norteastern University)
When: Spring 17Target: AV, CITTEL, MET & MasterCVContact: [email protected]
● Description○ Biomedical Signal Processing○ Brain Computer Interfaces
● Goals○ (To be decided)
● Candidate Requirements○ English
Alpen Adria Universität, AustriaMathias Lux (Alpen Adria University), Xavier Giró (UPC)
Advisor
Alpen Adria UniversityMathias Lux
Previous experiencesMathias Lux (Klagenfurt, Austria), Xavier Giró (UPC)
Retrieval of endoscopy video shots based on visual queries.
Visual search engines
● Pia Muñoz BSc thesis 2014● Jennifer Roldan BSc thesis (ETSETB 2015, Grade: 9.5/10)● Gabriel de Oliveria BSc thesis (ETSETB 2015, Grade: 9/10)● A conference and a demo paper at CBMI 2015
Visual Information RetrievalMathias Lux (Klagenfurt, Austria), Xavier Giró (UPC)
When: Spring 15 (no grant), Fall 15 or Spring 16Target: AV, CITTEL, MET & MasterCVContact: [email protected]
● Description○ Work on a domain specific problem in visual
information retrieval, ie. how to search for visual trademarks, medical photos, game recordings, etc.
● Goals○ Build, extend and test a visual retrieval
system for a specific domain (on top of existing libraries)
● Candidate Requirements○ Java & English
Sankt Polten (Austria)
Sankt Polten (Austria)Matthias Zeppelzauer (FH Sankt Pölten, Austria), Xavier Giró (UPC)
Matthias Zeppelzauer FH St Pölten
Previous experiencesMatthias Zeppelzauer (Sankt Pölten, Austria), Xavier Giró (UPC)
● Andrea Calafell BSc thesis (ETSETB 2015). Grade: 10/10● 2nd Award in the CVPRW ChaLearn on Cultural Event Recognition 2015● Workshop paper in MediaEval 2015.
Cultural Event RecognitionMatthias Zeppelzauer (Sankt Pölten, Austria), Xavier Giró (UPC)
When: Spring 15 (no grant), Fall 15 or Spring 16Target: AV, CITTEL, MET & MasterCVContact: [email protected]
● Description○ Computer vision.○ Multimedia processing.○ Machine Learning.
● Goals○ Local analysis of images in cultural events.○ Extend and publish the previous work by
Andrea Calafell.● Candidate Requirements
○ English. Python is a plus.
Nice (France)Benoit Huet (EURECOM Sophia-Antipolis, France), Xavier Giró (UPC)
Video HyperlinkingBenoit Huet (EURECOM Sophia-Antipolis, France), Xavier Giró (UPC)
When: Spring 15 (no grant), Fall 15 or Spring 16Target: MET & MasterCVContact: [email protected]
● Description○ Suggest related videos after a search.○ Multimedia analysis.
● Goals○ Submission to MediaEval 2015
● Candidate Requirements○ English
Tokyo, JapanShin’ichi Satoh (NII), Xavier Giró (UPC)
Advisor
Shin’ichi Satoh National Institute of Informatics (NII)
Previous experiencesShin’ichi Satoh (NII), Xavier Giró (UPC)
● Ana Garcia BSc thesis. (ETSETB 2013)● Amaia Salvador internship (TSC Phd program, 2015).● TRECVID workshop 2015.
Visual instance searchShin’ichi Satoh (NII), Xavier Giró (UPC)
When: Spring 17, Fall 17 (subject to NII Internship)Target: AV, CITTEL, MET & MasterCVContact: [email protected]
● Description○ Find an object in a very large dataset.○ Efficient search.
● Goals○ Participate in TRECVID Instance Search
● Candidate Requirements○ English, Programming skills
...
Find your own internshipXavier Giró (UPC)
When: Spring 16, Fall 16 or Spring 17Target: AV, CITTEL & METContact: [email protected]
● Many big companies are receiving now applications for Summer internships.
● May be used as a BSc/MS thesis.● Ideas:
○ Microsoft○ Google○ IBM (choose student/internship)○ Yahoo!○ Philips○ Technicolor○ Sony○ Facebook○ Apple○ internships.com (...)
Final words
● Presented requirements (dates, programming skills, degrees…) are orientative.
● You have time to improve the required skills before your departure.
● Contact professor and/or apply if you feel motivated by the topic.
Final words
● If you want to focus on image processing and computer vision...
http://pagines.uab.cat/mcv/
Final words
● If you are considering master & Phd, maximize grant chances by...○ ...high grades.○ ...scientific publications (conferences, journals)
Thank you !
Slides available on and .
https://imatge.upc.edu/web/people/xavier-giro
http://bitsearch.blogspot.com
https://twitter.com/DocXavi
https://www.facebook.com/ProfessorXavi