Upload File

final report jarvis - open food data program · rendle [4] [5] introduces the factorization...

  • Home
  • Documents
  • Final Report Jarvis - Open Food Data Program · Rendle [4] [5] introduces the factorization machines, an approach combining the power of factorization models with the generality of
3
1 Final Report by Jarvis The following report was completed by the project team members in the end of October 2017 as a final report for the first incubation phase. This does not mean that the incubation nor the project are at a final stage. What was your Vision? Chatbots are a new way to interact with companies, products and services. The product is the same, but the interface between the product and the user is different. Access to information has changed in the recent years thanks to the huge advances in predictive algorithms. The relevant information is displayed to the user even before he requests it. Everything is based on the tastes and preferences of the user. Our project is the create a personalized recommender system for cooking recipes available through a friendly conversational interface. What goals did you set for the incubation time frame? – Build a recommender system based on a dataset of recipes and user interactions – Build a chatbot interface that will guide the user through the recommendation process What open data did you use or generate? – we use the Swiss Food Composition Database: http://www.naehrwertdaten.ch – we’ll generate data about people’s food consumption What did you accomplish? – Scrap all the recipes from the allrecipes website (45k recipes, ~4.5M interactions with ~1M users) – Build a chatbot prototype of Jarvis with Dialogflow (our first ideas, but the final goal changed since then) – Gather information about chatbot design and recommender systems How did Open Data support you? – With financing – A meeting with Hannes Gassert (29.07.2017): brainstorming, strategies, ideation – A meeting with Thomas Rippel (10.08.2017): brainstorming, knowledge sharing Feedback for OpenData – The strategic meeting with Hannes was really interesting and helpful in the way that he knows what he says and has a lot of experience in the domain.

Upload: others

Post on 30-May-2020

5 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Final Report Jarvis - Open Food Data Program · Rendle [4] [5] introduces the factorization machines, an approach combining the power of factorization models with the generality of

1

FinalReportbyJarvisThefollowingreportwascompletedbytheprojectteammembersintheendofOctober2017asafinalreportforthefirstincubationphase.Thisdoesnotmeanthattheincubationnortheprojectareatafinalstage.WhatwasyourVision?Chatbotsareanewwaytointeractwithcompanies,productsandservices.Theproductisthesame,buttheinterfacebetweentheproductandtheuserisdifferent.Accesstoinformationhaschangedintherecentyearsthankstothehugeadvancesinpredictivealgorithms.Therelevantinformationisdisplayedtotheuserevenbeforeherequestsit.Everythingisbasedonthetastesandpreferencesoftheuser.Ourprojectisthecreateapersonalizedrecommendersystemforcookingrecipesavailablethroughafriendlyconversationalinterface.Whatgoalsdidyousetfortheincubationtimeframe?

– Buildarecommendersystembasedonadatasetofrecipesanduserinteractions– Buildachatbotinterfacethatwillguidetheuserthroughtherecommendation

processWhatopendatadidyouuseorgenerate?

– weusetheSwissFoodCompositionDatabase:http://www.naehrwertdaten.ch– we’llgeneratedataaboutpeople’sfoodconsumption

Whatdidyouaccomplish?

– Scrapalltherecipesfromtheallrecipeswebsite(45krecipes,~4.5Minteractionswith~1Musers)

– BuildachatbotprototypeofJarviswithDialogflow(ourfirstideas,butthefinalgoalchangedsincethen)

– GatherinformationaboutchatbotdesignandrecommendersystemsHowdidOpenDatasupportyou?

– Withfinancing– AmeetingwithHannesGassert(29.07.2017):brainstorming,strategies,ideation– AmeetingwithThomasRippel(10.08.2017):brainstorming,knowledgesharing

FeedbackforOpenData

– ThestrategicmeetingwithHanneswasreallyinterestingandhelpfulinthewaythatheknowswhathesaysandhasalotofexperienceinthedomain.

Page 2: Final Report Jarvis - Open Food Data Program · Rendle [4] [5] introduces the factorization machines, an approach combining the power of factorization models with the generality of

2

– Thewayyouadapttoeachteamisreallygood(eg.wedonotneedofficessothemoneyisusedforsomethingmoreusefulforthesuccessoftheproject,andsoon)

Whatarethenextsteps?

– Design,developmentandvalidationofthereciperecommendersystemmodelusingcollecteddata.~15hours*person/weekforthenext10weeks,withtheassistanceofLSIRlabatEPFL.Thecollecteddatacontainsbothimplicit(madeit/reviews)andexplicitfeedback(ratings)fromusertorecipes.

TherecommendermodelwillbebasedonBayesianPersonalizedRanking,usingimplicitfeedback,whichisexpectedtooutperformstandardlearningtechniques[1].ThecurrentdevelopmentseemstoleadtoaMatrix-factorization[2]basedmodel.

Amodelusingtheexplicitrankingsdatamightbedevelopedinparallelinordertoevaluateandcomparetheirrespectiveperformancesandvalidatethechoiceofusingimplicitdata.Otherwaysofevaluationthemodelwillbeexplored[3].

Rendle[4][5]introducesthefactorizationmachines,anapproachcombiningthepoweroffactorizationmodelswiththegeneralityofstandardfeaturesengineering.Sincethecollecteddatacontainslotsoffeaturesforrecipesitwouldbeinterestingtoimplementitinourmodelandcomparetheresults.

LatestresearchesonNeuralNetworkssuggestthattheuseofanunderlying(deep)neuralnetworksoutperformsstandardfactorizationmethodsforrecommendersystem[6].Onthelong-termitmightbeinterestingtotrysomethingandseeifitisactuallyofanyhelptoenhancetheperformanceofourmodel,butatsuchanearlystagebeginningwithafactorizationbasedmodelisbest.

– Integrateconstraintintherecommendersystem,allowingforexampleto

proposeasetofrecipesthatcomplywithspecificnutritiongoals.(Vegan,Low-meat,WHO’snutritionalguidelines)

– Adapttherecommendersystemtolegallyavailabledata(TBD).– Creationofthepersonalityofthechatbot– Designoftheconversationalflow– Integrationoftherecommenderinthechatbot.Sincewewillhaveno

informationabouttheusersandrecipesatthebeginning,wewillneedtoimplementasmartcold-startrecommendationsstrategy.[7]proposessuchastrategythatbasicallyconsistinmappingusersoritemsfeaturestothelatentfactorsofourmodel.Weneedtodesignasmartstrategytoaskusersfortheirpreference,forexamplebyproposingthemrecipes/ingredientsandletthemswipeleft/rightaccordingtotheirpreferencesanduseittobuildaprofile.Withasufficientamountofuserwecouldthenusetheprofiletomapthemtothelatentfactorsofourmodelandbeabletorecommendrecipestoanewuser.

– FindanewnameandbrandimagefortheJarvisproject– Regardingopendata,we’llbereleasingaggregatedandanonymizeddata

generatedbyourplatformcontainingusersinteractions,behavioursandevolutions.Thisdatawillbefreelyavailableonline,andwouldprovideaninterestingdatasetforscientisttryingtofindpatternsinpeople’sfoodconsumption.

Page 3: Final Report Jarvis - Open Food Data Program · Rendle [4] [5] introduces the factorization machines, an approach combining the power of factorization models with the generality of

3

– Expectedtimeframe:January2018:– endoftherecommendersystemprototype– endofthebasicchatbotFebruary2018:– adaptingtherecommendersystemtonewrecipes(legallyavailable)– integratingtherecommendersystemtothechatbotMarch2018:– firsttestofthebotwithrealusers– creationofbranding&launchstrategy)

TeamMembers&Contact

– JackyCasas,[email protected],@jackycasas_– NathanQuinteiro,[email protected],@nathan_quint

OpenDataContactNikkiBöhler,ProjectLeaderOpenData.ch,[email protected]:[1]:Rendle,Freudenthaler,GantnerandSchmidt-Thieme-BPR:BayesianPersonalizedRankingfromImplicitFeedbackhttps://arxiv.org/pdf/1205.2618.pdf[2]:SrebroandJaakkola-WeightedLow-RankApproximationshttps://www.aaai.org/Papers/ICML/2003/ICML03-094.pdf[3]:ShaniandGunawardana-EvaluatingRecommendationSystemshttp://www.bgu.ac.il/~shanigu/Publications/EvaluationMetrics.17.pdf[4]:Rendle-FactorizationMachineshttps://pdfs.semanticscholar.org/2ef7/d506b25731d0f3ec0c8f90b718b6e5bbd069.pdf[5]:Rendle-FactorizationMachineswithlibFMhttp://www.csie.ntu.edu.tw/~b97053/paper/Factorization%20Machines%20with%20libFM.pdf[6]:Xiangnan,Lizi,Hanwang,Liqiang,XiaandTat-Seng-NeuralCollaborativeFilteringhttp://papers.www2017.com.au.s3-website-ap-southeast-2.amazonaws.com/proceedings/p173.pdf[7]:Gantner,Drumond,Freudenthaler,RendleandSchmidt-Thiem-LearningAttribute-to-FeatureMappingsforCold-StartRecommendationshttps://www.semanticscholar.org/paper/Learning-Attribute-to-Feature-Mappings-for-Cold-St-Gantner-Drumond/1535d5db7078c85f0e2d565860a0fb4053a6090c


ANALYTICS WITHOUT LOSS OF GENERALITY

Notes on factorization algebras, factorization homology ... · Notes on factorization algebras, factorization homology and applications ... to factorization algebras, factorization

Generality of Learned Helplessness in Man

7 Branch&Pennypacker Generalization and Generality

RMIT University Francesca Rendle-Short Parsing the aside ... · PDF fileFrancesca Rendle-Short Parsing the aside TEXT Special Issue 30: Creative Writing as Research IV, October 2015

Journey to Personalisation“Factorization Machines,” S. Rendle (2010) C++ library libfm with BPR extension by Fabio Petroni Factorisation Machine with Bayesian Probability Ranking

Pasto Humidicola Brachiaria Humidicola Rendle Schweickt

Royal College of Art, London Hepzhibah Rendle-Short What

Factorize Factorization · 2 Factorize Factorization is however a more sophisticated property (sketched below) of which factorization is a basic instance. The content of factorization

Alison Rendle – professional executive coach · 2018-03-20 · Title: Microsoft Word - Alison Rendle – professional executive coach.docx Created Date: 3/18/2018 6:11:15 PM

Matrix Factorization and Factorization Machines for ...cjlin/talks/recsys.pdfMatrix Factorization and Factorization Machines for Recommender Systems Chih-Jen Lin Department of Computer

composite number into factors Using Prime Factorization to ... · 1 Using Prime Factorization to Find GCF & LCM Prime Factorization the factorization of a composite number into _____

Variables, Generality and Existence

Neural Collaborative Filtering vs. Matrix Factorization ... · Matrix Factorization Revisited Ste en Rendle Walid Krichene Li Zhang John Anderson Abstract Embedding based models have

AMBIGUITY, GENERALITY, AND

Temporal Factorization Vs. Spatial Factorization

Algebraic generality vs arithmetic generality in the

© ü b Factorization Machine - GitHub Pages · 2019-01-19 · • Rendle S. Factorization Machines[C]. international conference on data mining, 2010. • Blondel M, Fujino A, Ueda

RMIT University Francesca Rendle-Short Essay (queer). … · RMIT University . Francesca Rendle-Short . Essay (queer). The. Essay. ... our hands, something is lost, ... most worthwhile

x y Fxy Multiple Generality - WordPress.com

composite number into factors Using Prime Factorization … · 1 Using Prime Factorization to Find GCF & LCM Prime Factorization the factorization of a composite number into _____

Steffen Rendle, Research Scientist, Google at MLconf SF

Matrix Factorization and Factorization Machines for ...cjlin/talks/sdm2015.pdfMatrix Factorization and Factorization Machines for Recommender Systems Chih-Jen Lin Department of Computer

Ludwig Rendle (Hrsg.) Ganzheitliche Methoden im ... · Ludwig Rendle (Hrsg.) Ganzheitliche Methoden im Religionsunterricht ... nem Selbstverständnis her das Ganze des Lebens zur

In-Database Learning with Sparse Tensors · Rendle introduced factorization machines on relational data [28], a practically useful model that factorizes the parameter space to better

ALGOL-60 GENERALITY AND HIERARCHY

Nonnegative Matrix Factorization - Complexity, Algorithms ... · Nonnegative Matrix Factorization, Neural Computation 2012. Householder XIX Nonnegative Matrix Factorization: Complexity,

Factorization Machines with libFMb97053/paper/Factorization...Factorization Machines with libFM 57:3 Fig. 1. Example (from Rendle [2010]) for representing a recommender problem with

Delft University of Technology Advanced Factorization ... › portal › files › 47715379 › Advanced_Factorizat… · factorization models known as Factorization Machines (FMs)

Chapter 1-generality

LEVELS OF GENERALITY, CONSTITUTIONAL COMEDY, AND …

Generality of Languages

·0 - Martin Rendle Vieni Alla Finestra (Don...don giovji.nni. r,_~~·*~ p., ·0....

generality about dyeing process

Generality of metrology