on ai, markets and machine learningon ai, markets and machine learning david c. parkes paulson...

1
On AI, Markets and Machine Learning David C. Parkes Paulson School of Engineering and Applied Sciences Harvard University 33 Oxford St. Cambridge, MA 02138 USA [email protected] ABSTRACT What is fun about artificial intelligence (AI) is that it is fun- damentally constructive! Rather than theorizing about the behavior of an existing, say social system, or understand- ing the way in which decisions are currently being made, one gets to ask a profound question: how should a system for making intelligent decisions be designed? In multi-agent systems we’re often interested, in particular, in what hap- pens when multiple participants, each with autonomy, self- interest and potentially misaligned incentives come together. These systems involve people (frequently people and firms), as well as the use of AI to automate some parts of decision making. How should such a system be designed? In adopting this normative viewpoint, we follow a suc- cessful branch of economic theory that includes mechanism design, social choice and matching. But in pursuit of suc- cess, we must grapple with problems that are more complex than has been typical in economic theory, and solve these problems at scale. We want to attack difficult problems by using the methods of AI together with the methods of economic theory. In this talk, I will highlight the follow- ing themes from my own research, themes that emerge as one lifts nice ideas from economic theory and brings them to bear on the kinds of problems that are at the heart of modern AI research: 1. Preferences need to be elicited, and cannot be assumed to be known or easily represented. 2. Mechanisms don’t need to be centralized. Rather, we can use (incentive aligned) distributed optimization! 3. Many interesting problems are temporal and involve uncertainty, leading to rich challenges that have been largely untouched by economic theory. 4. Markets become algorithms, and market-based opti- mization is a powerful and increasingly real paradigm. 5. Scale becomes an opportunity, as large systems beget data, this data enabling new approaches to robust in- centive alignment. 6. Computation becomes a tool— machine learning has taken automated mechanism design up to the frontier of knowledge from 35 years of auction theory. Appears in: Proc. of the 16th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2017), S. Das, E. Durfee, K. Larson, M. Winikoff (eds.), May 8–12, 2017, S˜ao Paulo, Brazil. Copyright c 2017, International Foundation for Autonomous Agents and Multiagent Systems (www.ifaamas.org). All rights reserved. The future will bring a tighter and ever more compelling integration of AI with markets. The human and societal interface will remain, and become ever more important as there is more that can be automated. The anticipated “agent- mediated economy”is almost upon us, and holds much promise as long as we make sure that AIs represent our preferences and system designs capture our values as society. CCS Concepts Information systems Electronic commerce; Theory of computation Algorithmic mechanism design; Com- putational pricing and auctions; Computing method- ologies Multi-agent systems; Supervised learning; Keywords Mechanism design; multi-agent systems; market-design; ra- tionality; learning; auctions. Short Bio David C. Parkes is George F. Colony Professor of Com- puter Science, Harvard College Professor, and Area Dean for Computer Science at Harvard University, where he founded the EconCS research group and leads research with a focus on market design, artificial in- telligence, and machine learn- ing. He is co-director of the Harvard University Data Sci- ence Initiative. Parkes served on the inaugural panel of the Stanford 100 Year Study on Artificial Intelligence, and co- organized the 2016 OSTP Workshop on AI for Social Good. He served as chair of the ACM Special Interest Group on Electronic Commerce (2011-16), and was Treasurer of IFAA- MAS (2008-13). Parkes is Fellow of the Association for the Advancement of Artificial Intelligence (AAAI), and recipi- ent of the 2017 ACM/SIGAI Autonomous Agents Research Award, the NSF Career Award, the Alfred P. Sloan Fellow- ship, the Thouron Scholarship, and the Roslyn Abramson Award for Teaching. Parkes has degrees from the Univer- sity of Oxford and the University of Pennsylvania, serves on several international scientific advisory boards, and has been a technical advisor to a number of start-ups. 2

Upload: others

Post on 27-Apr-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: On AI, Markets and Machine LearningOn AI, Markets and Machine Learning David C. Parkes Paulson School of Engineering and Applied Sciences Harvard University 33 Oxford St. Cambridge,

On AI, Markets and Machine Learning

David C. ParkesPaulson School of Engineering and Applied Sciences

Harvard University33 Oxford St.

Cambridge, MA 02138 [email protected]

ABSTRACTWhat is fun about artificial intelligence (AI) is that it is fun-damentally constructive! Rather than theorizing about thebehavior of an existing, say social system, or understand-ing the way in which decisions are currently being made,one gets to ask a profound question: how should a systemfor making intelligent decisions be designed? In multi-agentsystems we’re often interested, in particular, in what hap-pens when multiple participants, each with autonomy, self-interest and potentially misaligned incentives come together.These systems involve people (frequently people and firms),as well as the use of AI to automate some parts of decisionmaking. How should such a system be designed?

In adopting this normative viewpoint, we follow a suc-cessful branch of economic theory that includes mechanismdesign, social choice and matching. But in pursuit of suc-cess, we must grapple with problems that are more complexthan has been typical in economic theory, and solve theseproblems at scale. We want to attack difficult problemsby using the methods of AI together with the methods ofeconomic theory. In this talk, I will highlight the follow-ing themes from my own research, themes that emerge asone lifts nice ideas from economic theory and brings themto bear on the kinds of problems that are at the heart ofmodern AI research:

1. Preferences need to be elicited, and cannot be assumedto be known or easily represented.

2. Mechanisms don’t need to be centralized. Rather, wecan use (incentive aligned) distributed optimization!

3. Many interesting problems are temporal and involveuncertainty, leading to rich challenges that have beenlargely untouched by economic theory.

4. Markets become algorithms, and market-based opti-mization is a powerful and increasingly real paradigm.

5. Scale becomes an opportunity, as large systems begetdata, this data enabling new approaches to robust in-centive alignment.

6. Computation becomes a tool— machine learning hastaken automated mechanism design up to the frontierof knowledge from 35 years of auction theory.

Appears in: Proc. of the 16th International Conference on

Autonomous Agents and Multiagent Systems (AAMAS 2017),

S. Das, E. Durfee, K. Larson, M. Winikoff (eds.),

May 8–12, 2017, Sao Paulo, Brazil.Copyright c© 2017, International Foundation for Autonomous Agentsand Multiagent Systems (www.ifaamas.org). All rights reserved.

The future will bring a tighter and ever more compellingintegration of AI with markets. The human and societalinterface will remain, and become ever more important asthere is more that can be automated. The anticipated“agent-mediated economy”is almost upon us, and holds much promiseas long as we make sure that AIs represent our preferencesand system designs capture our values as society.

CCS Concepts•Information systems→ Electronic commerce; •Theoryof computation → Algorithmic mechanism design; Com-putational pricing and auctions; •Computing method-ologies → Multi-agent systems; Supervised learning;

KeywordsMechanism design; multi-agent systems; market-design; ra-tionality; learning; auctions.

Short BioDavid C. Parkes is GeorgeF. Colony Professor of Com-puter Science, Harvard CollegeProfessor, and Area Dean forComputer Science at HarvardUniversity, where he foundedthe EconCS research groupand leads research with a focuson market design, artificial in-telligence, and machine learn-ing. He is co-director of theHarvard University Data Sci-ence Initiative. Parkes servedon the inaugural panel of theStanford 100 Year Study onArtificial Intelligence, and co-organized the 2016 OSTP Workshop on AI for Social Good.He served as chair of the ACM Special Interest Group onElectronic Commerce (2011-16), and was Treasurer of IFAA-MAS (2008-13). Parkes is Fellow of the Association for theAdvancement of Artificial Intelligence (AAAI), and recipi-ent of the 2017 ACM/SIGAI Autonomous Agents ResearchAward, the NSF Career Award, the Alfred P. Sloan Fellow-ship, the Thouron Scholarship, and the Roslyn AbramsonAward for Teaching. Parkes has degrees from the Univer-sity of Oxford and the University of Pennsylvania, serveson several international scientific advisory boards, and hasbeen a technical advisor to a number of start-ups.

2