Rahul JainAssociate Professor & 3740 McClintock Ave,Kenneth C. Dahlberg Early Career Chair Los Angeles, CA 90089EE, CS* & ISE* Departments (510) 520-1140 (cell)Viterbi School of Engineering rahul.jain@usc.eduUniversity of Southern California http://www-bcf.usc.edu/~rahuljai

ResearchInterests

Stochastic Control, Reinforcement Learning, Queueing Models, Game TheoryApplications: Energy, Cyber-Physical Systems, Healthcare, Networks

CurrentResearch

Learning/Control: Markov decision processes, Multi-armed bandits, Statistical learning theoryRisk-aware stochastic optimization

Stochastic Models: Non-classical queueing models, Healthcare decision analytics and schedulingGame Theory: Energy/Electricity markets, Network market design, Spectrum markets

Education University of California, Berkeley

Ph.D., Electrical Engineering and Computer Science (Advisor: Pravin Varaiya), December 2004M.A., Statistics, May 2002

Rice University, Houston, TX

M.S., Electrical and Computer Engineering, May, 1999

Indian Institute of Technology, Kanpur, India

B.Tech., Electrical Engineering, May, 1993

Appointments K. C. Dahlberg Early Career Chair Univ. of Southern California Jan 2012 - presentAssociate Professor EE Department Univ. of Southern California Feb 2013 - present(*courtsey appt.) ISE* Department Univ. of Southern California Oct 2008 - present(*courtsey appt.) CS* Department Univ. of Southern California Jan 2015 - present

Assistant Professor EE Department Univ. of Southern California Aug 2008 - Feb 2013Post-Doctoral Staff Math Sciences IBM Watson Research Sep 2006 - Jul 2008Post-Doctoral Scholar EECS UC Berkeley Jan 2005 - Aug 2006Grad. Research Asst. EECS UC Berkeley Aug 1999 - Dec 2004

VisitingAppointments/Other

Visiting Scientist, Simons Institute of Computing, Berkeley, CA Jan-May 2018Visiting Faculty, CEE, School of Engineering, Stanford University Jan-June, 2015Visiting Faculty, EECS, College of Engineering, UC Berkeley Aug-Dec.,2014Visiting Faculty, School of Tech. & Computer Sci., TIFR Mumbai, India Feb ’09, May ’10Visiting Faculty, CSE Department, IIT Delhi, India March 2009

Honors andAwards

US Fulbright Specialist Fellow 2017-20ONR Young Investigator Award 2012IBM Faculty Award 2010NSF CAREER Award 2010James H. Zumberge Faculty Research and Innovation Award 2009Best Paper Award at The ValueTools Conference1, Pisa, Italy 2009IBM Invention Achievement Citation 2007TCS Best B.Tech Project Award, IIT Kanpur 1997

Dissertations Ph.D. Efficient Market Mechanisms and Simulation-based Learning for Multi-Agent Systems,University of California, Berkeley, December 2004.Dissertation Committee: Pravin P. Varaiya (Chair), Jean Walrand (EECS), & Jim Pitman(Mathematics & Statistics)

M.S. Admission Control for Wireless Networks, Rice University, May 1999.

Primary Interests Secondary Interests

SC = Controlled Stochastic Processes & Optimization NE = Network Economics & Market Design

SL = Statistical and Online Learning CS = Communication Systems & Games

QT = Queueing Theory & Models DC = Decentralized and Networked Control

PS = Power Systems & Smart-Grid Econ. WN = Wireless Networks

HA = Healthcare Decision Analytics TS = Transportation System Modeling

(Click on paper title to view paper)* indicates student or postdoc co-author at time of project work

Journal Papers(In Preparation)

P38. N. Dahlin*, A. Gupta, and R. Jain, “Scheduling and pricing non-preemptive flexible load”,journal version in preparation.

P37. A. Gupta*, R. Jain and P. Glynn, “ A fixed point theorem for iterative random contractionoperators over Banach spaces”, journal version in preparation.

S36. W. Tang* and R. Jain, “Pricing mechanisms for economic dispatch: A game-theoretic per-spective”, under revision for resubmission, 2018.

S35. H. Honnappa*, R. Jain and Amy Ward, “Conditioned functional limits and applications toqueues”, under revision for resubmission, 2018

S34. H. Honnappa*, R. Jain and Amy Ward, “On Transitory Queueing”, under revision for resub-mission, 2018

Journal Papers(Submitted/Under-Revision)

S33. Y. Ouyang*, M. Gagrani*, and R. Jain, “Learning-based Control of Unknown Linear Systemswith Thompson Sampling”, IEEE Trans. Automatic Control, submitted: August 2017.

R32. M. Jafarnia* and R. Jain, “Non-indexability of Stochastic Scheduling”, Operations Research,submitted: August 2017. Major Revision required: January 2018.

R31. W. Haskell, P. Yu, H. Sharma* and R. Jain, “An Empirical dynamic programming algorithmfor Continuous State Space MDPs”, IEEE Trans. Automatic Control, submitted: August2017. Major Revision required: November 2017.

R30. H. Honnappa* and R. Jain, “Transitory queueing networks”, Stochastic Systems, submitted:July 2017. Major Revision required: December 2017.

R29. D. Kalathil*, V. Borkar and R. Jain, “Empirical Q-Value Iteration”, Stochastic Systems,submitted: Sep. 2015. (first revision decision: May 2017)

Journal Papers(Accepted/Published)

J28. W. Tang* and R. Jain, “Aggregating Correlated Wind Power with Full Surplus Extraction”,IEEE Trans. on Smart-grid, accepted: May 2017.

J27. N. Nayyar*, D. Kalathil* and R. Jain, “On Regret-Optimal Learning in Decentralized Multi-player Multi-armed Bandits”, IEEE Trans. on Control of Network Systems, 5(1):597-606,2018.

J26. N. Nayyar*, D. Kalathil* and R. Jain, “Optimal decentralized control for asymmetric delayedinformation sharing”, IEEE Trans. Control of Networked Systems, 5(1):653-663, 2018.

J25. D. Kalathil*, V. Borkar and R. Jain, “Approachability in Stackelberg Stochastic Games withVector Costs”, Dynamic Games and Applications, 7(3):422-442, 2017.

J24. W. Tang* and R. Jain, “Dynamic economic dispatch game: The value of storage”, IEEETrans. on Smart-Grid 7(5):2350-2358, 2016.

J22. W. Haskell*, R. Jain and D. Kalathil*, “Empirical Dynamic Programming”, Math. of Oper-ations Research, 41(2):402-429, May 2016.

J23. W. Tang* and R. Jain, “Market mechanisms for buying random wind”, IEEE Trans. Sus-tainable Energy 6(4):1615-1623, 2015.

J21. W. Haskell* and R. Jain and, “A convex analytic approach to Risk-aware MDPs”, SIAM J.Control and Optimization, 53(3): 1569-1598, 2015.

J20. H. Honnappa*, R. Jain and Amy Ward, “A queueing model with independent arrivals, andits fluid and diffusion limits”, Queueing Systems, 80(1-2): 71-103, 2015.

J19. H. Honnappa* and R. Jain, “Strategic arrivals into queueing networks: The network concertqueueing game”, Operations Research, 63(1):247 - 259, 2015.

J18. R. Jain and V. Borkar, “Risk-constrained Markov decision processes”, IEEE Trans. onAutomatic Control, 59(9):2574-2579, 2014.

J17. D. Kalathil*, N. Nayyar* and R. Jain, “Decentralized learning for multi-player multi-armedbandits”, IEEE Trans. on Information Theory, 60(4):2331-2345, April 2014.

J16. P. Dube and R. Jain, “Bertrand equilibria and efficiency in markets for congestible networkresources”, Automatica, 50(3):756-767, 2014.

J15. S. Yerramalli*, R. Jain and U. Mitra, “Coalitional games for transmitter cooperation inMIMO Multiple Access Channels”, IEEE Trans. on Signal Processing, 62(4):757-771, 2014.

J14. W. Haskell* and R. Jain, “Stochastic dominance-constrained Markov decision processes”,SIAM J. Control and Optimization, 51(1):273-303, 2013.

J13. D. Kalathil* and R. Jain, “Spectrum sharing through contracts for cognitive radios”, IEEETrans. Mobile Computing, 12(10):1999-2011, October 2013.

J12. W. Tang* and R. Jain, “Hierarchical auctions for network resource allocation”, IEEE J.Selected Areas in Communications, 30(11):2117-2125, Nov. 2012.

J11. R. Jain, “Network Market Design I: Bandwidth markets”, (invited paper) IEEE Communi-cations Magazine, Communication networks economics special issue, 50(11):78-83, 2012.

J10. Y. Gai, B. Krishnamachari, and R. Jain, “Combinatorial network optimization with unknownvariables: Multi-armed bandits with linear rewards and individual observations”, IEEE/ACMTrans. on Networking, 20(5):1466-1478, 2012.

J9. R. Jain, S. Juneja and N. Shimkin, “The concert queueing game: To wait or to be late”,Discrete-Event Dynamic Systems, 21:103-138, 2011. (Best paper, The ValueTools Conf. 2009).

J8. R. Jain and P. Varaiya, “Simulation-based optimization of Markov decision processes: Anempirical process theory approach”, Automatica, 46(8):1297-1304, August 2010.

J7. R. Jain and J. Walrand, “An efficient Nash-implementation mechanism for network resourceallocation”, Automatica, 46(8):1276-1283, August 2010.

J6. C. Kaskiris, R. Jain, P. Varaiya and R. Rajagopal, “Combinatorial Auction Bandwidth Trad-ing: An Experimental Study”, in Developments in Experimental Economics, Lecture Notes inEconomics and Mathematical Systems, Springer, 2007.

J5. R. Jain and P.P. Varaiya, “Simulation-based uniform value function estimates of Markovdecision processes”, SIAM J. Control and Optimization, 45(5):1633-1656, November 2006.

J4. R. Jain and P.P. Varaiya, “Combinatorial exchange mechanisms for efficient bandwidth allo-cation”, Communications in Information and Systems, 3(4):305-324, September 2004.

J3. T. Simsek, R. Jain and P.P. Varaiya, “Scalar estimation and control with noisy binary obser-vations”, IEEE Trans. Automatic Control, 49(9):1598-1603, September 2004.

J2. R. Jain, A.Puri and R.Sengupta, “Geographical routing for wireless ad hoc networks usingpartial information”, IEEE Personal Communications, 8(1):48-57, February 2001.

J1. R. Jain, “Key distribution and authentication protocol for secure wireless conferencing”,IETE Technical Review, 15(6):471-476, December 1998.

ConferenceProceedings(Peer-Reviewed)

2017:

1. SL Y. Ouyang, M. Gagrani, A. Nayyar and R. Jain, “Learning Unknown Markov DecisionProcesses: A Thompson Sampling Approach”, Proc. Adv. Neural Information Proc. Symp.(NIPS), 2017.

2. SC William B. Haskell and R. Jain, ”A Random Monotone Operator Framework for StronglyConvex Stochastic Optimization”, Proc. IEEE Conf. on Decision and Control (CDC), 2017.

3. SC William B. Haskell, Pengqian Yu, Hiteshi Sharma, and R. Jain, ”Randomized FunctionFitting-based Empirical Value Iteration”, Proc. IEEE Conf. on Decision and Control (CDC),2017.

4. SC W. Haskell and R. Jain, “Inexact iteration of averaged operators for non-strongly convexstochastic optimization”, Proc. Allerton Conf., 2017.

5. SL Y. Ouyang, M. Gagrani, and R. Jain, “Control of Unknown Linear Systems with Thomp-son Sampling”, Proc. Allerton Conf., 2017.

2016:

6. TS Yi Ouyang, R. Jain and Pravin Varaiya, “On the existence of fixed time control of trafficintersection signals”, Proc. Allerton Conference, 2016. (Invited)

7. SC William Haskell, R. Jain and Hiteshi Sharma, “A Dynamical Systems Framework forStochastic Iterative Optimization”, Proc. IEEE Conf. on Decision and Control (CDC), 2016.(Invited)

2015:

8. PS Wenyuan Tang, Junjie Qin, R. Jain and Ram Rajagopal, “Pricing Sequential ForwardPower Contracts”, IEEE International Conference on Smart Grid Communications (Smart-GridComm), Nov. 2015.

9. PS Abhishek Gupta, R. Jain, Kameshwar Poolla and Pravin P. Varaiya, “Equilibria inTwo-Stage Electricity Markets”, Proc. IEEE Conf. on Decision and Control (CDC), Dec.2015.

10. SL Abhishek Gupta, R. Jain and Peter Glynn, “An Empirical Algorithm for Relative ValueIteration for Average-cost MDPs”, submitted to Proc. IEEE Conf. on Decision and Control(CDC), Dec. 2015.

11. PS A. Gupta, R. Jain and R. Rajagopal, “Scheduling, pricing and efficiency of non-preemptiveflexible loads under direct load control”, Proc. Allerton Conference, 2015.

2014:

12. QT H. Honnappa, R. Jain and Amy Ward, “Mean field limits By population acceleration”,

Proc. IEEE Conf. on Decision and Control (CDC), Dec. 2014.

13. PS W. Tang, R. Jain and R. Rajagopal, “Stochastic dynamic pricing: Utilizing demandresponse in an adaptive manner”, Proc. IEEE CDC, Dec. 2014.

14. SL W. Haskell, D. Kalathil and R. Jain, “Empirical policy iteration for approximate dynamicprogramming”, Proc. IEEE CDC, Dec. 2014.

15. SL D. Kalathil, V. Borkar and R. Jain, “Blackwell’s approachability in Stackelberg stochasticgames: A learning version”, Proc. IEEE CDC, Dec. 2014.

16. PS W. Tang and R. Jain, “Buying random yet correlated wind power”, Proc. IEEE Inter-national Conference on Smart Grid Communications (SmartGridComm), Nov. 2014.

17. PS W. Tang and R. Jain, “Dynamic economic dispatch among strategic generators withstorage systems”, Proc. Allerton Conference, Oct 2014.

18. SL W. Haskell, R. Jain and D. Kalathil, “Empirical value iteration for approximate dynamicprogramming”, Proc. American Control Conf., 2014.

19. DC N. Nayyar, D. Kalathil and R. Jain, “Optimal decentralized control in unidirectionalone-step delayed sharing pattern with partial output feedback”, Proc. American Control Conf.(ACC), 2014.

20. SL S. Kotova, Varun Sah, N. Nayyar and R. Jain, “Thoracic epidural analgesia does notrequire prolonged urinary catheterization, Academic Surgical Congress 2014, San Diego, Febru-ary 2014.

2013:

21. CS S. Yerramalli, R. Jain and U. Mitra, “Coalition formation for uplink device to devicecoordination with cooperation costs”, Proc. Asilomar Conference, 2013.

22. PS W. Tang and R. Jain, “Game-theoretic analysis of the nodal pricing mechanism forelectricity markets”, Proc. IEEE CDC 2013, March 2013.

23. DC N. Nayyar, D. Kalathil and R. Jain, “Optimal decentralized control for unidirectionalon-step delayed sharing pattern”, Proc. of The Allerton Conf., 2013.

2012:

24. SL D. Kalathil, N. Nayyar and R. Jain, “Decentralized learning for multi-player multi-armedbandits”, IEEE Conf. on Decision and Control (CDC), Dec 2012.

25. SC W. Haskell and R. Jain, “Dominance-constrained Markov decision processes”, IEEEConf. on Decision and Control (CDC), Dec 2012.

26. PS Q. Wang, M. Liu and R. Jain, “Dynamic pricing of power in smart-grid networks”, IEEEConf. on Decision and Controls (CDC), Dec 2012.

27. QT H. Honnappa, R. Jain and Amy Ward, “A new transitory queueing model, and its’

process limits”, The ValueTools Conference, Oct. 2012.

28. SL D. Kalathil, N. Nayyar and R. Jain, “Multi-player multi-armed bandits: Decentralizedlearning with IID rewards”, The Allerton Conference, Oct. 2012.

29. QT H. Honnappa, R. Jain and Amy Ward, “The ∆(i)/GI/1 model: A new model of tran-

sitory queueing”, The Allerton Conference, Oct. 2012.

30. CS S. Yerramalli, R. Jain and U. Mitra, “Characterization of equilibria for the degradedGaussian broadcast and sum power MAC channels””, The Allerton Conference, Oct. 2012.

31. CS S. Yerramalli, R. Jain and U. Mitra, “Stability of transmitter cooperation over a multipleaccess channel”, Proc. Intl. Conf. Sig. Proc. Comm. (SPCOM), August 2012. (Beststudent paper award)

32. CS S. Yerramalli, R. Jain and U. Mitra, “A game theoretic model for the Gaussian broadcastchannel”, Proc. International Symposium on Information Theory (ISIT), June 2012.

33. CS D. Kalathil and R. Jain, “Incentives for cooperative relaying in a simple information-theoretic model, Proc. International Symp. on Information Theory (ISIT), June 2012.

2011:

34. PS W. Tang and R. Jain, “Stochastic resource auctions for renewable energy integration”,Proc. of The Allerton Conference on Systems, Communications and Control, Sep. 2011.

35. NE W. Tang and R. Jain, “Hierarchical auctions for network resource allocation”, Proc. ofthe International Conf. on Game Theory in Networks (GameNets), April 2011.

36. CS S. Yerramalli, R. Jain and U. Mitra, “Coalition games for transmitter cooperation inwireless networks”, Proc. International Symp. on Information Theory (ISIT), July 2011.

2010:

37. CS D. Kalathil and R. Jain, “Communication games on the generalized Gaussian relaychannel”, Proc. of The Allerton Conf. on Systems, Communications and Control, Sep. 2010.

38. CS D. Kalathil and R. Jain, “A contracts-based approach to spectrum sharing in cognitiveradio networks”, Proc. IEEE WiOpt (Intl. Symp. on Modeling and Optimization in Mobile,Ad Hoc, and Wireless Networks) Conference, June 2010.

39. CS D. Kalathil and R. Jain, “Spectrum sharing through contracts”, Proc. of the IEEEDySpan Conference, April 2010.

40. SC V. Borkar and R. Jain, “Risk-constrained Markov decision processes”, Proc. IEEEControl and Decision Conf. (CDC), December 2010.

41. SL Yi Gai, B. Krishnamachari, and R. Jain, “Learning multi-user channel allocations incognitive radio networks: A combinatorial multi-armed bandit formulation”, Proc. of theIEEE DySpan Conference, April 2010.

42. QT H. Honnappa and R. Jain, “Strategic arrivals into queueing networks”, Proc. of The

Allerton Conference on Systems, Communications and Control, September 2010.

43. QT R. Jain, S. Juneja and N. Shimkin, “Queueing for timely service: Equilibrium analysis

and social efficiency”, INFORMS MSOM (Manufacturing and Service Operations Manage-ment) Conference, Sep. 2010.

44. QT P. Dube and R. Jain, “DiffServ pricing games in multiclass queueing network models”,

Proc. International Tele-traffic Conference (ITC), Sep. 2010.

2009:

45. QT P. Dube and R. Jain, “Bertrand games between multi-class queues”, Proc. of the IEEE

Control and Decision Conference (CDC), December 2009.

46. QT R. Jain and S. Juneja, “The concert/cafetaria queueing problem: A game of arrivals”,

Proc. of the International Conference on Performance Evaluation Methodologies and Tools(VALUETOOLS Conference), October 2009. (Best paper award)

47. QT R. Jain and P. Dube, “Queueing game models for differentiated services”, Proc. of the

Int. Conf. on Game Theory in Networks (GameNets), May 2009.

2008-07:

48. QT P. Dube and R. Jain, “N-player Bertrand and Cournot queueing games: Existence of

equilibrium”, Proc. of The Allerton Conference on Systems, Communications and Control,September 2008.

49. NE R. Jain and J. Walrand, “An efficient Nash-implementation mechanism for divisibleresource allocation”, Proc. IEEE NOMS Workshop on Bandwidth on Demand, April 2008.

50. NE R. Jain, “Designing a bipartite matching market”, Proc. of the IEEE Conf. on Decisionand Control (CDC), December 2007.

51. SL R. Jain and P. Varaiya, “PAC bounds for simulation-based optimization of Markovdecision processes”, Proc. of the IEEE Control and Decision Conf. (CDC), Dec. 2007.(invited SIAM paper)

2006-05:

52. NE A.Dimakis, R. Jain and J.Walrand, “Mechanisms for efficient allocation in divisiblecapacity networks”, Proc. of the IEEE Conf. Decision and Control (CDC), December 2006.

53. NE C. Kaskiris, Y. Butun and R. Jain, “An experimental analysis of a combinatorial marketmechanism for bandwidth trading”, Proc. of the Workshop on Bandwidth Trading, Nov. 2006.

54. NE R. Jain and P.P. Varaiya, “Efficient market mechanisms for network resource allocation”,Proc. of the IEEE Conf. Decision and Control (CDC), December 2005. (invited paper)

2004-1999:

55. NE R. Jain, C. Kaskiris, R. Rajagopal and P. Varaiya, “Combinatorial auction design forbandwidth trading: An experimental study”, International Conf. on Experiments in EconomicSciences (EES), December 2004.

56. NE R. Jain and P.P. Varaiya, “An efficient incentive-compatible combinatorial market mech-anism”, Proc. of the Allerton Conf. on Systems, Communications and Control, Oct. 2004.

57. SL R. Jain and P.P. Varaiya, “Simulation-based uniform value estimates of discounted andaverage reward MDPs”, Proc. IEEE Conf. Decision and Control (CDC), December 2004.

58. SL R. Jain and P.P. Varaiya, “PAC learning for Markov decision processes and dynamicgames”, Proc. IEEE Symp. on Information Theory (ISIT), June 2004.

59. SL R. Jain and P.P. Varaiya, “Extensions to PAC learning for partially observable Markovdecision processes”, Proc. Conf. Information Systems and Sciences (CISS), March 2004.

60. NE R. Jain, A. Dimakis and P.P. Varaiya, “On the existence of competitive equilibriain bandwidth markets”, Proc. of the Allerton Conference on Systems, Communications andControl, October 2002.

61. DC T. Simsek, R. Jain and P.P. Varaiya, “Control under communication constraints”, Proc.IEEE Conf. Decision and Control (CDC), December 2002.

62. WN M.Ergen, S.Coleri, B.Dundar, R. Jain, A.Puri, P.P.Varaiya, “Application of GPS tomobile IP and routing in wireless networks”, Proc. IEEE Vehicular Tech. Conf. (VTC), Sep.2002.

63. WN R. Jain, B. Sadeghi and E.W. Knightly, “Towards coarse-grained mobile-QoS”, Proc.IEEE WOWMOM (A Mobicom Workshop), August 1999.

64. WN R. Jain and E.W. Knightly, “A framework for design and evaluation of mobile admissioncontrol algorithms”, Proc. IEEE Int. Conf. on Computer Comm. (INFOCOM), March 1999.

65. SL R. Jain, G.Rajaram, S.Gupta, S.Subramanium, A.Rawat, A.Mukerjee, “A robot thatlearns to play soccer”, Proc. Intl. Symp. on Intelligent Robotic Systems, Ed. M. Vidyasagar,January 1998.

Peer-Reviewed, Non-Archived Conference and Workshop Papers

2017:

66. SC M. Jafarnia and R. Jain, “Non-indexability of the Stochastic Appointment SchedulingProblem”, INFORMS Applied Probability Society Meeting, July 2017.

67. SC W. Haskell and R. Jain, “A Random Monotone Operator Framework for StochasticOptimization”, INFORMS Applied Probability Society Meeting, July 2017.

68. SC William B. Haskell, R. Jain and H. Sharma, ”The Random Monotone Operator Approachto Stochastic Optimization”, ITA Workshop, 2017. (invited)

2016:

69. PS A. Gupta, R. Jain and R. Rajagopal, “Pricing and Scheduling Flexible Loads”, ITAWorkshop, San Diego, Feb. 2016. (invited)

2015:

70. SC W. Haskell, R. Jain and D. Kalathil,“Empirical Methods in Control and Optimization”,IMS Workshop on Stochastic Methods in Game Theory, National University of Singapore,Nov. 2015. (invited)

71. QT H. Honnappa, R. Jain, “Transitory queueing networks”, INFORMS Applied Probability

Soc. Meeting, Istanbul Turkey, July 2015.

72. SL N. Nayyar, D. Kalathil and R. Jain,“Learning to Match: decentralized Learning in Multi-player Multi-armed bandits”, INFORMS Applied Probability Soc. Meeting, Istanbul Turkey,July 2015. (invited)

73. SL N. Nayyar, H. Honnappa, R. Jain, “Statistical Analysis of Operating Room Schedulesin Elective Surgery Hospitals”, INFORMS POMS Annual Conference, 2015 (invited session)

74. SC W. Haskell, R. Jain and D. Kalathil, “Empirical dynamic programming: Further Re-sults”, ITA Workshop, San Diego, Feb. 2015. (invited)

2014:

75. PS W. Tang and R. Jain, “Equilibrium analysis of the LMP mechanism”, INFORMS AnnualMeeting, San Francisco, Nov. 2014. (invited)

76. SL W. Haskell, D. Kalathil and R. Jain, “Empirical dynamic programming”, Banff Work-shop on Optimal Cooperation, Communication, and Learning in Decentralized Systems, Banff,AB, Oct. 2014. (invited)

77. QT H. Honnappa, R. Jain and A. Ward, “Transitory queues”, IEEE MobiHoc Workshop:

Frontiers of Networks: Theory and Algorithms, Philadelphia, PA, Aug. 2014. (invited)

78. SL D. Kalathil, N. Nayyar and R. Jain, “Decentralized learning for Multi-player systems”,RSS Workshop: Humans and Sensing in Cyber-Physical Systems, Berkeley, CA, July 2014.(invited)

79. SC W. Haskell and R. Jain, “Risk-constrained decision making”, RSS Workshop: Con-strained decision-making in robotics: models, algorithms, and applications, Berkeley, CA, July2014. (invited)

80. SC W. Haskell, R. Jain and D. Kalathil, “Empirical dynamic programming”, ITA Workshop,San Diego, Feb. 2014. (invited)

2013:

81. SC W. Haskell and R. Jain, “Stochastic dominance-constrained Markov decision processes”,INFORMS Computing Soc. Conf. (Computational Stochastic Optimization stream), Santa Fe,NM, Jan 2013. (invited)

82. PS W. Tang and R. Jain, “Market and pricing mechanisms for Smart-grid networks”, ITAWorkshop, San Diego, CA, Feb. 2013. (invited)

83. SL D. Kalathil, N. Nayyar and R. Jain, “Decentralized learning for multi-player multi-armed bandits: An algorithm for near-logarithmic regret”, INFORMS Applied Probability Soc.Meeting, Costa Rica, July 2013. (invited)

84. QT H. Honnappa and R. Jain, “Timing and routing games in transitory generalized Jackson

networks”, INFORMS Applied Probability Soc. Meeting, Costa Rica, July 2013.

85. QT H. Honnappa and R. Jain and A. Ward, “On fluid and diffusion Approximations for

Finite Horizon Single-server Queueing Models”, INFORMS Annual Meeting, Minneapolis, MN,Oct. 2013. (invited)

86. SC W. Haskell, R. Jain, G. Shanthikumar and Z.M. Shen, “Ambiguity in risk preferences inoptimization and control”, INFORMS Annual Meeting, Minneapolis, MN, Oct. 2013. (invited)

2012:

87. QT H. Honnappa, R. Jain and Amy Ward, “The ∆(i)/GI/1 model: A new model of tran-

sitory queueing”, INFORMS Annual Meeting, Phoenix, AZ, Oct. 2012.

88. SL D. Kalathil, N. Nayyar and R. Jain, “Decentralized learning for multi-player multi-armedbandits”, Information Theory and Appl. (ITA) Workshop, UCSD, Feb 2012. (invited)

2011:

89. QT H. Honnappa, R. Jain and A. Ward, “Strategically arriving users into queueing systems”,

SIAM Conference on Control and its Applications, Baltimore, MD, July 2011.

90. CS D. Kalathil and R. Jain, “Communication games on the generalized Gaussian relaychannel”, Information Theory and Appl. (ITA) Workshop, UCSD, Feb 2011. (invited)

2010:

91. SL R. Jain, “Solving Markov decision problems via simulations”, International Congressof Mathematicians (ICM) Satellite Conf. on Probability and Stochastic Processes, Bangalore,India, Aug. 2010.

92. QT R. Jain, S. Juneja and N. Shimkin, “The concert queueing game: To wait or to be late”,

Information Theory and Appl. (ITA) Workshop, UCSD 2010 (invited).

93. QT H. Honnappa and R. Jain, “Strategic arrivals into queueing networks”, INFORMS

Annual Meeting, Austin, TX, Nov 2010.

2009:

94. QT R. Jain and S. Juneja, “The concert queueing problem: A game of arrivals”, INFORMS

Applied Probability Society Conference, Ithaca, NY, July 2009.

95. SC R. Jain and V. Borkar, “Risk-constrained Markov decision processes”, INFORMS Ap-plied Probability Society Conference, Ithaca, NY, July 2009.

96. SC V. Borkar and R. Jain, “Markov decision processes with CVAR constraints”, INFORMSAnnual Meeting, San Diego, CA, October 2009.

2008-07:

97. QT R. Jain and P. Dube, “ N-player queueing games: Pricing competition for queued ser-

vices”, Information Theory and Applications (ITA) Workshop, UCSD, January 2008 (invited).

98. NE R. Jain, “Stability of marriage and dowry”, Intl. Conf. on Applied Mathematics,Plovdiv, Bulgaria, August 2007.

99. NE R. Jain,“A design for an asymptotically efficient combinatorial Bayesian markets: Gen-eralizing the Satterthwaite-Williams mechanism”, Int. Conf. on Game Theory, Stony Brook,NY, July 2007.

100. QT P. Dube and R. Jain, “Pricing differentiated queued services”, INFORMS Annual Meet-

ing, , Seattle, WA, November 2007. (invited)

101. QT P. Dube, R. Jain and C. Touati, “An analysis of oligopolistic competitive markets of

queued services with QoS guarantees” INFORMS Applied Probability Meeting, Eindhoven, TheNetherlands, July 2007.

102. SL R. Jain and P. Varaiya, “Simulation-based optimization for Markov decision processesand Multi-armed bandits: An empirical process theory approach, Conf. on Stochastic Pro-cesses and Applications (SPA-07), Urbana-Champaign, IL, August 2007.

2006-05:

103. SL R. Jain and P.P. Varaiya, “Simulation-based uniform estimates of value functions ofMarkov decision processes”, Conf. Stochastic Processes and Applications (SPA-05), SantaBarbara, CA, June 2005.

2004-1999:

104. WN R. Jain, “Geographical routing for wireless ad hoc networks”, IMA Workshop on HotTopics in Wireless, University of Minnesota, Minneapolis, August 2001. (invited)

105. WN R. Jain, “Geographical routing for wireless ad hoc networks using partial information”,Workshop on The Foundations of Wireless Networks and Applications, DIMACS Center, Rut-gers University and AT&T Shannon Labs, August 2000. (invited)

Patents Granted: 5. Pending: 4. Provisional: 2.

1. R. Jain, C.Kaskiris, N.Pillai, R.Rajagopal, J.Shu and P.P.Varaiya, “System and method forconducting combinatorial exchanges”, US7627510, Filed: Mar 23, 2006. Issued: Dec 1, 2009.

2. R. Jain, “Method and system for designing bipartite matching markets with applications toonline advertising industry”, US patent application file: 11/837616, filed August 13, 2007.

3. R. Jain and P. Dube, “A method and system for auction of assets with non-exclusivity ofuse”, US7516093, Filed: Jun 30, 2008. Issued Apr 7, 2009.

4. P. Dube and R. Jain, “Incentivized reputation-based knowledge exchange”, US Patent appli-cation file: 12/147994, Filed: June 2008.

5. R. Jain, P. Dube and M. Naphade, “Collaborative networking with optimized informationquality assessment”, US8527447, Filed: Feb 22, 2010. Issued: Sep 3, 2013.

6. P. Dube, R. Jain and M. Naphade, “Collaborative networking with optimized inter-domaininformation quality assessment”, US8560490, Filed: Feb 22, 2010. Issued: Oct 15, 2013.

7. P. Dube, R. Jain, R. Kannan and K. Subbian, “Method and system for user guided searchnavigation”, US8745039, Filed: Sep 25, 2009. Issued: Jun 3, 2014.

8. P. Chowdhury, A. Gupta, R. Jain, J. Kalagnanam, S. Siegel and D. Subramanian, “Developingan optimal long term electricity generation capacity resource plan under a Carbon dioxideregulatory regime”, US20110178833, Filed: Jan. 20, 2010.

9. R. Jain, P. Dube and S. Sahu, “Method and system for location-aware user specific adver-tisements”, US20110082752, Filed: Oct. 2, 2009.

10. N. Nayyar and R. Jain, “Method and System for Multi-stage Scheduling of Multiple Resourceswith Application to Surgery Scheduling in Hospitals”, US Provisional Patent application file:62/381013, filed: August 30, 2016.

11. N. Nayyar, R. Jain and M. Jafarnia, “Method and System for Predicting Resource UseDuration by Combining Multiple Models”, US Provisional Patent application file: 62/415506,filed: November 1, 2016.

Contracts &Grants

Total funding raised (share as PI/co-PI): $1.96M1. “SCC: Microtransactions for Decarbonization: Renewables Integration with Electric Vehicles

for Shared and Inclusive Economy”, National Science Foundation, pending (as co-PI).

2. “Learning Methods for Decentralized Control of Multi-Agent Systems”, Army Research Office,pending (as co-PI).

3. “A New Approach to Analysis and Design of Algorithms for Stochastic Control and Optimiza-tion”, National Science Foundation, pending (as PI).

4. “Online Learning-based Real-time Control of Unknown Stochastic Systems”, National ScienceFoundation, pending (as PI).

5. “Smarter Markets for a Smarter Grid: Pricing Randomness, Flexibility and Risk”, NationalScience Foundation, award no. ECCS-1611574, 09/01/16-08/31/19

6. “An Integrated Analytics and Scheduling System for Operations Management in Hospitals”,National Science Foundation, SBIR Phase I (Organization: Vivace Systems LLC)

7. “Stochastic Dynamic Optimization and Games: Simulation and Learning Methods”, Office ofNaval Research (ONR) Young Investigator Award, 2012, Award Period: 6/1/2012-5/31/2016.

8. “Smarter Cities: Distributed Optimization and Control Framework for Smart Energy Net-works”, IBM Faculty Award, Award Period: 2010-11.

9. “Distributed Control and Infomation Fusion over Communication Networks”, Air Force Officeof Scientific Research (AFOSR), Award no. FA9550-10-1-0307, 6/15/2010-6/15/2013.

10. “CAREER: Network Economics: Theory and Architecture for Incentive-engineered Networks”,National Science Foundation Early Faculty Development (CAREER) Award, Grant no. CNS-0954116, 2/1/2010-1/31/2017 (Single PI, 1 summer month/year).

11. “NetSE: Small: Cooperation and Incentives in Communication and Social Networks”, NationalScience Foundation, Grant no. IIS-0917410, 10/1/09-9/30/14.

12. “The Economics of Quality of Service on the Internet”, James H. Zumberge Faculty Research& Innovation Award, 7/1/09-6/30/10.

Students &Postdocs

PhD Students: 4 graduated. 3 in TT-academic positions. 1 industry/entrepreneur.1. Harsha Honnappa (PhD (EE), “Strategic and Transitory Models of Queueing Systems”, Fall

’09-Dec. 2014, (Assistant prof., Purdue IE, started: Jan 2015)

2. Dileep M. Kalathil (PhD (EE), “Empirical Methods in Control and Optimization”, Fall’09-Sep.2014, (Assistant Prof., Texas A&M ECE, started: Fall 2017)

3. Wenyuan Tang (PhD (EE), “The Smart-grid Network: Pricing, Markets and Incentives”,Fall’10-Aug. 2015, (Assistant Prof., North Carolina State ECE, started: Fall 2017)

4. Naumaan Nayyar, (PhD (EE), “Learning and Control in Decentralized Stochastic Systems”,Fall’10-Sep. 2015, (Currently: Applied Scientist, Amazon. Previous: CTO, Smart+CareSystems; IBM Watson Research (2015-16))

5. Srinivas Yerramalli (co-advised with U. Mitra) (PhD, (EE), “Communication and Cooperationin Underwater Acoustic Networks”, May 2013, (Currently: Qualcomm)

6. Hiteshi Sharma, (PhD student (EE), RA, Fall ’14-present)

7. Mehdi Jafarnia (PhD student (EE), RA, Sp. ’15-present)

8. Mukul Gagrani (PhD student (EE), RA, Fa’15-, co-advised with Ashutosh Nayyar)

9. Nathan Dahlin (PhD student (EE), RA, Fall ’15-present)

10. Krishna Chaitanya Kalagarla (PhD Student (EE), Fellowship, Fall ’16-present)

Postdocs: Total 4. 3 in TT-academic positions.1. Arman Khouzani (Postdoc, EE, Jan-June 2013; PhD (EE), U.Penn.) (Lecturer (asst. prof.),

Queen Mary University of London)

2. Will Haskell (Postdoc, ISE/CS/EE Dept., Summer ’12 and Fall ’13-June ’14; PhD (IEOR),UC Berkeley) (Currently: TT-assistant prof., NUS, Singapore, ISE and Math department)

3. Abhishek Gupta (Postdoc, EE, Aug 2014 - June 2015; PhD (ECE), UIUC) (Currently: ,TT-assistant prof., Ohio State ECE)

4. Ouyang Yi (Postdoc, EE, Jan 2016 - July 2017; PhD (EECS), Michigan) (Currently: UCBerkeley IEOR/EECS, postdoc)

Summer Students:Karan Chadha (Senior UG, IIT Bombay, summer intern 2017)Soham Phade (Senior Undergraduate, IIT Bombay, summer intern 2014)Varun Sah (Senior Undergraduate, BITS Pilani, summer intern 2013)Sachin Gupta (Senior undergraduate, IIT Kanpur, summer intern 2012)Suk-Jin Lee (Junior undergraduate, EE, summer intern 2010)

Student’s Honorsand Awards

Harsha Honnappa, Lajos Takacs Thesis Award in Queueing Theory 2016Dileep Kalathil, Best EE PhD Dissertation 2015Srinivas Yerramalli, Best Student Paper Award at the SPCOM 2012 Conference 2012

Teaching Average rating: 4.0/5EE 599/651* Network Econ. and Games Fa’09, Fa’10,EE/ISE 556* Stochastic Systems Sp’10, Sp’11, Fa’13, Fa’15,Fa’17EE 512* Stochastic Processes Fa’11, Sp’13, Sp’14, Sp’16 , Sp’17EE 598* EE Research Seminar Fa’11,Fa’12, Sp’13,Fa’13,Fa’15,Sp’16,Fa’16EE 503 Prob. and Random Proc. Su’17EE 364† Probability (UG) Fa’16Sp 2012 :: On parental leave 2014-15:: Sabbatical leave

*Courses created and developed: EE 599/651: Network Economics and Game Theory; EE/ISE 556:Stochastic Systems; EE 512: Stochastic Processes; EE 598: EE Seminar course. Courses (helped)substantially revised: EE 588 Convex optimization.

Service University:1. Zumberge Individual Award Review Panel, 2011, 2012, 2014.

School:1. Member-at-large, Appointment, Promotion and Tenure (APT) Committee of the Viterbi

School of Engineering, Dec’15-present

2. Member, APT Subcomittee on Departmental merit evaluation process, Spring 2018

3. Faculty Coordinator, MS (Financial Engineering) Program, EE Department, USC 2008-present.Co-lead establishment of the program.

4. NSF CAREER proposal reviewer for Viterbi School junior faculty, 2010-15

Department:1. NTT Faculty Departmental Promotion Committee: 2016-17

2. EE Graduate Curriculum Committee: 2016-17

3. EE PhD Fellowships Admissions Committee: 2015-16

4. EE Faculty Merit Review Committee: 2015-16 (research subcommittee)

5. PhD Defense Committees Served: Longbo Huang (May 2011), Mahyar Salek (May 2011),Chih-Ping Li (June 2011), Nate Koenig (September 2012), Yi Gai (October 2012), SrinivasYerramalli (Nov 2012), Harsha Honnappa (Summer 2014), Dileep Kalathil (Summer 2014),Eric Shieh (Spring 2015), Wenyuan Tang (Sp’15), Naumaan Nayyar (Fa’15), Yifan Liu (Fa’16),Pengqian Yu (Oct’16, NUS)

6. PhD Qualifying Committees Served: Fall 2008: Jason Levin (EE, Ionnou); Fall 2009: Yi Wang(EE, Krishnamachari), Mahyer Salek (CS, Kempe)); Spring 2010: Longbo Huang (EE, Neely),Fall 2010: Nate Koenig (CS, Mataric), Chih-ping Li (EE, Neely), Yi Gai (EE, Krishnamachari);Spring 2011: Marjan Baghaie (EE, Krishnamachari); Summer 2011: Brandon Franzke (EE,Bart Kosko); Fall 2011: Chiranjeeb Chatterjee (EE, U. Mitra); Fall 2012: Ryan Williams(CS, G. Sukhatme); Spring 2013: Daphne Zois-Stavroula (EE, U. Mitra); Summer 2013: RezaBanirazi (EE, Jonckheere); Summer 2014: Sagar Patil (EE, Safonov), Eric Shieh (CS, M.Tambe); Spring 2016: Yu-chen Sung (EE, Safonov); Fall 2016: Mohammad Motie (CEE,Savla); Summer 2017: Hao Yu (EE, Neely); Semih Atakan (ISE, Sen); Tianyu Hao (ISE,Pang)

7. PhD Screening Oral Exam Committees Served: Fall 2008, Spring 2009, Fall 2009, Spring 2010,Fall 2010, Spring 2011, Fall 2011, Fall 2012, Spring 2013, Fall 2013, Spring 2014, Fall 2015,Spring 2016, Fall 2016, Spring 2017

8. CommNetS (Communications, Networks & Systems) Seminar Organizer (with Alex Dimakis/AshutoshNayyar), 2009-16. (New multi-disciplinary seminar)

9. USC EE Dept. Distinguished Lecture Series (DLS) Speaker Selection Committee, 2009-10

10. USC Ming Hsieh Institute Doctoral Scholars Selection Committee, 2010-11, 2011-12

11. EE Research Festival - Best Student Presentation Committee, April 2011; Best student paperCommittee, Spring 2013

ProfessionalMemberships

IEEE, IEEE Communications, Control Systems and Information Theory Societies;INFORMS (Inst. for Operations Res. and Manag. Sci.), INFORMS Applied Probability Soc.;

ProfessionalService

Journal Editorial Boards/Technical Society Committees:1. Associate Editor, Conference Editorial Board, IEEE Control Systems Society, July 2016-

2. Member, Technical Committee on Networks and Communications, IEEE Control Systems So-ciety, 2015- (Chair: Daniel Quevedo )

3. Associate Editor, IEEE Trans. on Network Science and Engineering, April 2014-present

4. Associate Editor, IEEE Trans. on Mobile Computing, April 2013-June 2016

5. Guest Editor-in-Chief, Special issue on “Economics of Communication Networks and Systems”,IEEE J. Selected Areas in Communications, Fall 2011-12.

Conference Organization:1. TPC Co-Chair, International Conference on Game Theory in Networks (GameNets) 2011

2. Symposium Co-Organizer, Southern California Symposium on Network Economics and GameTheory, Los Angeles, CA 2009-2014

Conference Technical Program Committee (TPC) Membership:1. ISIT 2018

2. NetGCOOP, 2016;

3. NetEcon 2015;

4. IEEE INFOCOM 2014; NetGCoop 2014; GameSec 2014; SPCOM 2014; INFOCOM Workshopon Smart-grid Dynamic Pricing (SDP) 2014;

5. IEEE COMSNETS 2013; IEEE INFOCOM 2013; INFOCOM SDP Workshop 2013; IEEE ICC2013, IEEE Globecom 2013; The 2nd IEEE International Workshop on Smart Data Pricing(SDP 2013)

6. IEEE INFOCOM 2012; IEEE SPCOM 2012; IEEE SECON 2012; NetGCOOP’12; WPiNWorkshop 2012; GameSec 2012.

7. International Conference on NETwork Games, COntrol and OPtimization (NETGCOOP’11),2011; IEEE INFOCOM, 2011

8. IEEE PIMRC, 2010; IEEE SECON, 2010; IEEE INFOCOM Work-in-Progress, 2010

9. ACM CoroNet, 2009; IEEE SECON (Sensor, Mesh and Ad Hoc Communications and Net-works) Conference, Rome, Italy, June 2009.

10. Workshop on Game Theory in Communications (Game-Comm) (A ValueTools Workshop),Athens, Greece, October 2008; Workshop on Bandwidth on Demand (BoD 08), April 2008,Brazil;

11. Workshop on Game Theory in Communications (Game-Comm) (A ValueTools Workshop),Nantes, France, October 2007

12. Workshop on Bandwidth on Demand (BoD 06), San Francisco, CA, November 2006. (AnIEEE Globecom Workshop)

Other Service:1. Review Panel, Systems and Communication Engineering program, European Research Council

Executive Agency ERCEA.B4 - Physical Sciences and Engineering, May 2016

2. Review Panel, National Science Foundation (NSF) ‘Transportation’ Program, Mar 2018

3. Review Panel, National Science Foundation (NSF) ‘EPCN’ Program, Mar 2017

4. Review Panel, National Science Foundation (NSF) ‘NeTS’ Program, Mar 2015

5. Review Panel, National Science Foundation (NSF) ‘Energy, Power and Adaptive Systems’Program, Mar 2013

6. Review Panel, National Science Foundation (NSF) ‘Interface of Computer Science and Eco-nomic and Social Sciences’ Program, Feb 2012

7. Proposal reviewer for Fonds de recherche du Quebec - Nature et technologies, Fall 2011

8. Review Panel, National Science Foundation (NSF) ‘Networked Controls’ Program, 2010

9. Review Panel, National Science Foundation (NSF) ‘Algorithmic Foundations’ Program, Novem-ber 2008

10. Proposal Reviewer for Air Force Office of Scientific Research, December 2008

11. Session organizer and chair, INFORMS Annual Meeting 2009 and 2010

12. Session Co-organizer, Session on Pricing and Revenue Management, INFORMS Annual Meet-ing, Washington, DC, November 2008

13. Session Chair (Markov chains and MDPs), INFORMS Applied Probability Society Conference,Ithaca, NY, 2009

14. Session Chair, Int. Conference on Game Theory in Netwoks (GameNets), Istanbul, Turkey2009

15. Session Co-chair, Session on Game Theory, IEEE Conf. on Decision and Control (CDC), NewOrleans, LA, December 2007

16. Session Co-organizer, Session on Pricing for Networks and Queues, INFORMS Annual Meeting,Seattle, WA, November 2007

17. Session Co-chair, Session on Network pricing, IEEE Conf. on Decision and Control (CDC),San Diego, CA, December 2006

18. Journal Reviewer for IEEE Trans. on Auto. Control (Outstanding Reviewer 2010),IEEE Trans. on Information Theory, IEEE/ACM Trans. on Networking, IEEE J. SelectedAreas in Communications, IEEE T. Mobile Computing, IEEE Trans. on Communications,Queueing Systems, European J. of Control, J. of Economic Theory, Automatica, OperationsResearch, Performance Evaluation

19. Conference Reviewer for the IEEE CDC Conferences, IEEE Infocom Conferences, Game-Comm Conferences, Game-Nets Conference, IEEE NOMS BoD Workshops, IEEE SECONConference, ACM CoRoNet Workshop, IEEE DySpan etc.

Selected InvitedTalks (Fall2008+)

1. “The Random Operator Approach to Stochastic Control and Optimization”, Dept. of Math.Sciences, Indian Institute of Scientific Education and Research, Mohali (Jan 2, 2017) andEE Department, UC Santa Barbara (March 3, 2017), and ECE Department, U. Melbourne(December 18, 2017). Also: USC CS Department (April 24, 2017)

2. “Learning, Control and Optimization”, EE Advisory Board, Nov 3, 2016

3. “Empirical methods in Controls and Optimization”, Machine Learning Center Kickoff event,Sep 29, 2016

4. “The Art of Optimizing via Simulations”/“Empirical Dynamic Programming”, UCSD ITATalk (Feb 7, 2014); Caltech SISL Seminar (May 9, 2014); Berkeley IEOR (Sep 15, 2014);Stanford MS&E (Oct 8, 2014); U. Maryland ISR (Oct. 28, 2014); MIT LIDS (Oct 29, 2014),Boston Univ (Oct 30, 2014), UCLA EE (Nov 6, 2015), NUS (Nov 19, 2015).

5. “Transitory Queues”, UC Berkeley, EECS, NCD Seminar, Oct 20, 2014.

6. “Pricing/Markets, Storage and Dispatch”, Berkeley Energy Group Seminar, Oct. 2, 2014.

7. “Smarter markets for a smarter grid: The Why and How.”, UCLA EE (April 3), Caltech(April 15), Stanford Smart-Grid Seminar (Oct. 24), and UC Berkeley, EECS, Oct. 25, 2013.

8. “Transitory queueing systems”, Stochastic Analysis Seminar, MIT OR Center, May 2, 2013.

9. “Market and pricing mechanisms for smart-grid networks”, Information Theory and Applica-tions (ITA) Workshop, San Diego, Feb 15, 2013.

10. “Team Problems: Learning and Control”, AFOSR Program Review Workshop, Dec 4, 2012.

11. “The Art of Gambling in a Team: Multi-player multi-armed bandits”, Google Research (Nov6), U-Maryland ECE (Nov 12), IBM Research (Nov 14), UCSD ECE (Nov 20, 2012), UCSBECE (Feb 1, 2013), MIT EECS (May 3, 2013).

12. “How to gamble (as a team) if you must: Decentralized learning for multiplayer multi-armedbandits”, CMS Seminar, Caltech, Sep 6, 2012 and Supelec, Paris, Oct 8, 2012.

13. “To wait or be late: Strategic and transitory queueing systems”, CSL Seminar, University ofIllinois, Urbana-Champaign, July 12, 2012, EECS Seminar, Northwestern University, July 13,2012, UC Berkeley EECS (Oct 22), Stanford ISL Seminar (Nov 8), U-Penn ESE (Nov 13) andColumbia GSB/IEOR (Nov 15, 2012).

14. “To queue or not to queue: Strategic behavior in queueing systems”, EECS Department, U.Michigan, Ann Arbor*, Mar 12, 2012.

15. “To queue or not to queue: Strategic behavior in queueing systems”, Prob. and Stat. Seminar,Math Department, USC, Apr 20, 2012.

16. “Multi-player Multi-armed bandits”, Int. Center for Theoretical Sciences (ICST) Workshopon Network Science, IISc/TIFR Bangalore, January 2012.

17. “Multi-player Multi-armed bandits: Combinatorial and Decentralized settings”, AFOSR In-formation Fusion Program Workshop, Nov 9, 2011.

18. “Queues & Games: Strategic interaction in queueing systems”, Southern California Symp. onNetwork Economics and Game Theory (NEGT), Caltech, Nov 4, 2011.

19. “A non-cooperative perspective of cooperative communications”, CS Seminar, Caltech, Feb18, 2011. (Also: CSPL/EECS Seminar, U. Michigan, Ann Arbor, Jan 27, 2011 and School ofTech. and Comp. Sci. Seminar, Tata Inst. Fund. Res. (TIFR), Mumbai, May 21, 2010. )

20. “The concert arrival game: Strategic arrivals into queueing networks”, invited talk, IPAMWorkshop on Algorithmic Game Theory, UCLA, January 12, 2011.

21. “Contracts for cooperative spectrum sharing”, Southern California Symp. on Network Eco-nomics and Game Theory (NEGT), UCLA, Nov 12, 2010.

22. “Network market design”, Varaiya Energy Group Webinar, UC Berkeley, Sep 21, 2010.

23. “The concert queueing game: To wait or to be late”, Information Theory and Applications(ITA) Workshop 2010, UC San Diego, Feb 5, 2010.

24. “Simulation-based algorithms for Markov decision processes: An empirical process theoryapproach”, Prob. and Stat. Seminar, Math department, USC, Nov 13, 2009.

25. “Match-making: From efficient network markets to stable marriages”, EE Seminar, Universityof California, Los Angeles, April 29, 2009. (Also: School of technology and computer science,Tata Institute of Fundamental Research, Mumbai, February 27, 2009 and also at IIT Delhi,March 24, 2009.)

26. “Simulation-based algorithms for Multi-stage decision systems: An empirical process theoryapproach”, ISE Seminar, USC, Los Angeles, CA, October 2, 2008.

Date: May 1, 2018.

Latest version at: http://www-bcf.usc.edu/~rahuljai/Downloads/rahuljainCV18.pdf