Reading Schedule

1. Week 1: Introduction to Multi-Agent Systems
   • Katia Sycara, Multiagent Systems, AI Magazine 19(2): Summer 1998, p.79-92
   • Rod Brooks, I, Rod Brooks, am a Robot, IEEE Spectrum, June 2008
   • N. Jennings et al., Human-Agent Collectives, Communications of the ACM, Dec 2014
2. Week 2: Introduction to Planning
   • Reading: D. Nau, Current trends in automated planning, AI Magazine, Winter 2007
   • Reading: J-P. Kelly, A. Boea, and S. Koenig, Offline planning with HTNs in Video Games, AIIDE 2008
3. Week 3: Planning: Graphplan and UCT
   • Reading: A. Blum and M. Furst, Fast planning through graph plan analysis, AIJ 1990: pp.281-300
   • Reading: K. Laviers and G. Sukthankar, A Monte Carlo Approach for Football Play Generation, AIIDE 2010
4. Week 4: Trading Agent Competition
   • Reading: A. Greenwald and P. Stone, Autonomous Bidding Agents in the Trading Agent Competition IEEE Internet Computing, 5(2), March/April 2001
   • Reading: A. Greenwald and J. Boyan, Bidding Under Uncertainty: Theory and Experiments In Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence (Jul 2004), pp. 209-216.
   • Reading: A. Greenwald, S. Lee, and V. Narioditskiy RoxyBot-06: Stochastic Prediction and Optimization in TAC Travel In JAIR 2009: pp. 513-546
5. Week 5: Robocup Soccer and Urban Rescue
   • Reading: Peter Stone, Manuela Veloso, and Patrick Riley. The CMUnited-98 Champion Simulator Team. In M. Asada and H.Kitano, editors, RoboCup-98: Robot Soccer World Cup II Lecture Notes in Artificial Intelligence, pp. 61.76, Springer Verlag 1999.
   • Reading: J.,Wang, M. Lewis, and P. Scerri. Cooperating robots for search and rescue, Proceedings of the AAMAS 1st International Workshop on Agent Technology for Disaster Management, 2006, 92-99.
   • Reading: P. MacAlpine, F. Barrera, and P. Stone. Positioning to Win: A Dynamic Role Assignment and Formation Positioning System, Proceedings of the Robocup International Symposium, Mexico, June 2012
   • Reading: Juan Pablo Mendoza, Joydeep Biswas, Philip Cooksey, Richard Wang, Steven Klee, Danny Zhu and Manuela Veloso. Selectively Reactive Coordination for a Team of Robot Soccer Champions, Proceedings of AAAI 2016
6. Week 6: Starcraft Competition; Reinforcement Learning
   • Reading: D. Churchill and M. Buro. Incorporating Search Algorithms into RTS Game Agents. AIIDE Workshop on RTS Games 2012
   • Reading: Michal Certicky, David Churchill, Kyung-Joong Kim, Martin Certicky , and Richard Kelly, StarCraft AI Competitions, Bots, and Tournament Manager Software, IEEE Transactions on Games. 2019
   • Reading: Leslie Pack Kaelbling, Michael L. Littman, and Andrew W. Moore. Reinforcement learning: a survey. Journal of Artificial Intelligence Research, 4:237--285, May 1996
   • Reading: Reinforcement Learning: an Introduction (Chapter 1, 4, and 6)
   • Reading: Peter Stone and Manuela Veloso. Team-Partitioned, Opaque-Transition Reinforcement Learning. In Minoru Asada and Hiroaki Kitano, editors, RoboCup-98: Robot Soccer World Cup II, Lecture Notes in Artificial Intelligence, pp 261-72, Springer Verlag, Berlin, 1999.
7. Week 7: Deep RL and Transfer Learning
   • Reading (Guest Lecturer): Johnathan Mell and Jonathan Gratch, Grumpy & Pinocchio: Answering Human-Agent Negotiation Questions through Realistic Agent Design, AAMAS 2017
   • Reading: Deep Learning (Chapter 1, 6, and 9)
   • Reading: Vincent Francois-Lavet, Peter Henderson, Riashat Islam, Marc G. Bellemare and Joelle Pineau (2018), An Introduction to Deep Reinforcement Learning, Foundations and Trends in Machine Learning: Vol. 11, No. 3-4. Chapter 4 and 5
   • Reading: Matthew E. Taylor and Peter Stone. Cross-Domain Transfer for Reinforcement Learning. In Proceedings of the Twenty-Fourth International Conference on Machine Learning, June 2007
8. Week 8: Robotics: Path Planning
   • Reading: S. Koenig and M. Likhachev, Real-time Adaptive A*, Proceedings of AAMAS 2006
   • Reading: S.M. LaValle and J.J Kuffner. Randomized kinodynamic planning. In Proc. IEEE Int'l Conf. on Robotics and Automation (ICRA'99), Detroit, MI, May 1999
9. Week 9: Robotics: Localization and SLAM
   • Reading: D. Fox, W. Burgard, F. Dellaert, S. Thrun, Monte Carlo Localization: Efficient Position Estimation for Mobile Robots, AAAI 1999
   • Reading: D. Haehnel, W. Burgard, D. Fox, and S. Thrun, An Efficient FastSLAM Algorithm for Generating Maps of Large-scale Cyclic Environments From Raw Laser Range Measurements, IROS-03.
10. Week 10: Robotics: Multi-robot Coordination
    • Reading: N. Kalra, R. Zlot, and B. Dias, Market-based Multirobot Coordination: A Comprehensive Survey, IEEE Special Issue on Multirobot Coordination, July 2006
    • Reading: M. Koes, I. Nourbakhsh, and K. Sycara. Constraint Optimization Coordination Architecture for Search and Rescue Robotics, in Proceedings of ICRA 2006, Orlando, FL, May 2006, pp. 3977-3982
11. Week 11: Modeling Humans
    • Muric et al, Massive Cross-Platform Simulations of Online Social Networks, AAMAS 2020

Presentation Schedule