Readings

I am putting myself to the fullest possible use, which is all I think that any conscious entity can ever hope to do.

The lecture schedule is subject to change as the term progresses.

Date	Topic	Readings
Tuesday, January 28, 2020	First class by João Sedoc Goals for this seminar Who should take this class, and what will they have to do Introduction to Deep Learning Feedforward Deep NNs	Machine Learning Basics - Chapters 5 of Deep Learning by Ian Goodfellow, Yoshua Bengio and Aaron Courville Deep Feedforward Networks - Chapter 6 of Deep Learning by Ian Goodfellow, Yoshua Bengio and Aaron Courville Introducing the Conversational Interface - Chapters 3,4 by Michael McTear, Zoraida Callejas, David Griol
Thursday, January 30, 2020	Regularization, Parameter Tuning, and Recurrent Neural Networks by João Sedoc Optimization of neural networks with focus on tuning parameters Recurrent Neural networks and their relation to NLP	Regularization for Deep Learning - Chapter 7 of Deep Learning by Ian Goodfellow, Yoshua Bengio and Aaron Courville Sequence Modeling Recurrent and Recursive Nets - Chapter 10 of Deep Learning by Ian Goodfellow, Yoshua Bengio and Aaron Courville
Tuesday, February 4, 2020	Sequence to Sequence Learning by João Sedoc Sequence to sequence model Transformer model	Sequence Modeling Recurrent and Recursive Nets - Chapter 10 of Deep Learning by Ian Goodfellow, Yoshua Bengio and Aaron Courville Sequence to Sequence Learning with Neural Networks by Ilya Sutskever, Oriol Vinyals, Quoc V. Le Attention Is All You Need (Transformer Model) by Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
Thursday, February 6, 2020	Sequence to Sequence Learning by João Sedoc Sequence to sequence model Neural Conversation Models	Data-Driven Response Generation in Social Media by Alan Ritter, Colin Cherry, William B. Dolan A Neural Conversational Model by Oriol Vinyals, Quoc V. Le Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models by Iulian V. Serban, Alessandro Sordoni, Yoshua Bengio, Aaron Courville, Joelle Pineau
Tuesday, February 11, 2020	HRED, DialoGPT, and Corpora by João Sedoc	DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation by Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, Bill Dolan A Survey of Available Corpora For Building Data-Driven Dialogue Systems by Iulian Vlad Serban, Ryan Lowe, Laurent Charlin, Joelle Pineau The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems by Ryan Lowe, Nissan Pow, Iulian Serban, Joelle Pineau
Thursday, February 13, 2020	Guest Lecture by Alan Nichol	BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding by Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring by Samuel Humeau, Kurt Shuster, Marie-Anne Lachaux, Jason Weston
Tuesday, February 18, 2020	Evaluation by João Sedoc	How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation by Chia-Wei Liu, Ryan Lowe, Iulian V. Serban, Michael Noseworthy, Laurent Charlin, Joelle Pineau Chatbot Evaluation and Database Expansion via Crowdsourcing by Zhou Yu, Ziyu Xu, Alan W Black, Alexander I. Rudnicky
Wednesday, February 19, 2020	Modeling user intent and satisfaction in conversational systems by Eugene Agichtein	ConCET: Entity-Aware Topic Classification for Open-Domain Conversational Agents by Ali Ahmadvand, Harshita Sahijwani, Jasoningyu Choi, Eugene Agichtein Contextual Dialogue Act Classification for Open-Domain Conversational Agents by Ali Ahmadvand, Jason Ingyu Choi, Eugene Agichtein
Thursday, February 20, 2020	Evaluation continued by João Sedoc	deltaBLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets by Michel Galley, Chris Brockett, Alessandro Sordoni, Yangfeng Ji, Michael Auli, Chris Quirk, Margaret Mitchell, Jianfeng Gao, Bill Dolan Investigating Evaluation of Open-Domain Dialogue Systems With Human Generated Multiple References by Prakhar Gupta, Shikib Mehri, Tiancheng Zhao, Amy Pavel, Maxine Eskenazi, Jeffrey P. Bigham
Tuesday, February 25, 2020	Evaluation and Response Diversity by João Sedoc	A Diversity-Promoting Objective Function for Neural Conversation Models by Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan Mutual Information and Diverse Decoding Improve Neural Machine Translation by Jiwei Li and Dan Jurafsky
Thursday, February 27, 2020	Poly-encoder by João Sedoc	Comparison of Diverse Decoding Methods from Conditional Language Models by Daphne Ippolito, Reno Kriz, Maria Kustikova, João Sedoc, Chris Callison-Burch The Curious Case of Neural Text Degeneration by Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, Yejin Choi
Tuesday, March 3, 2020	Diverse Decoding by Daphne Ippolito	Adversarial Learning for Neural Dialogue Generation by Jiwei Li, Will Monroe, Tianlin Shi, Sébastien Jean, Alan Ritter, Dan Jurafsky Another Diversity-Promoting Objective Function for Neural Dialogue Generation by Ryo Nakamura, Katsuhito Sudoh, Koichiro Yoshino, Satoshi Nakamura
Thursday, March 5, 2020	Project brainstorming	Discourse and Dialogue by Susan E. Brennan, Anna K. Kuhlen, Jeanne Charoy
Tuesday, March 10, 2020	Topic Aware Generation by João Sedoc	Topic Aware Neural Response Generation by Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, Wei-Ying Ma Generating More Interesting Responses in Neural Conversation Models with Distributional Constraints by Ashutosh Baheti, Alan Ritter, Jiwei Li, Bill Dolan
Thursday, March 12, 2020	Class cancelled
Tuesday, March 17, 2020	Spring vacation
Thursday, March 19, 2020	Spring vacation
Tuesday, March 24, 2020	Personality and Identity for Generation by Aaron Mueller	Assigning Personality/Identity to a Chatting Machine for Coherent Conversation Generation by Qiao Qian, Minlie Huang, Haizhou Zhao, Jingfang Xu, Xiaoyan Zhu
Thursday, March 26, 2020	Persona and Personalization by Alexandra DeLucia	A Persona-Based Neural Conversation Model by Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan A Pre-training Based Personalized Dialogue Generation Model with Persona-sparse Data by Yinhe Zheng, Rongsheng Zhang, Xiaoxi Mao, Minlie Huang
Tuesday, March 31, 2020	Project Checkpoint 1 5 minute presentations by groups
Tuesday, March 31, 2020	Reinforcement Learning for Dialog Generation by Qianwei Li	Latent Intention Dialogue Models by Tsung-Hsien Wen, Yishu Miao, Phil Blunsom, Steve Young Deep Active Learning for Dialogue Generation by Nabiha Asghar, Pascal Poupart, Xin Jiang, Hang Li
Thursday, April 2, 2020	Dialog as a Text Adventure Problem by Mitchell Gordon	Learning to Speak and Act in a Fantasy Text Adventure Game by Jack Urbanek, Angela Fan, Siddharth Karamcheti, Saachi Jain, Samuel Humeau, Emily Dinan, Tim Rocktäschel, Douwe Kiela, Arthur Szlam, Jason Weston
Tuesday, April 7, 2020	Guest Lecture by Oluwatobi Olabiyi	Adversarial Bootstrapping for Dialogue Model Training by Oluwatobi O. Olabiyi, Erik T. Mueller, Christopher Larson, Tarek Lahlou DLGNet: A Transformer-based Model for Dialogue Response Generation by Oluwatobi O. Olabiyi and Erik T. Mueller A Persona-based Multi-turn Conversation Model in an Adversarial Learning Framework by Oluwatobi O Olabiyi, Anish Khazane, Erik T Mueller
Thursday, April 9, 2020	Non-Collaborative Dialog by Xiang Li	End-to-End Trainable Non-Collaborative Dialog System by Yu Li, Kun Qian, Weiyan Shi, Zhou Yu
Thursday, April 9, 2020	Visual QA with Reinforcement Learning by Nathaniel Weir	Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning by Abhishek Das, Satwik Kottur, José M. F. Moura, Stefan Lee, Dhruv Batra
Tuesday, April 14, 2020	Learning Implicit Preferences with Off-Policy RL by David Mueller	Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialog by Natasha Jaques, Asma Ghandeharioun, Judy Hanwen Shen, Craig Ferguson, Agata Lapedriza, Noah Jones, Shixiang Gu, Rosalind Picard
Tuesday, April 14, 2020	Inverse Reinforcement Learning for Dialog by Darius Irani	Dialogue Generation: From Imitation Learning to Inverse Reinforcement Learning by Ziming Li, Julia Kiseleva, Maarten de Rijke
Thursday, April 16, 2020	Decoding with Lingustic Pragmatics by Rachel Wicks	Natural Language Generation by Hierarchical Decoding with Linguistic Patterns by Shang-Yu Su, Kai-Ling Lo, Yi-Ting Yeh, Yun-Nung Chen Linguistically-Informed Specificity and Semantic Plausibility for Dialogue Generation by Wei-Jen Ko, Greg Durrett, Junyi Jessy Li
Thursday, April 16, 2020	Project Checkpoint 2 5 minute presentations by groups
Tuesday, April 21, 2020	Conditional Variational Autoencoder Discourse Level Diversity by Christian Cosgrove	Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders by Tiancheng Zhao, Ran Zhao, Maxine Eskenazi
Tuesday, April 21, 2020	Self Feeding Chatbot by Amrit Nidhi	Learning from Dialogue after Deployment: Feed Yourself, Chatbot! by Braden Hancock, Antoine Bordes, Pierre-Emmanuel Mazaré, Jason Weston
Thursday, April 23, 2020	Using Knowledge for Generation by Dylan Lewis	Learning to Select Knowledge for Response Generation in Dialog Systems by Rongzhong Lian, Min Xie, Fan Wang, Jinhua Peng, Hua Wu
Thursday, April 23, 2020	Knowledge Enhancement by Elias Stengel-Eskin	Knowledge Enhanced Hybrid Neural Network for Text Matching by Yu Wu, Wei Wu, Zhoujun Li, Ming Zhou A Knowledge-Grounded Neural Conversation Model by Marjan Ghazvininejad, Chris Brockett, Ming-Wei Chang, Bill Dolan, Jianfeng Gao, Wen-tau Yih, Michel Galley
Tuesday, April 28, 2020	Teach me about Wikipedia by Jung Min Lee	Wizard of Wikipedia: Knowledge-Powered Conversational agents by Emily Dinan, Stephen Roller, Kurt Shuster, Angela Fan, Michael Auli, Jason Weston
Thursday, April 30, 2020	Empathy in Dialog by Carlos Aguirre	Towards Empathetic Open-domain Conversation Models: a New Benchmark and Dataset by Hannah Rashkin, Eric Michael Smith, Margaret Li, Y-Lan Boureau Automatic Dialogue Generation with Expressed Emotions by Chenyang Huang, Osmar Zaïane, Amine Trabelsi, Nouha Dziri
Thursday, April 30, 2020	Bias in Generation by João Sedoc	Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation by Emily Dinan, Angela Fan, Adina Williams, Jack Urbanek, Douwe Kiela, Jason Weston A Crowd-based Evaluation of Abuse Response Strategies in Conversational Agents by Amanda Cercas Curry, Verena Rieser
Thursday, May 7, 2020	Project Presentations during Final Exam