ECE 594: Mathematical Models of Language

Note: 

(1) This is an evolving schedule.

(2) The readings are based on the list of books in the Logistics page.

(3) All course videos are available in our course channel

 

Date Topic/Paper Presenter(s) Readings   Assignment
01/18 Introduction Prof. Bhat      
01/20

Word-level models–Naive Bayes

slides

Prof. Bhat.   

JM_3 4.1-7

optional (4.8-10)

   
01/25

Word-level models–Logistic Regression 

slides

Prof. Bhat JE 2.5-6    
01/27

Finding Deceptive Opinion Spam by Any Stretch of the Imagination (ACL Test of Time Award 2021)

Word representations: A simple and general method for semi-supervised learning (ACL Test of Time Award 2020)

Yong's slides

 

 

Jiachen's slides

 

     
02/01

Models of meaning

slides

Prof. Bhat JM_3 6.1-8    
02/03

Unsupervised Word Sense Disambiguation Rivaling Supervised Methods (ACL Test of Time Award 2020)

Lightweight Lexical and Semantic Evidence for Detecting Classes Among Wikipedia Articles

Vincent's slides

 

Keyu's slides

   

Assignment1[link]

Due 02/11@11:59pm

02/08

Sequence-level models

slides

Prof. Bhat

JE Chapter 6

SLP_3 9.1-4

   
02/10

Efficient estimation of word representations in vector space

 

Deep contextualized word representations

Hanyin's slides

 

Viraj's slides

   

Assignment2 [link]

Due 02/27@11:59pm

02/15

Low-resource NLP

slides

Prof. Bhat      
02/17

What Kind of Language is Hard to Language Model?

Analysis Methods in Neural Language Processing: A Survey

Neeraj

Sophie

   

Project proposals due 02/18

(proposal Latex template)

02/22

Transfer Learning in NLP and Summarization

slides

Prof. Bhat JM_3 11.1-3    
02/24

Summarization

slides

Prof. Bhat    

Assignment3 [link]

Due 03/11@11:59pm

03/01

Dialog

slides

Prof. Bhat

JM_3

24.1-5

   
03/03

Exploring and Predicting Transferability Across NLP Tasks

On Faithfulness and Factuality in Abstractive Summarization

Po-Hao's slides

 

Viraj

     
03/08

Question Answering

slides

Prof. Bhat

JM_3 

23.1-2, 23.5-7

   
03/10

Rakesh's slides

 

Qian's slides

     
03/15,17 SPRING BREAK        
03/22

Commonsense Reasoning

slides

Prof. Bhat      
03/24

REALM: Retrieval Augmented Language model Pretraining

Language Models as Knowledge Bases?

Haozhong's slides

 

Vincent's slides

     
03/29 Project Updates        Project Presentation template
03/31

 

Social Bias Frames: Reasoning about Social and Power Implications of Language

Language from police body camera footage shows racial disparities in officer respect

 

Neeraj

Jiachen's slides

     
04/05

Generate, Prune and Select–A Pipeline for Counterspeech Generation Against Online Hate Speech

Challenges in Automated Debiasing for Toxic Language Detection

 

Mengfei

Zhenrui

     
04/07

Deep Reinforcement Learning-based Text Anonymization against Private-Attribute Inference

Personal Information Leakage Detection in Conversations

Hanyin's slides

 

Po-hao

   

Assignment 4

[link]

Due 04/22@11:59pm

04/12

Navigating the Kaleidoscope of COVID-19 Misinformation Using Deep Learning

Censorship of Online Encyclopedias: Implications for NLP Models 

Sophie

 

Yong's slides

     
04/14

Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake News

Seeing Things from A Different Angle: Discovering Diverse Perspectives about Claims

Rakesh's slides

 

Yaman's slides

     
04/19

Stance Classification of Context-Dependent Claims

Asking the Right Question: Inferring Advice-Seeking Intentions from Personal Narratives

Mengfei

 

Yaman's slides

 

     
04/21

Decoupling Strategy and Generation in Negotiation Dialogues

Self-Supervised Euphemism Detection and Identification for Content Moderation

Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings

Haozhong

 

Qian

 

Huimin

     
04/26

 

All That's Human Is Not Gold: Evaluating Human Evaluation of Generated Text

Evaluating and Characterizing Human Rationales

Huimin

Zhenrui

     

04/28

05/03

Project Presentation

 

 

Project Presentation

Yong, Hanyin, Rakesh, Yaman

 

Neeraj, 

Viraj,

Huimin,

Sophie