MMToM-QA: Multimodal Theory of Mind Question Answering

Chuanyang Jin, Yutong Wu, Jing Cao, Jiannan Xiang, Yen-Ling Kuo, Zhiting Hu, Tomer Ullman, Antonio Torralba, Joshua Tenenbaum, Tianmin Shu
ACL 2024 Outstanding Paper Award [Website] [Paper] [GitHub] [Leaderboard]

Pandora: Towards General World Model with Natural Language Actions and Video States

Jiannan Xiang*, Guangyi Liu*, Yi Gu*, Qiyue Gao, Yuting Ning, Yuheng Zha, Zeyu Feng, Tianhua Tao, Shibo Hao, Yemin Shi, Zhengzhong Liu, Eric P. Xing, Zhiting Hu
[Website] [Github] [Paper] [Model]

LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Models

Shibo Hao*, Yi Gu*, Haotian Luo*, Tianyang Liu, Xiyan Shao, Xinyuan Wang, Shuhua Xie, Haodi Ma, Adithya Samavedhi, Qiyue Gao, Zhen Wang, Zhiting Hu
COLM 2024 [Website] [Library] [Paper]

Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning

Zhiting Hu*, Tianmin Shu*
[Paper] [NeurIPS2023 Tutorial] [AAAI2024 Tutorial]