This is Kaiwen Zhou, a fourth-year Ph.D student at the University of California, Santa Cruz, working with Prof. Xin (Eric) Wang. I received my bachelor’s degree in statistics from Zhejiang University.

Research Interest

My research interests include (multi-modal) LLM, embodied AI, and AI safety.

News

• Two papers are accepted by ACL 2024!(05/2024)
• One paper is accepted by NAACL 2024!(03/2024)
• Our SlugJARVIS team won the third place in the first-ever Amazon Alexa SimBot challenge! (06/2023)
• Our ESC paper is accepted by ICML 2023!(04/2023)
• I will join Honda Research Institute as research intern this spring and summer!(04/2023)
• Our paper FedVLN is accepted by ECCV 2022!(07/2022)
• We are ranking No.1 in Alexa Prize SimBot Public Benchmark Challenge!(04/2022)
• I will join Samsung AI center as research intern this summer!(04/2022)

Publication

Multimodal Situational Safety
Kaiwen Zhou, Chengzhi Liu, Xuandong Zhao, Anderson Compalas, Dawn Song, Xin Eric Wang
NeurIPS Workshop on RBFM 2024 Oral
[Paper] [Website]

Muffin or Chihuahua? Challenging Large Vision-Language Models with Multipanel VQA
Yue Fan, Jing Gu, Kaiwen Zhou, Qianqi Yan, Shan Jiang, Ching-Chen Kuo, Xinze Guan, Xin Eric Wang
ACL 2024
[Paper] [Website]

ViCor: Bridging Visual Understanding and Commonsense Reasoning with Large Language Models
Kaiwen Zhou, Kwonjoon Lee, Teruhisa Misu, Xin Eric Wang
Findings of ACL 2024
[Paper]

Navigation as the Attacker Wishes? Towards Building Byzantine-Robust Embodied Agents under Federated Learning
Yunchao Zhang, Zonglin Di, Kaiwen Zhou, Cihang Xie, Xin Eric Wang
NAACL 2024
[Paper]

ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigation
Kaiwen Zhou, Kaizhi Zheng, Connor Pryor, Yilin Shen, Hongxia Jin, Lise Getoor, Xin Eric Wang
ICML 2023
[Paper] [Website]

FedVLN: Privacy-preserving Federated Vision-and-Language Navigation
Kaiwen Zhou, Xin Eric Wang
ECCV 2022
[Paper] [Source]

JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents
Kaizhi Zheng*, Kaiwen Zhou*, Jing Gu*, Yue Fan*, Zonglin Di*, Jialu Wang, Xuehai He, Xin Eric Wang
SoCal NLP 2022
Winner Model of the Alexa Prize SimBot Public Benchmark Challenge
[Paper]

Service

Reviewer
ICCV CLVL 2023, NeurIPS 2023, ICLR 2024, ICML 2024

Others

I like working out and singing after work, which I’ve been done for a long time. I also like hiking and traveling.