Weirui | Tsinghua University

About Me

I am a last year Ph.D student in Institute for Interdisciplinary Information Science (IIIS) at Tsinghua University, advised by Prof. Yang Gao. Previously, I received my bachelor degree from the School of Software at Tsinghua University, where I conducted research under the supervision of Prof. Mingsheng Long and Prof. Feng Xu.

My research goal is to develop human-level policy learning algorithms for embodied agents under visual perceptions. My current interest lies in Model-based RL, foundation models for decision-making, robot learning, etc.

News from 2024

[Sep. 2024] Our paper Reinforcement Learning with Foundation Priors: Let the Embodied Agent Efficiently Learn on Its Own was accepted as Oral by CoRL 2024.
[May. 2024] Our paper EfficientZero V2: Mastering Discrete and Continuous Control with Limited Data was accepted as Spotlight by ICML 2024.
[Mar. 2024] I embarked on my visiting scholar journey at Berkeley Artificial Intelligence Research (BAIR) under the expert guidance of Prof. Pieter Abbeel.

Selected Publications

CoRL

Reinforcement Learning with Foundation Priors: Let the Embodied Agent Efficiently Learn on Its Own

Weirui Ye, Yunsheng Zhang, Haoyang Weng, Xianfan Gu, Shengjie Wang, Tong Zhang, Mengchen Wang, Pieter Abbeel, Yang Gao

Conference on Robot Learning (CoRL), 2024.

PDF Code Website Oral, 4%

ICML

EfficientZero V2: Mastering Discrete and Continuous Control with Limited Data

Shengjie Wang*, Shaohuai Liu*, Weirui Ye*, Jiacheng You, Yang Gao (*equal contribution)

International Conference on Machine Learning (ICML), 2024.

PDF Code Spotlight, 3.5%

ICLR

Become a Proficient Player with Limited Data

Weirui Ye*, Yunsheng Zhang*, Pieter Abbeel, Yang Gao (*equal contribution)

International Conference on Learning Representations (ICLR), 2023.

PDF Code

NeurIPS

Spending Thinking Time Wisely: Accelerating MCTS with Virtual Expansions

Weirui Ye, Pieter Abbeel, Yang Gao

Conference on Neural Information Processing Systems(NeurIPS), 2022.

PDF

NeurIPS

Mastering Atari Games with Limited Data

Weirui Ye, Shaohuai Liu, Thanard Kurutach, Pieter Abbeel, Yang Gao

Conference on Neural Information Processing Systems(NeurIPS), 2021.

PDF Code Towards Data Science Interview Tsinghua News (Chinese) YouTube

Professional Services

Talk | Interview

Invited oral presentation at CoRL 2024.
Invited oral presentation at DAI 2023.

Reviewers | PC Member

Teaching Assitant

Computer Vision, Spring 2022. Instructor: Prof. Yang Gao

Student Counselor

Undergraduate Student Counselor (2022级本科生辅导员), Institute for Interdisciplinary Information Science, 2022-2025 (expected)

Selected Awards

National Scholarship (Top 1%), 2022
Good graduates of Tsinghua (Top 10%), 2020