Policy Learning

VIMA: General Robot Manipulation with Multimodal Prompts
✨ Oral Presentation ✨. 1st NeurIPS Workshop on Foundation Models for Decision Making (FMDM), 2022
Yunfan Jiang, Agrim Gupta, Zichen Zhang, Guanzhi Wang, Yongqiang Dou, Yanjun Chen, Li Fei-Fei, Anima Anandkumar, Yuke Zhu, Linxi "Jim" Fan
Cite Project PDF Arxiv Twitter FMDM Workshop Code Models Benchmark Dataset
VIMA: General Robot Manipulation with Multimodal Prompts
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
💫✨ Outstanding Paper Award ✨💫. Neural Information Processing Systems (NeurIPS) Dataset & Benchmark, 2022
Linxi "Jim" Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu, Andrew Tang, De-An Huang, Yuke Zhu, Anima Anandkumar
Cite Project PDF Arxiv Twitter NeurIPS 2022 Code Models Database Blog TwoMinutePaper Video NeurIPS Interview MIT Tech Review Ars Technica
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Pre-Trained Language Models for Interactive Decision-Making
✨ Oral Presentation ✨. Neural Information Processing Systems (NeurIPS), 2022
Shuang Li, Xavier Puig, Chris Paxton, Yilun Du, Clinton Wang, Linxi "Jim" Fan, Tao Chen, De-An Huang, Ekin Akyürek, Anima Anandkumar, Jacob Andreas, Igor Mordatch, Antonio Torralba, Yuke Zhu
Cite Project PDF Arxiv NeurIPS 2022 Code
Pre-Trained Language Models for Interactive Decision-Making
MetaMorph
Learning universal controller over diverse morphologies with transformers
Mar 22, 2022
Website Arxiv ICLR 2022 Code Video
MetaMorph
MetaMorph: Learning Universal Controllers with Transformers
International Conference on Learning Representations (ICLR), 2022
Agrim Gupta, Linxi "Jim" Fan, Surya Ganguli, Li Fei-Fei
Cite Project PDF Arxiv ICLR 2022 Code Video
MetaMorph: Learning Universal Controllers with Transformers
Training and Deploying Visual Agents at Scale
My Stanford Ph.D. thesis advised by Fei-Fei Li. Learn the rules like a pro, so you can break them like an artist — Picasso.
Sep 27, 2021
PDF SECANT iGibson SURREAL RubiksNet
Training and Deploying Visual Agents at Scale
Training and Deploying Visual Agents at Scale
My Stanford Ph.D. Thesis advised by Prof. Fei-Fei Li. 132 pages in total, enjoy!
Linxi "Jim" Fan
Cite PDF Stanford Library
Training and Deploying Visual Agents at Scale
SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies
International Conference on Machine Learning (ICML), 2021
Linxi "Jim" Fan, Guanzhi Wang, De-An Huang, Zhiding Yu, Li Fei-Fei, Yuke Zhu, Anima Anandkumar
Cite Project PDF Arxiv ICML 2021 Code Video
SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies
iGibson 1.0: A Simulation Environment for Interactive Tasks in Large Realistic Scenes
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
Bokui Shen, Fei Xia, Chengshu Li, Roberto Martín-Martín, Linxi "Jim" Fan, Guanzhi Wang, Claudia Pérez-D'Arpino, Shyamal Buch, Sanjana Srivastava, Lyne P. Tchapmi, Micael E. Tchapmi, Kent Vainio, Josiah Wong, Li Fei-Fei, Silvio Savarese
Cite Project PDF Arxiv IROS 2021 Code
iGibson 1.0: A Simulation Environment for Interactive Tasks in Large Realistic Scenes
SURREAL-System: Fully-Integrated Stack for Distributed Deep Reinforcement Learning
Whitepaper for SURREAL Distributed RL Framework
Linxi "Jim" Fan, Yuke Zhu, Jiren Zhu, Orien Zeng, Anchit Gupta, Joan Creus-Costa, Silvio Savarese, Li Fei-Fei
Cite Project PDF Arxiv Code Video
SURREAL-System: Fully-Integrated Stack for Distributed Deep Reinforcement Learning