Publications

VIMA: General Robot Manipulation with Multimodal Prompts
✨ Oral Presentation ✨. 1st NeurIPS Workshop on Foundation Models for Decision Making (FMDM), 2022
Yunfan Jiang, Agrim Gupta, Zichen Zhang, Guanzhi Wang, Yongqiang Dou, Yanjun Chen, Li Fei-Fei, Anima Anandkumar, Yuke Zhu, Linxi "Jim" Fan
Cite Project PDF Arxiv Twitter FMDM Workshop Code Models Benchmark Dataset
VIMA: General Robot Manipulation with Multimodal Prompts
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
💫✨ Outstanding Paper Award ✨💫. Neural Information Processing Systems (NeurIPS) Dataset & Benchmark, 2022
Linxi "Jim" Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu, Andrew Tang, De-An Huang, Yuke Zhu, Anima Anandkumar
Cite Project PDF Arxiv Twitter NeurIPS 2022 Code Models Database Blog TwoMinutePaper Video NeurIPS Interview MIT Tech Review Ars Technica
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Pre-Trained Language Models for Interactive Decision-Making
✨ Oral Presentation ✨. Neural Information Processing Systems (NeurIPS), 2022
Shuang Li, Xavier Puig, Chris Paxton, Yilun Du, Clinton Wang, Linxi "Jim" Fan, Tao Chen, De-An Huang, Ekin Akyürek, Anima Anandkumar, Jacob Andreas, Igor Mordatch, Antonio Torralba, Yuke Zhu
Cite Project PDF Arxiv NeurIPS 2022 Code
Pre-Trained Language Models for Interactive Decision-Making
MetaMorph: Learning Universal Controllers with Transformers
International Conference on Learning Representations (ICLR), 2022
Agrim Gupta, Linxi "Jim" Fan, Surya Ganguli, Li Fei-Fei
Cite Project PDF Arxiv ICLR 2022 Code Video
MetaMorph: Learning Universal Controllers with Transformers
Training and Deploying Visual Agents at Scale
My Stanford Ph.D. Thesis advised by Prof. Fei-Fei Li. 132 pages in total, enjoy!
Linxi "Jim" Fan
Cite PDF Stanford Library
Training and Deploying Visual Agents at Scale
SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies
International Conference on Machine Learning (ICML), 2021
Linxi "Jim" Fan, Guanzhi Wang, De-An Huang, Zhiding Yu, Li Fei-Fei, Yuke Zhu, Anima Anandkumar
Cite Project PDF Arxiv ICML 2021 Code Video
SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies
iGibson 1.0: A Simulation Environment for Interactive Tasks in Large Realistic Scenes
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
Bokui Shen, Fei Xia, Chengshu Li, Roberto Martín-Martín, Linxi "Jim" Fan, Guanzhi Wang, Claudia Pérez-D'Arpino, Shyamal Buch, Sanjana Srivastava, Lyne P. Tchapmi, Micael E. Tchapmi, Kent Vainio, Josiah Wong, Li Fei-Fei, Silvio Savarese
Cite Project PDF Arxiv IROS 2021 Code
iGibson 1.0: A Simulation Environment for Interactive Tasks in Large Realistic Scenes
RubiksNet: Learnable 3D-Shift for Efficient Video Action Recognition
European Conference on Computer Vision (ECCV), 2020
Linxi "Jim" Fan, Shyamal Buch, Guanzhi Wang, Ryan Cao, Yuke Zhu, Juan Carlos Niebles, Li Fei-Fei
Cite Project PDF ECCV 2020 Code Video
RubiksNet: Learnable 3D-Shift for Efficient Video Action Recognition
SURREAL-System: Fully-Integrated Stack for Distributed Deep Reinforcement Learning
Whitepaper for SURREAL Distributed RL Framework
Linxi "Jim" Fan, Yuke Zhu, Jiren Zhu, Orien Zeng, Anchit Gupta, Joan Creus-Costa, Silvio Savarese, Li Fei-Fei
Cite Project PDF Arxiv Code Video
SURREAL-System: Fully-Integrated Stack for Distributed Deep Reinforcement Learning
SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark
Conference on Robot Learning (CoRL), 2018
Linxi "Jim" Fan, Yuke Zhu, Jiren Zhu, Orien Zeng, Anchit Gupta, Joan Creus-Costa, Silvio Savarese, Li Fei-Fei
Cite Project PDF CoRL 2018 Code Video Stanford News
SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark
World of Bits: An Open-Domain Platform for Web-Based Agents
International Conference on Machine Learning (ICML), 2017
Tianlin Shi, Andrej Karpathy, Linxi "Jim" Fan, Jonathan Hernandez, Percy Liang
Cite Project PDF ICML 2017 Code Video
World of Bits: An Open-Domain Platform for Web-Based Agents
Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin
International Conference on Machine Learning (ICML), 2016
Baidu Silicon Valley AI Lab
Cite PDF Arxiv ICML 2016 MIT Tech Review TechCrunch Forbes NPR VentureBeat Mashable
Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin
Deconstructing the Ladder Network Architecture
International Conference on Machine Learning (ICML), 2016
Mohammad Pezeshki, Linxi "Jim" Fan, Philemon Brakel, Aaron Courville, Yoshua Bengio
Cite PDF Arxiv ICML 2016 Code
Deconstructing the Ladder Network Architecture
Kernel Approximation Methods for Speech Recognition
Journal of Machine Learning Research (JMLR), 2019
International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2016
Avner May, Alireza Bagheri Garakani, Zhiyun Lu, Dong Guo, Kuan Liu, Aurélien Bellet, Linxi "Jim" Fan, Michael Collins, Daniel Hsu, Brian Kingsbury, Michael Picheny, Fei Sha
Cite PDF Arxiv JMLR 2019 ICASSP 2016
Kernel Approximation Methods for Speech Recognition
Hybrid Ontology-Learning Materials Engineering System for Pharmaceutical Products
Computers & Chemical Engineering Journal, 2017
AIChE Annual Meeting, 2014
Miguel Francisco Remolona, Matthew Conway, Sriram Balasubramanian, Linxi "Jim" Fan, Ziyan Feng, Tianhao Gu, Hyungtae Kim, Prasad Nirantar, Sarah Panda, Nithin Ranabothu, Neha Rastogi, Venkat Venkatasubramanian
Cite PDF Journal AIChE 2014
Hybrid Ontology-Learning Materials Engineering System for Pharmaceutical Products