Robotics | Jim Fan

Eureka

GPT-4 writes reward functions to teach a 5-finger robot hand how to do extremely dexterous tasks like pen spinning.

VIMA

Multimodal LLM for robot manipulation; unifies diverse robotics tasks in a single prompting framework.

VIMA: General Robot Manipulation with Multimodal Prompts

✨ Oral Presentation ✨. 1st NeurIPS Workshop on Foundation Models for Decision Making (FMDM), 2022

Yunfan Jiang, Agrim Gupta, Zichen Zhang, Guanzhi Wang, Yongqiang Dou, Yanjun Chen, Li Fei-Fei, Anima Anandkumar, Yuke Zhu, Linxi "Jim" Fan

VIMA: General Robot Manipulation with Multimodal Prompts

MetaMorph

Learning universal controller over diverse morphologies with transformers

Mar 22, 2022

MetaMorph: Learning Universal Controllers with Transformers

International Conference on Learning Representations (ICLR), 2022

Agrim Gupta, Linxi "Jim" Fan, Surya Ganguli, Li Fei-Fei

MetaMorph: Learning Universal Controllers with Transformers

Training and Deploying Visual Agents at Scale

My Stanford Ph.D. Thesis advised by Prof. Fei-Fei Li. 132 pages in total, enjoy!

Linxi "Jim" Fan

Training and Deploying Visual Agents at Scale

SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies

International Conference on Machine Learning (ICML), 2021

Linxi "Jim" Fan, Guanzhi Wang, De-An Huang, Zhiding Yu, Li Fei-Fei, Yuke Zhu, Anima Anandkumar

SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies

iGibson 1.0: A Simulation Environment for Interactive Tasks in Large Realistic Scenes

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021

Bokui Shen, Fei Xia, Chengshu Li, Roberto Martín-Martín, Linxi "Jim" Fan, Guanzhi Wang, Claudia Pérez-D'Arpino, Shyamal Buch, Sanjana Srivastava, Lyne P. Tchapmi, Micael E. Tchapmi, Kent Vainio, Josiah Wong, Li Fei-Fei, Silvio Savarese

iGibson 1.0: A Simulation Environment for Interactive Tasks in Large Realistic Scenes

SURREAL-System: Fully-Integrated Stack for Distributed Deep Reinforcement Learning

Whitepaper for SURREAL Distributed RL Framework

Linxi "Jim" Fan, Yuke Zhu, Jiren Zhu, Orien Zeng, Anchit Gupta, Joan Creus-Costa, Silvio Savarese, Li Fei-Fei

SURREAL-System: Fully-Integrated Stack for Distributed Deep Reinforcement Learning

SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark

Conference on Robot Learning (CoRL), 2018

Linxi "Jim" Fan, Yuke Zhu, Jiren Zhu, Orien Zeng, Anchit Gupta, Joan Creus-Costa, Silvio Savarese, Li Fei-Fei

SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark