Ofir Nachum

发表

DeepMDP: Learning Continuous Latent Space Models for Representation Learning pdf

Marc G. Bellemare, Ofir Nachum, Carles Gelada, 2019, ICML.

Data-Efficient Hierarchical Reinforcement Learning

Sergey Levine, Honglak Lee, Ofir Nachum, 2018, NeurIPS.

Learning to Remember Rare Events pdf

Aurko Roy, Samy Bengio, Lukasz Kaiser, 2017, ICLR.

Bridging the Gap Between Value and Policy Based Reinforcement Learning

Dale Schuurmans, Mohammad Norouzi, Kelvin Xu, 2017, NIPS.

Deep Reinforcement Learning for Vision-Based Robotic Grasping: A Simulated Comparative Evaluation of Off-Policy Methods

Sergey Levine, Chelsea Finn, Ofir Nachum, 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

ALGAE: Policy Gradient from Arbitrary Experience

D. Schuurmans, Ofir Nachum, Ilya Kostrikov, 2019 .

RL Unplugged: A Suite of Benchmarks for Ofﬂine Reinforcement Learning

Sergio Gomez Colmenarejo, Matthew W. Hoffman, Nando de Freitas, 2020 .

A Lyapunov-based Approach to Safe Reinforcement Learning

Ofir Nachum, Yinlam Chow, Mohammad Ghavamzadeh, 2018, NeurIPS.

The Laplacian in RL: Learning Representations with Efficient Approximations pdf

Yifan Wu, George Tucker, Ofir Nachum, 2018, ICLR.

Identifying and Correcting Label Bias in Machine Learning

Ofir Nachum, Heinrich Jiang, Ofir Nachum, 2019, AISTATS.

ERATING OFFLINE REINFORCEMENT LEARNING

S. Levine, Ofir Nachum, Aviral Kumar, 2021 .

RL Unplugged: Benchmarks for Offline Reinforcement Learning

Sergio Gomez Colmenarejo, Matthew W. Hoffman, T. Paine, 2020, ArXiv.

Benchmarks for Deep Off-Policy Evaluation pdf

Sergey Levine, Mohammad Norouzi, Justin Fu, 2021, ICLR.

Stochastic Learning of Additive Second-Order Penalties with Applications to Fairness

Yifan Wu, Ofir Nachum, Heinrich Jiang, 2018 .

P OLICY G RADIENTS I NCORPORATING THE F UTURE

Doina Precup, Ofir Nachum, David Venuto, 2022 .

The Laplacian in Reinforcement Learning: Representation Learning with Efficient Approximations

Yifan Wu, George Tucker, Ofir Nachum, 2019 .

BRPO: Batch Residual Policy Optimization

Craig Boutilier, Honglak Lee, Ofir Nachum, 2020, IJCAI.

ING VIA MODEL-BASED OFFLINE OPTIMIZATION

S. Gu, Ofir Nachum, Hiroki Furuta, 2021 .

A Mixture-of-Expert Approach to RL-based Dialogue Management

M. Ghavamzadeh, Craig Boutilier, Ofir Nachum, 2022, International Conference on Learning Representations.

Why Should I Trust You, Bellman? The Bellman Error is a Poor Replacement for Value Error

S. Gu, Doina Precup, Ofir Nachum, 2022, ICML.

Chain of Thought Imitation with Procedure Cloning

P. Abbeel, D. Schuurmans, Ofir Nachum, 2022, NeurIPS.

BRPO: Batch Residual Policy Optimization

Ed H. Chi, Craig Boutilier, Honglak Lee, 2020, International Joint Conference on Artificial Intelligence.

A Mixture-of-Expert Approach to RL-based Dialogue Management

M. Ghavamzadeh, Craig Boutilier, Ofir Nachum, 2022, ICLR.

Simulating self-assembly of nanoparticles in tumor environments

Ofir Nachum, 2014 .

Dichotomy of Control: Separating What You Can Control from What You Cannot

P. Abbeel, D. Schuurmans, Ofir Nachum, 2022, ICLR.

Multi-Game Decision Transformers

Ian S. Fischer, Eric Jang, Ofir Nachum, 2022, NeurIPS.

Understanding HTML with Large Language Models

Ofir Nachum, Sharan Narang, Yingjie Miao, 2022, EMNLP.

Contrastive Value Learning: Implicit Models for Simple Offline RL

Ofir Nachum, Benjamin Eysenbach, Jonathan Tompson, 2022, ArXiv.

Joint Representation Training in Sequential Tasks with Shared Structure

P. Bartlett, Ofir Nachum, Aldo Pacchiano, 2022, ArXiv.

RT-1: Robotics Transformer for Real-World Control at Scale

S. Levine, Vincent Vanhoucke, M. Ryoo, 2022, Robotics: Science and Systems.

Safe Policy Learning for Continuous Control

Aleksandra Faust, Ofir Nachum, Yinlam Chow, 2019, CoRL.

Multi-Environment Pretraining Enables Transfer to Action Limited Datasets

P. Abbeel, Doina Precup, Ofir Nachum, 2022, ICML.

Oracle Inequalities for Model Selection in Offline Reinforcement Learning

G. Tucker, Ofir Nachum, Bo Dai, 2022, NeurIPS.

Off-Policy Evaluation via the Regularized Lagrangian

Lihong Li, D. Schuurmans, Ofir Nachum, 2020, NeurIPS.

Imitation Learning via Off-Policy Distribution Matching pdf

Ilya Kostrikov, Jonathan Tompson, Ofir Nachum, 2019, ICLR.

Policy Gradients Incorporating the Future pdf

Doina Precup, Ofir Nachum, David Venuto, 2021, ICLR.

Deployment-Efficient Reinforcement Learning via Model-Based Offline Optimization pdf

Yutaka Matsuo, Tatsuya Matsushima, Ofir Nachum, 2020, ICLR.

TRAIL: Near-Optimal Imitation Learning with Suboptimal Data pdf

Sergey Levine, Ofir Nachum, Mengjiao Yang, 2021, ICLR.

Lyapunov-based Safe Policy Optimization for Continuous Control pdf

Mohammad Ghavamzadeh, Aleksandra Faust, Ofir Nachum, 2019, ArXiv.

Robustness Guarantees for Density Clustering

Ofir Nachum, Heinrich Jiang, Jennifer Jang, 2019, AISTATS.

Learning Universal Policies via Text-Guided Video Generation

P. Abbeel, J. Tenenbaum, D. Schuurmans, 2023, NeurIPS.

OPAL: Offline Primitive Discovery for Accelerating Offline Reinforcement Learning

S. Levine, Ofir Nachum, Aviral Kumar, 2020, ICLR.

Behavior Regularized Offline Reinforcement Learning pdf

Yifan Wu, George Tucker, Ofir Nachum, 2019, ArXiv.

Why Does Hierarchy (Sometimes) Work So Well in Reinforcement Learning?

S. Levine, S. Gu, Honglak Lee, 2019, ArXiv.

Offline Reinforcement Learning with Fisher Divergence Critic Regularization

Ilya Kostrikov, Jonathan Tompson, Rob Fergus, 2021, ICML.

D4RL: Datasets for Deep Data-Driven Reinforcement Learning pdf

Justin Fu, George Tucker, Ofir Nachum, 2020, ArXiv.

Foundation Models for Decision Making: Problems, Methods, and Opportunities

P. Abbeel, D. Schuurmans, Ofir Nachum, 2023, ArXiv.

Representation Matters: Offline Pretraining for Sequential Decision Making pdf

Ofir Nachum, Mengjiao Yang, Ofir Nachum, 2021, ICML.

Near-Optimal Representation Learning for Hierarchical Reinforcement Learning pdf

Sergey Levine, Honglak Lee, Ofir Nachum, 2018, ICLR.

Datasets for Data-Driven Reinforcement Learning

Justin Fu, George Tucker, Ofir Nachum, 2020 .

Policy Information Capacity: Information-Theoretic Measure for Task Complexity in Deep Reinforcement Learning

S. Levine, S. Gu, Ofir Nachum, 2021, ICML.

Provable Representation Learning for Imitation with Contrastive Fourier Features pdf

Ofir Nachum, Mengjiao Yang, Ofir Nachum, 2021, NeurIPS.

Improving Zero-shot Generalization in Offline Reinforcement Learning using Generalized Similarity Functions

Jonathan Tompson, Ofir Nachum, Bogdan Mazoure, 2021, NeurIPS.

PI-ARS: Accelerating Evolution-Learned Visual-Locomotion with Predictive Information Representations

Ofir Nachum, S. Guadarrama, Jie Tan, 2022, 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networks

Elad Eban, Edward Choi, Ofir Nachum, 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

Understanding HTML with Large Language Models

Ofir Nachum, Sharan Narang, Yingjie Miao, 2022, ArXiv.

Multi-Agent Manipulation via Locomotion using Hierarchical Sim2Real pdf

Vikash Kumar, Ofir Nachum, Hugo Ponte, 2019, CoRL.

Multimodal Web Navigation with Instruction-Finetuned Foundation Models

S. Gu, Ofir Nachum, Izzeddin Gur, 2023, ArXiv.

AlgaeDICE: Policy Gradient from Arbitrary Experience pdf

Ilya Kostrikov, Bo Dai, Lihong Li, 2019, ArXiv.

Path Consistency Learning in Tsallis Entropy Regularized MDPs pdf

Ofir Nachum, Yinlam Chow, Mohammad Ghavamzadeh, 2018, ICML.

CoinDICE: Off-Policy Confidence Interval Estimation pdf

Csaba Szepesvári, Bo Dai, Lihong Li, 2020, NeurIPS.

DualDICE: Behavior-Agnostic Estimation of Discounted Stationary Distribution Corrections

Bo Dai, Ofir Nachum, Yinlam Chow, 2019, NeurIPS.

Why So Pessimistic? Estimating Uncertainties for Offline RL through Ensembles, and Why Their Independence Matters

Seyed Kamyar Seyed Ghasemipour, S. Gu, Ofir Nachum, 2022, NeurIPS.

Improving Policy Gradient by Exploring Under-appreciated Rewards pdf

Dale Schuurmans, Mohammad Norouzi, Ofir Nachum, 2016, ICLR.

Trust-PCL: An Off-Policy Trust Region Method for Continuous Control pdf

Dale Schuurmans, Mohammad Norouzi, Kelvin Xu, 2017, ICLR.

Reinforcement Learning via Fenchel-Rockafellar Duality pdf

Bo Dai, Ofir Nachum, Ofir Nachum, 2020, ArXiv.

INSTRUCTION-FINETUNED FOUNDATION MODELS FOR MULTIMODAL WEB NAVIGATION

S. Gu, Ofir Nachum, Hiroki Furuta, 2023 .

Autoregressive Dynamics Models for Offline Policy Evaluation and Optimization pdf

Mohammad Norouzi, George Tucker, Ofir Nachum, 2021, ICLR.

Offline Policy Selection under Uncertainty pdf

Bo Dai, George Tucker, Ofir Nachum, 2020, AISTATS.

Statistical Bootstrapping for Uncertainty Estimation in Off-Policy Evaluation pdf

Ilya Kostrikov, Ofir Nachum, Ofir Nachum, 2020, ArXiv.

Barkour: Benchmarking Animal-level Agility with Quadruped Robots

Vincent Vanhoucke, R. Hadsell, N. Heess, 2023, ArXiv.

Learning to Remember Rare Events

Aurko Roy, Lukasz Kaiser, Samy Bengio, 2017, ICLR.

Model Selection in Batch Policy Optimization pdf

Bo Dai, George Tucker, Ofir Nachum, 2021, ICML.

Supervised Pretraining Can Learn In-Context Reinforcement Learning

Ofir Nachum, Chelsea Finn, A. Xie, 2023, NeurIPS.

Inverse Dynamics Pretraining Learns Good Representations for Multitask Imitation

Ofir Nachum, Joan Bruna, Ofir Nachum, 2023, ArXiv.

RT-1: Robotics Transformer for Real-World Control at Scale

Pannag R. Sanketi, S. Levine, Vincent Vanhoucke, 2022, Robotics: Science and Systems.

EARNING TO R EMEMBER R ARE E VENTS

Aurko Roy, Ofir Nachum, Łukasz Kaiser, 2017 .

Near Optimal Policy Optimization via REPS pdf

Ofir Nachum, Aldo Pacchiano, Jonathan Lee, 2021, NeurIPS.

Smoothed Action Value Functions for Learning Gaussian Policies

Dale Schuurmans, Mohammad Norouzi, George Tucker, 2018, ICML.

Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functions

S. Levine, Karol Hausman, Ofir Nachum, 2023, CoRL.

Inverse Dynamics Pretraining Learns Good Representations for Multitask Imitation

Ofir Nachum, Joan Bruna, David Brandfonbrener, 2023, NeurIPS.

DualDICE: Efficient Estimation of Off-Policy Stationary Distribution Corrections

Bo Dai, Ofir Nachum, Yinlam Chow, 2019 .

CoinDICE: Off-Policy Conﬁdence Interval Estimation

D. Schuurmans, Ofir Nachum, Yinlam Chow, 2022 .

Multimodal Web Navigation with Instruction-Finetuned Foundation Models

S. Gu, Ofir Nachum, Izzeddin Gur, 2023, ICLR.