Vision Based Model Predictive Control

Vision Based Model Predictive Control Information Guide

1. Overview of Vision Based Model Predictive Control
2. Important Facts
3. Developments
4. Full Guide
5. Final Thoughts

Overview of Vision Based Model Predictive Control

Talk given by Yann LeCun at ETH Zürich during "Frontiers of Embodied AI". Supporting material for the ICRA 2017 paper: Precision manipulation ... Recordings of my talk at American Control Conference (ACC 2019) on Polytopic Tube Full Title: Tube-NeRF: Efficient Imitation Learning of Visuomotor Policies from Supplementary material of the paper "An Adaptive Neural- Vision-Based Non-Linear Model Predictive Control for Last-Mile Delivery Robot Local Motion Planning

Presentation for the IEEE International Conference on Robotics and Automation (ICRA) 2021. Paper available at: ...

Important Facts

Developments

A talk on Polytopic Tube MPC at ACC 2019, by Haimin Hu

A Model Predictive Control Approach for Vision-based Object Grasping via Mobile Manipulator

Tube-NeRF: Efficient Imitation Learning of Vision-based Policies from MPC

An Adaptive Neural-based Model Predictive Control Framework for Autonomous Aggressive Driving

Vision-Based Non-Linear Model Predictive Control for Last-Mile Delivery Robot Local Motion Planning

Model Predictive Control from Scratch: Derivation and Python Implementation-Optimal Control Tutorial

A Perception-Aware Flatness-based MPC for Fast Vision-based Flight

High-MPC: Learning High-Level Policies for Model Predictive Control (IROS 2020)

Constraint Handling in Continuous-Time DDP-Based Model Predictive Control (ICRA 2021 Presentation)

Full Guide

Data is compiled from public records and verified media reports.

Last Updated: June 12, 2026

Final Thoughts

Disclaimer: Disclaimer: Details estimates are based on publicly available data, media reports, and financial analysis. Actual numbers may vary.