Talks

Here are talks I gave, with links to slides and recordings if available, and for some even writeups of the discussions that followed. The list does not include conference presentations, which you will find next to their corresponding publications.

2024 ¶

• Between model-based and visuo-motor motion control
  Talk given for my Habilitation à diriger des recherches on 18 September 2024. (abstract)

  In this presentation, we first discuss the notion (desired, but undefined) of "stability" for robot locomotion. After some physics reminders on the zero-moment point (ZMP) and its corresponding support area, we see how these concepts generalize to systems that make multiple contacts with their environment. Teaser: the support areas become support volumes over more general quantities, prompting our interest into polyhedral projection. We review algorithms for it, including output-sensitive contour tracking and its lazy sibling output-sensitive ray casting.

• Some elements of model engineering for optimal control
  Talk given to the TUM School of Engineering and Design on 12 April 2024. (abstract)

  This survey presentation will cover three topics relevant to motion control and state observation: (1) Model reduction: how we can compute forward and reverse mappings between whole-body and reduced dynamic models, carrying both the equations of motion and system constraints. (2) Divergent components of motion: how the analysis of nonlinear systems can turn predictive control into linear feedback of virtual states, and how we can leverage this for hierarchical behaviors. (3) Trajectory optimization: a major item in the control toolbox, whose current limitations include feasibility, recursive feasibility, and real-time performance. We review new features brought by an upcoming generation of quadratic-programming and nonlinear solvers, including differentiable QP layers and constrained trajectory optimization.

2023 ¶

• Next iterations of quadratic programming for adaptive and robust motion control
  Talk given at the Humanoids 2023 workshop on Generalizable and Robust Decision Making, Planning, and Control for Humanoid Loco-Manipulation, 12 December 2023. (abstract)

  Convex quadratic programming (QP) has become a major item in the robotics toolbox, with well-known applications including whole-body control, model predictive control (MPC), contact planning and state estimation. Current challenges when solving QP-formulated problems include feasibility (ensuring that a solution exists, e.g. when some problem parameters come from measurements), recursive feasibility (in MPC: ensuring the system does not steer towards unfeasible problems) and real-time performance. In this talk, we review new features brought by an upcoming generation of QP solvers. We will focus in particular on ProxQP, which can handle non-convex or unfeasible problems and always returns a principled solution. We will further develop how this enables the inclusion of differentiable QP layers in end-to-end trainable control pipelines.

• Open source robots: to make, or not to make?
  Talk given at the Journées Nationales de la Robotique Humanoïde on 5 July 2023. (pdf) (abstract)

  This short presentation recalls the principles behind The Open Source Definition and discusses how we should adapt them to the more general context of open source robots. It is also an invitation to check out and update the Awesome Open Source Robots list, where we list robots and check the features that make them open source: license? Build instructions? Open source software?

2022 ¶

• Motion control software for homemade robots
  Talk given to the Artificial and Mechanical Intelligence lab on 6 December 2022. (pdf) (abstract)

  In this talk, we discuss some hardware and software practices to foster cross-lab developments in robotics. On the hardware side, we highlight the alternative made possible by recent innovations in actuators: building lighter robots of the kind that can (1) be made at home/with minimal equipment, and (2) bump, fall on, or be lifted by us with no harm. We'll discuss the example of Upkie as one instance of this template.

• Humanoid and wheeled-legged controllers in C++ and Python: balancing at different frequencies
  Talk given at the Humanoids 2022 Tutorial on Challenge-driven Learning of Humanoid Robot Control in Virtual Environments, 28 November 2022. (pdf) (abstract)

  The physics of a task dictate how fast a controller should run to perform it. Balancing, in particular, is a rather low-frequency task: it was demonstrated (in theory and on real hardware) that a DCM-based controller can balance an adult-size humanoid while running at only 10 Hz. In this talk, we will discuss how this property allows us to write more control-critical code in a high-level language like Python. We will illustrate our points with practical sub-modules from two controllers: the LIPM walking controller for HRP humanoids, implemented with mc_rtc, and the Pink controller for the Upkie wheeled-biped, implemented with Vulp (🦊).

• Motion control bits for homemade robots
  Talk given at LAAS-CNRS on 19 July 2022. (pdf) (abstract)

  Upkie prototype on stage, with a human commenting.

• Ideas and software for the locomotion of homemade robots
  Talk given at the R4 robotics working group on 20 June 2022. (pdf) (abstract)

  Moving away from big expensive robots to light homemade things (that can bump, fall on or be lifted by us with no harm) is a great way to revisit past design decisions and explore alternatives. Being incented to make robots cheaper, reduce their number of actuators and complexity, we end up with new morphologies that don't fit exactly the bill of previous ideas. Interesting things lie in this not exactly! In this presentation, we take a look at two existing ideas that are important in legged locomotion, contact stability and whole-body control, and see how they fit Upkie, a wheeled biped with a low-cost onboard computer. Another idea comes to the rescue: the theoretical and empirical evidence that balance control is a low-frequency task. We build open source software upon it that allows us to prototype most of our robot's brain in Python, while achieving its goals of balancing, crouching and going places.

2019 ¶

• Divergent components of motion
  Talk given at the CNRS-AIST Joint Robotics Laboratory (JRL) on 29 October 2019. (pdf) (abstract)

  Some nonlinear control systems admit an exponential dichotomy (Coppel, 1966), that is to say, their dynamics can be decomposed into (exponentially) stable and unstable components. Walking robots fall into this category, and we call their unstable components divergent components of motion (DCM). The concept of DCM has been fruitfully applied to the linear inverted pendulum (LIP) for both walking pattern generation and balance feedback control. But DCMs can be found for other models as well! In this talk, we will discuss DCMs for the variable-height inverted pendulum (VHIP), an extension of the LIP where the controller can add height variations. Ideally, we would like our robot to behave as a LIP (nominal height) unless some perturbation occurs and the robot resorts to the height-variation strategy, if it has to. Deciding when to use or not this strategy may seem "smart" or predictive, but we will see that it can be implemented straightforwardly as linear feedback over a 4D DCM.

• Walking and stair climbing controller for locomotion in an aircraft factory
  Talk given at DeepMind on 10 May 2019 and at the the NASA-Caltech Jet Propulsion Laboratory on 5 June 2019. (pdf) (abstract)

  The task was initially phrased for humans: go upstairs, walk into the aircraft, pick up the object and place it on the fuselage. Yet, repetition and the disposition of target locations turned out to cause chronic back pain, and the question of automation was raised: can a robot do that? In this talk, we will see how the HRP-4 humanoid can do that, and discuss the components we developed for the final demonstrator of the COMANOID project that ran at the Airbus Saint-Nazaire factory on 21 February 2019: self localization, locomotion, object localization and manipulation. We will focus on walking and stair climbing control. The audience is encouraged to bring plastic bottles.

• How do biped robots walk?
  Talk given at the Willow team seminar, Computer Science Department of the École Normale Supérieure de Paris (DI ENS), on 26 March 2019. (pdf) (abstract)

  In this introductory talk, we will see the general methods used nowadays to make humanoid robots walk or climb stairs. Predictive and feedback controls will be presented from a high-level perspective, with more videos than equations. At its end, our bird-eye trip will leave us with open questions, for instance: what is missing in our robots' brains today? The audience is encouraged to bring lightweight plastic bottles.

• Walking and stair climbing stabilization for position-controlled biped robots
  Talk given at Wandercraft on 19 March 2019. (pdf) (abstract)

  In this talk, we will see the walking and stair climbing stabilizer implemented on the HRP-4 humanoid robot as part of the final demonstrator for an Airbus manufacturing use case. Our solution is based on DCM feedback control, quadratic-programming wrench distribution and a whole-body admittance controller that combines three kinds of tasks: single-effector CoP control at each foot, multi-effector foot pressure control during double-support phases, and CoM admittance control.

2018 ¶

• Stair Climbing Stabilization of the HRP-4 Humanoid Robot
  Talk given at the CNRS-AIST Joint Robotics Laboratory (JRL) on 11 December 2018 and at the University of Tokyo on 14 December 2018. (pdf) (abstract)

  In this talk, we will discuss stair climbing experiments carried out with the HRP-4 humanoid as part of an Airbus manufacturing use case. Our solution is based on linear inverted pendulum tracking, quadratic-programming wrench distribution and a whole-body admittance controller that relies on both end-effector and CoM strategies. After presenting these components, we will open up the discussion on the interplay between end-effector and CoM strategies, as well as their potential applications in multi-contact.

• 3D Bipedal Walking including COM height variations
  Talk given at Nanyang Technological University on 14 May 2018 and at Queensland University of Technology on 29 May 2018. (pdf) (abstract)

  Real robots that walk in the field today rely on the Linear Inverted Pendulum Mode (LIPM) for walking control. Rigorously, the LIPM requires the robot's center-of-mass to lie in a plane, which is valid for walking on flat surfaces but becomes inexact over more general terrains. In this talk, we will see how to extend the LIPM to 3D walking, opening up old but refreshed questions on the analysis and control of bipeds. Technically, we will encounter a nonlinear control problem that we address by model predictive control of a quasi-convex optimization problem. We will see how the resulting controller works on the HRP-4 humanoid robot.

2017 ¶

• Pendular models for walking over rough terrains
  Talk given at the University of Rome "La Sapienza" on 19 October 2017, and at the Journées Nationales de la Robotique Humanoïde on 20 June 2017. (pdf) (abstract)

  The Newton-Euler equations that govern multi-body systems are not integrable in general. However, they become so in the pendular mode, a specific way of moving where conservation of the angular momentum is enforced. This property was successfully showcased for locomotion over horizontal floors (2D locomotion) by walking pattern generators based on the LIPM and CART-table models. In this talk, we will see how to generalize these two models to 3D locomotion while taking into account both friction and tilted contacts, resulting into the FIP (3D version of LIPM) and COM-accel (3D version of CART-table) models. We will demonstrate both approaches in live simulations with the HRP-4 humanoid model.

• Une histoire de la locomotion humanoïde : du sol plat au tout-terrain
  Talk given at SoftBank Robotics Europe on 8 March 2017. (pdf) (abstract)

  Cette présentation retrace les étapes importantes du développement des contrôleurs de marche pour les robots humanoïdes, depuis la démonstration publique du Honda P2 en 1997 jusqu'aux récents développements en marche tout-terrain. Elle n'aborde que des résultats partagés dans le monde ouvert, chaque slide étant associé à un article de recherche. La première partie revisite les concepts majeurs qui ont permis de résoudre la locomotion sur sol plat. La seconde décrit plusieurs développements récents en marche tout-terrain.

2016 ¶

• Time-Optimal Parameterization: a tool for Humanoid Motion Planning and Predictive Control
  Talk given at the Humanoids 2016 workshop on The use of dynamics in the field of humanoid robotics: identification, planning, perception and control, 15 November 2016. (abstract)

  Numerical optimization and dynamic models have given roboticists the tools to implement instantaneous whole-body control (e.g. finding joint torques at time t to track at best a reference trajectory). However, it provided no turnkey solution as to whole-body planning, where successful planners were historically grounded on stochastic sampling and state-space discretization rather than active sets and gradient descents. Yet, this does not mean that the two fields are hermetically separated. In this talk, we will go through the recent history of Time-Optimal Path Parameterization (TOPP), an optimization routine that has been successfully applied to both motion planning and predictive control. A key feature of TOPP is its ability to return not only optimal solutions for a given dynamic model, but also higher-level information such as intervals of reachable velocities. We will discuss these practicalities and show both simulation and real-hardware applications.

• Support Areas and Volumes for Humanoid Locomotion under Frictional Contacts
  Talk given at the Max Planck Institute for Intelligent Systems on 19 September 2016. (abstract)

  Humanoid locomotion on horizontal floors was solved by closing the feedback loop on the Zero-tiling Moment Point (ZMP), a measurable dynamic point that needs to stay inside the foot contact area to prevent the robot from falling (contact stability criterion). However, this criterion does not apply to general multi-contact settings, the "new frontier" in humanoid locomotion.

• ZMP support areas for multi-contact locomotion
  Talk given at the Journées Nationales de la Robotique Humanoïde on 23 June 2016. (pdf) (abstract)

  The Zero-tilting Moment Point (ZMP) and its support area are the two notions thanks to which roboticitsts solved the problem of walking on horizontal floor. Its historic definition presents two major limitations: all contacts between the robot and the environment need to be coplanar, and frictional effects (such as sliding or yaw rotations) are not taken into account. We present here a generalization of the ZMP "support area" that overcomes these two limitations. We show how to apply it with a linear-pendulum control law to generate stable multi-contact locomoting motions for humanoids in general environments.

• Perspectives on Motion Planning and Control for Humanoid Robots in Multi-contact Scenarios
  Talk given at Nanyang Technological University on 7 March 2016. (abstract)

  When today's robots move around, the motion that you observe is the result of two software stages: planning and control. Planning is the part that computes a trajectory from the initial state of the system to some goal state. Control is the part that deals with perturbations or modelling errors, and stabilizes the system at best while it performs the trajectory output by the planner.

2015 ¶

• Modèles simplifiés pour la locomotion des robots humanoïdes en terrain accidenté
  Présentation donnée à la Journée Francophone de la Recherche au Japon, Maison Franco-Japonaise de Tokyo, novembre 2015. (abstract)

  La robotique humanoïde distingue deux domaines : planification et locomotion. Tous deux servent le même objectif, qui est de permettre au robot de se déplacer d'un endroit à un autre. La locomotion repose sur des mouvements répétés (comme les pas d'une démarche) ou générés par des modèles simplifiés du robot (comme le pendule inversé, que nous allons voir). Elle nécessite généralement un sol plat ou peu accidenté. La planification fait moins d'hypothèses, ce qui la rend adaptée aux déplacements dans les environnements encombrés. Toutefois, elle nécessite d'avantage de calculs et a tendance à produire des mouvements peu naturels. Marcher en forêt relève par exemple de la locomotion, tandis qu'escalader une montagne relève de la planification.

2012 ¶

• Journal Club: "Continuous Inverse Optimal Control with Locally Optimal Examples"
  Talk given to the Journal Club of the Nakamura Laboratory, the University of Tokyo, Japan, on 31 October 2012. (abstract)

  This is a presentation I gave to the Journal Club of the Nakamura Laboratory while I was interning there, before my graduate studies. We discussed the the paper Continuous Inverse Optimal Control with Locally Optimal Examples by Levine and Koltun. It is a work in inverse optimal control, a.k.a. inverse reinforcement learning, which is the problem of deriving an unknown reward function from demonstrations of the optimal policy in a Markov decision process.