• Editors' Suggestion

Controlled gliding and perching through deep-reinforcement-learning

Guido Novati, L. Mahadevan, and Petros Koumoutsakos
Phys. Rev. Fluids 4, 093902 – Published 6 September 2019

Abstract

Controlled gliding is one of the most energetically efficient modes of transportation for natural and human powered fliers. Here we demonstrate that gliding and landing strategies with different optimality criteria can be identified through deep-reinforcement-learning without explicit knowledge of the underlying physics. We combine a two-dimensional model of a controlled elliptical body with deep-reinforcement-learning (D-RL) to achieve gliding with either minimum energy expenditure, or fastest time of arrival, at a predetermined location. In both cases the gliding trajectories are smooth, although energy/time optimal strategies are distinguished by small/high frequency actuations. We examine the effects of the ellipse's shape and weight on the optimal policies for controlled gliding. We find that the model-free reinforcement learning leads to more robust gliding than model-based optimal control strategies with a modest additional computational cost. We also demonstrate that the gliders with D-RL can generalize their strategies to reach the target location from previously unseen starting positions. The model-free character and robustness of D-RL suggests a promising framework for developing robotic devices capable of exploiting complex flow environments.

  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
3 More
  • Received 15 September 2018

DOI:https://doi.org/10.1103/PhysRevFluids.4.093902

©2019 American Physical Society

Physics Subject Headings (PhySH)

Nonlinear DynamicsFluid DynamicsInterdisciplinary Physics

Authors & Affiliations

Guido Novati1, L. Mahadevan2,3, and Petros Koumoutsakos1,*

  • 1Computational Science and Engineering Laboratory, Clausiusstrasse 33, ETH Zürich, CH-8092, Switzerland
  • 2John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts 02138, USA
  • 3Department of Organismic and Evolutionary Biology, Department of Physics, Harvard University, Cambridge, Massachusetts 02138, USA

  • *petros@ethz.ch

Article Text (Subscription Required)

Click to Expand

References (Subscription Required)

Click to Expand
Issue

Vol. 4, Iss. 9 — September 2019

Reuse & Permissions
Access Options
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review Fluids

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×