Gait switching and targeted navigation of microswimmers via deep reinforcement learning

ORAL

Abstract

Swimming microorganisms switch between locomotory gaits to enable complex navigation strategies such as run-and-tumble to explore their environments and search for specific targets. This ability of targeted navigation via adaptive gait-switching is particularly desirable for the development of smart artificial microswimmers that can perform complex biomedical tasks such as targeted drug delivery and microsurgery in an autonomous manner. Here we use a deep reinforcement learning approach to enable a model microswimmer to self-learn effective locomotory gaits for translation, rotation and combined motions. The Artificial Intelligence (AI) powered swimmer can switch between various locomotory gaits adaptively to navigate towards target locations. The multimodal navigation strategy is reminiscent of gait-switching behaviors adopted by swimming microorganisms. We show that the strategy advised by AI is robust to flow perturbations and versatile in enabling the swimmer to perform complex tasks such as path tracing without being explicitly programmed. Taken together, our results demonstrate the vast potential of these AI-powered swimmers for applications in unpredictable, complex fluid environments.

*Funding support by the National Science Foundation (Grant Nos. 1830958 and 1931292 to O.S.P. and Grant Nos. 1614863 and 1951600 to Y.-N.Y.) is gratefully acknowledged. Y.-N.Y. acknowledges support from Flatiron Institute, part of Simons Foundation. A.C.H.T. acknowledges funding support from the Croucher Foundation.

Publication: https://doi.org/10.1038/s42005-022-00935-x

Presenters

  • Zonghao Zou

    • Santa Clara University

Authors

  • Zonghao Zou

    • Santa Clara University
  • Yuexin Liu

    • New Jersey Inst of Tech
  • Yuan-Nan Young

    • New Jersey Inst of Tech
  • On Shun Pak

    • Santa Clara University
  • Alan Cheng Hou Tsang

    • The University of Hong Kong