On the use of physics in machine learning for imaging and quantifying complex processes

ORAL · Invited

Abstract

We discuss the use of machine learning kernels as regularizers in problems of quantitative imaging and estimation for complex processes. In such problems, the “image” is not a final goal; it is rather an intermediate step toward estimating parameter values.



Recently, we have investigated laser speckle as an encoder for dynamics of interacting particulates. For instance, we developed a real-time method, the Physics Enhanced Auto Correlation Estimator (Peace) [1] which explicitly maps the probability density function of particle sizes (also referred to as particle size distribution, PSD) to the intensity autocorrelation of the speckle. After recording the speckle and computing its autocorrelation, a machine learning-aided decoder returns the PSD. It is important to note that this is a far-field, or “non-imaging” method—the interpretation of speckle as an encoder obviates the need to image individual particles. Instead, the ensemble statistical properties are obtained directly from the autocorrelation.



In this talk, we will discuss more extensively the quantitative properties of dynamic Peace, i.e. when the particle size distribution itself is evolving due to chemical or mechanical interactions. We will also discuss some preliminary work on the application of quantitative speckle to two novel domains: scattering from biological cells and the phloem in plants. In both cases, the speckle is interpreted as an encoder of diffusion, transport and reactive processes. These may only be partially explained from first principles, whereas the constitutive relationships necessarily need to be derived from the data.



[1] Qihang Zhang, et al, Nature Comm. 14:1159, 2023.



* This research was funded by the National Research Foundation (NRF) of Singapore through the Intra-Create grant programme, grant no NRF2019-THE002-0006; and by Millennium Pharmaceuticals, Inc. (a subsidiary of Takeda Pharmaceuticals), grant No. D824/ MT15.

Publication: Qihang Zhang, et al, Nature Comm. 14:1159, 2023

Presenters

  • George Barbastathis

    MIT

Authors

  • George Barbastathis

    MIT

  • Qihang Zhang

    Singapore-MIT Alliance for Research and Technology Centre; present address: Tsinghua University

  • Richard D Braatz

    Massachusetts Institute of Technology MIT

  • Allan Myerson

    Massachusetts Institute of Technology

  • Charles Papageorgiou

    Takeda Pharmaceuticals

  • Wenlong Tang

    Takeda Pharmaceuticals

  • Yi Wei

    Massachusetts Institute of Technology

  • Neda Nazemifard

    Takeda Pharmaceuticals

  • Deborah Pereg

    Massachusetts Institute of Technology

  • Ajinkya Pandit

    Massachusetts Institute of Technology

  • Shashank Muddu

    Massachusetts Institute of Technology

  • Sandip Mondal

    Sinagpore-MIT Alliance for Research and Technology Centre

  • Daniel Roxby

    Singapore-MIT Alliance for Research and Technology Centre

  • Jongyoon Han

    Massachusetts Institute of Technology MIT