Finding Transient Artifacts with Deep Learning in the Dark Energy Survey

ORAL

Abstract

Cosmological surveys increasingly rely on deeper astronomical imaging, including tens to hundreds of single-epoch images in coadds. These images contain many non-cosmological transient artifacts, such as cosmic rays, satellites, and asteroids, which can hinder astronomers' ability to accurately infer a representative cosmological object sample. The Dark Energy Survey (DES) Year 3 results relied on manual visual inspection by volunteers of all deep field coadd images to detect and mask residual transient artifacts. As the quantity of data of cosmological surveys increase, machine learning techniques provide an opportunity to supplement and assist these time-consuming stages of data processing. Through the utilization of deep learning architectures trained on DES deep field image data masked by volunteers, we develop methods for both patch-based classification and direct localized detection of transient artifacts. We find the artifact detection labels by volunteers to have a number of errors, so we introduce a human-in-the-loop relabeling step to correct these mislabels. The models reach high levels of precision and recall and show promising use for automated artifact detection in DES Year 6 deep coadd image stacks and other cosmological surveys.

–

Authors

  • Pavani Jairam

    Duke University

  • Abdul Qadeer Rehan

    University of Tennessee, University of York, Old Dominion University, Massachusetts Institute of Technology, Old Dominion University, Massachusetts Institute of Technology, Lawrence Berkeley National Laboratory, University of California, Berkeley, Institute of Physics - University of Sao Paulo, Naval Research Laboratory, St. Cloud State University, University of Illinois at Urbana-Champaign, Space Sciences Laboratory, Virginia Polytechnic Institute and State University, Space Sciences Laboratory, University of California Berkeley, University of Maryland - Baltimore County, Sandia National Laboratories, Pacific Northwest National Laboratory, Federal University of Bahia; University of Brasília, Federal University of Bahia, Department of Applied Physics, Yale University & Department of Physics, Yale University, Theoretical Division and Center for Nonlinear Studies, Los Alamos National Laboratory, Department of Physics, University of Illinois at Urbana-Champaign & Current affiliation: Seagate Research Group, Seagate Technology, Department of Physics and Astronomy, Wayne State University, Department of Physics, University of Illinois at Urbana-Champaign, Department of Applied Physics, Yale University, Swarthmore College, Western Washington University, Departments of Chemistry and Physics and The Baruch 60 Center for Biochemical Solar Energy Research at Rensselaer Polytechnic Institute, University of Florida, Wayne State University, Vanderbilt University, University of Maryland, College Park, NASA GSFC, CfA, California Institute of Technology, Skidmore College, Durham University, University of Alberta, University of Michigan, Curtin University, Michigan State University, University of Nevada, University of Chicago, Duke University, Cornell, Pennsylvania State University, New York University Abu Dhabi, NASA Ames Research Center, Kenyon Coll, Kenyon College, University of Texas at Austin, Flatiron Institute, University of California, Los Angeles, Ohio State University, University of Pennsylvania, HERA, HERA, Rochester Institute of Technology, Howard Community College, Carleton College, California State University at Long Beach, Bishop Ireton High School, Fayetteville State University, Univ of Oklahoma, University of Massachusetts Amherst, Carnegie Observatories, San Diego State University, Associate of the National Institute of Standards and Technology, National Institute of Standards and Technology, NTT Basic Research Laboratories and NTT Research Center for Theoretical Quantum Physics, JILA, University of Colorado, 440 UCB, Boulder, CO, Department of Physics, 390 UCB University of Colorado, University of Washington, James Franck Institute, Enrico Fermi Institute, University of Chicago Department of Physics, Princeton University, Department of Physics, Arizona State University, Indiana Univ - Bloomington, National Autonomous University of Mexico, Harvard University, Nagoya University, Toyota Technological Institute, University of Tokyo, Zhejiang University, Clark University, Natl Univ of Singapore, University of Richmond

  • Abdul Qadeer Rehan

    University of Tennessee, University of York, Old Dominion University, Massachusetts Institute of Technology, Old Dominion University, Massachusetts Institute of Technology, Lawrence Berkeley National Laboratory, University of California, Berkeley, Institute of Physics - University of Sao Paulo, Naval Research Laboratory, St. Cloud State University, University of Illinois at Urbana-Champaign, Space Sciences Laboratory, Virginia Polytechnic Institute and State University, Space Sciences Laboratory, University of California Berkeley, University of Maryland - Baltimore County, Sandia National Laboratories, Pacific Northwest National Laboratory, Federal University of Bahia; University of Brasília, Federal University of Bahia, Department of Applied Physics, Yale University & Department of Physics, Yale University, Theoretical Division and Center for Nonlinear Studies, Los Alamos National Laboratory, Department of Physics, University of Illinois at Urbana-Champaign & Current affiliation: Seagate Research Group, Seagate Technology, Department of Physics and Astronomy, Wayne State University, Department of Physics, University of Illinois at Urbana-Champaign, Department of Applied Physics, Yale University, Swarthmore College, Western Washington University, Departments of Chemistry and Physics and The Baruch 60 Center for Biochemical Solar Energy Research at Rensselaer Polytechnic Institute, University of Florida, Wayne State University, Vanderbilt University, University of Maryland, College Park, NASA GSFC, CfA, California Institute of Technology, Skidmore College, Durham University, University of Alberta, University of Michigan, Curtin University, Michigan State University, University of Nevada, University of Chicago, Duke University, Cornell, Pennsylvania State University, New York University Abu Dhabi, NASA Ames Research Center, Kenyon Coll, Kenyon College, University of Texas at Austin, Flatiron Institute, University of California, Los Angeles, Ohio State University, University of Pennsylvania, HERA, HERA, Rochester Institute of Technology, Howard Community College, Carleton College, California State University at Long Beach, Bishop Ireton High School, Fayetteville State University, Univ of Oklahoma, University of Massachusetts Amherst, Carnegie Observatories, San Diego State University, Associate of the National Institute of Standards and Technology, National Institute of Standards and Technology, NTT Basic Research Laboratories and NTT Research Center for Theoretical Quantum Physics, JILA, University of Colorado, 440 UCB, Boulder, CO, Department of Physics, 390 UCB University of Colorado, University of Washington, James Franck Institute, Enrico Fermi Institute, University of Chicago Department of Physics, Princeton University, Department of Physics, Arizona State University, Indiana Univ - Bloomington, National Autonomous University of Mexico, Harvard University, Nagoya University, Toyota Technological Institute, University of Tokyo, Zhejiang University, Clark University, Natl Univ of Singapore, University of Richmond

  • Abdul Qadeer Rehan

    University of Tennessee, University of York, Old Dominion University, Massachusetts Institute of Technology, Old Dominion University, Massachusetts Institute of Technology, Lawrence Berkeley National Laboratory, University of California, Berkeley, Institute of Physics - University of Sao Paulo, Naval Research Laboratory, St. Cloud State University, University of Illinois at Urbana-Champaign, Space Sciences Laboratory, Virginia Polytechnic Institute and State University, Space Sciences Laboratory, University of California Berkeley, University of Maryland - Baltimore County, Sandia National Laboratories, Pacific Northwest National Laboratory, Federal University of Bahia; University of Brasília, Federal University of Bahia, Department of Applied Physics, Yale University & Department of Physics, Yale University, Theoretical Division and Center for Nonlinear Studies, Los Alamos National Laboratory, Department of Physics, University of Illinois at Urbana-Champaign & Current affiliation: Seagate Research Group, Seagate Technology, Department of Physics and Astronomy, Wayne State University, Department of Physics, University of Illinois at Urbana-Champaign, Department of Applied Physics, Yale University, Swarthmore College, Western Washington University, Departments of Chemistry and Physics and The Baruch 60 Center for Biochemical Solar Energy Research at Rensselaer Polytechnic Institute, University of Florida, Wayne State University, Vanderbilt University, University of Maryland, College Park, NASA GSFC, CfA, California Institute of Technology, Skidmore College, Durham University, University of Alberta, University of Michigan, Curtin University, Michigan State University, University of Nevada, University of Chicago, Duke University, Cornell, Pennsylvania State University, New York University Abu Dhabi, NASA Ames Research Center, Kenyon Coll, Kenyon College, University of Texas at Austin, Flatiron Institute, University of California, Los Angeles, Ohio State University, University of Pennsylvania, HERA, HERA, Rochester Institute of Technology, Howard Community College, Carleton College, California State University at Long Beach, Bishop Ireton High School, Fayetteville State University, Univ of Oklahoma, University of Massachusetts Amherst, Carnegie Observatories, San Diego State University, Associate of the National Institute of Standards and Technology, National Institute of Standards and Technology, NTT Basic Research Laboratories and NTT Research Center for Theoretical Quantum Physics, JILA, University of Colorado, 440 UCB, Boulder, CO, Department of Physics, 390 UCB University of Colorado, University of Washington, James Franck Institute, Enrico Fermi Institute, University of Chicago Department of Physics, Princeton University, Department of Physics, Arizona State University, Indiana Univ - Bloomington, National Autonomous University of Mexico, Harvard University, Nagoya University, Toyota Technological Institute, University of Tokyo, Zhejiang University, Clark University, Natl Univ of Singapore, University of Richmond

  • Abdul Qadeer Rehan

    University of Tennessee, University of York, Old Dominion University, Massachusetts Institute of Technology, Old Dominion University, Massachusetts Institute of Technology, Lawrence Berkeley National Laboratory, University of California, Berkeley, Institute of Physics - University of Sao Paulo, Naval Research Laboratory, St. Cloud State University, University of Illinois at Urbana-Champaign, Space Sciences Laboratory, Virginia Polytechnic Institute and State University, Space Sciences Laboratory, University of California Berkeley, University of Maryland - Baltimore County, Sandia National Laboratories, Pacific Northwest National Laboratory, Federal University of Bahia; University of Brasília, Federal University of Bahia, Department of Applied Physics, Yale University & Department of Physics, Yale University, Theoretical Division and Center for Nonlinear Studies, Los Alamos National Laboratory, Department of Physics, University of Illinois at Urbana-Champaign & Current affiliation: Seagate Research Group, Seagate Technology, Department of Physics and Astronomy, Wayne State University, Department of Physics, University of Illinois at Urbana-Champaign, Department of Applied Physics, Yale University, Swarthmore College, Western Washington University, Departments of Chemistry and Physics and The Baruch 60 Center for Biochemical Solar Energy Research at Rensselaer Polytechnic Institute, University of Florida, Wayne State University, Vanderbilt University, University of Maryland, College Park, NASA GSFC, CfA, California Institute of Technology, Skidmore College, Durham University, University of Alberta, University of Michigan, Curtin University, Michigan State University, University of Nevada, University of Chicago, Duke University, Cornell, Pennsylvania State University, New York University Abu Dhabi, NASA Ames Research Center, Kenyon Coll, Kenyon College, University of Texas at Austin, Flatiron Institute, University of California, Los Angeles, Ohio State University, University of Pennsylvania, HERA, HERA, Rochester Institute of Technology, Howard Community College, Carleton College, California State University at Long Beach, Bishop Ireton High School, Fayetteville State University, Univ of Oklahoma, University of Massachusetts Amherst, Carnegie Observatories, San Diego State University, Associate of the National Institute of Standards and Technology, National Institute of Standards and Technology, NTT Basic Research Laboratories and NTT Research Center for Theoretical Quantum Physics, JILA, University of Colorado, 440 UCB, Boulder, CO, Department of Physics, 390 UCB University of Colorado, University of Washington, James Franck Institute, Enrico Fermi Institute, University of Chicago Department of Physics, Princeton University, Department of Physics, Arizona State University, Indiana Univ - Bloomington, National Autonomous University of Mexico, Harvard University, Nagoya University, Toyota Technological Institute, University of Tokyo, Zhejiang University, Clark University, Natl Univ of Singapore, University of Richmond

  • Abdul Qadeer Rehan

    University of Tennessee, University of York, Old Dominion University, Massachusetts Institute of Technology, Old Dominion University, Massachusetts Institute of Technology, Lawrence Berkeley National Laboratory, University of California, Berkeley, Institute of Physics - University of Sao Paulo, Naval Research Laboratory, St. Cloud State University, University of Illinois at Urbana-Champaign, Space Sciences Laboratory, Virginia Polytechnic Institute and State University, Space Sciences Laboratory, University of California Berkeley, University of Maryland - Baltimore County, Sandia National Laboratories, Pacific Northwest National Laboratory, Federal University of Bahia; University of Brasília, Federal University of Bahia, Department of Applied Physics, Yale University & Department of Physics, Yale University, Theoretical Division and Center for Nonlinear Studies, Los Alamos National Laboratory, Department of Physics, University of Illinois at Urbana-Champaign & Current affiliation: Seagate Research Group, Seagate Technology, Department of Physics and Astronomy, Wayne State University, Department of Physics, University of Illinois at Urbana-Champaign, Department of Applied Physics, Yale University, Swarthmore College, Western Washington University, Departments of Chemistry and Physics and The Baruch 60 Center for Biochemical Solar Energy Research at Rensselaer Polytechnic Institute, University of Florida, Wayne State University, Vanderbilt University, University of Maryland, College Park, NASA GSFC, CfA, California Institute of Technology, Skidmore College, Durham University, University of Alberta, University of Michigan, Curtin University, Michigan State University, University of Nevada, University of Chicago, Duke University, Cornell, Pennsylvania State University, New York University Abu Dhabi, NASA Ames Research Center, Kenyon Coll, Kenyon College, University of Texas at Austin, Flatiron Institute, University of California, Los Angeles, Ohio State University, University of Pennsylvania, HERA, HERA, Rochester Institute of Technology, Howard Community College, Carleton College, California State University at Long Beach, Bishop Ireton High School, Fayetteville State University, Univ of Oklahoma, University of Massachusetts Amherst, Carnegie Observatories, San Diego State University, Associate of the National Institute of Standards and Technology, National Institute of Standards and Technology, NTT Basic Research Laboratories and NTT Research Center for Theoretical Quantum Physics, JILA, University of Colorado, 440 UCB, Boulder, CO, Department of Physics, 390 UCB University of Colorado, University of Washington, James Franck Institute, Enrico Fermi Institute, University of Chicago Department of Physics, Princeton University, Department of Physics, Arizona State University, Indiana Univ - Bloomington, National Autonomous University of Mexico, Harvard University, Nagoya University, Toyota Technological Institute, University of Tokyo, Zhejiang University, Clark University, Natl Univ of Singapore, University of Richmond

  • Abdul Qadeer Rehan

    University of Tennessee, University of York, Old Dominion University, Massachusetts Institute of Technology, Old Dominion University, Massachusetts Institute of Technology, Lawrence Berkeley National Laboratory, University of California, Berkeley, Institute of Physics - University of Sao Paulo, Naval Research Laboratory, St. Cloud State University, University of Illinois at Urbana-Champaign, Space Sciences Laboratory, Virginia Polytechnic Institute and State University, Space Sciences Laboratory, University of California Berkeley, University of Maryland - Baltimore County, Sandia National Laboratories, Pacific Northwest National Laboratory, Federal University of Bahia; University of Brasília, Federal University of Bahia, Department of Applied Physics, Yale University & Department of Physics, Yale University, Theoretical Division and Center for Nonlinear Studies, Los Alamos National Laboratory, Department of Physics, University of Illinois at Urbana-Champaign & Current affiliation: Seagate Research Group, Seagate Technology, Department of Physics and Astronomy, Wayne State University, Department of Physics, University of Illinois at Urbana-Champaign, Department of Applied Physics, Yale University, Swarthmore College, Western Washington University, Departments of Chemistry and Physics and The Baruch 60 Center for Biochemical Solar Energy Research at Rensselaer Polytechnic Institute, University of Florida, Wayne State University, Vanderbilt University, University of Maryland, College Park, NASA GSFC, CfA, California Institute of Technology, Skidmore College, Durham University, University of Alberta, University of Michigan, Curtin University, Michigan State University, University of Nevada, University of Chicago, Duke University, Cornell, Pennsylvania State University, New York University Abu Dhabi, NASA Ames Research Center, Kenyon Coll, Kenyon College, University of Texas at Austin, Flatiron Institute, University of California, Los Angeles, Ohio State University, University of Pennsylvania, HERA, HERA, Rochester Institute of Technology, Howard Community College, Carleton College, California State University at Long Beach, Bishop Ireton High School, Fayetteville State University, Univ of Oklahoma, University of Massachusetts Amherst, Carnegie Observatories, San Diego State University, Associate of the National Institute of Standards and Technology, National Institute of Standards and Technology, NTT Basic Research Laboratories and NTT Research Center for Theoretical Quantum Physics, JILA, University of Colorado, 440 UCB, Boulder, CO, Department of Physics, 390 UCB University of Colorado, University of Washington, James Franck Institute, Enrico Fermi Institute, University of Chicago Department of Physics, Princeton University, Department of Physics, Arizona State University, Indiana Univ - Bloomington, National Autonomous University of Mexico, Harvard University, Nagoya University, Toyota Technological Institute, University of Tokyo, Zhejiang University, Clark University, Natl Univ of Singapore, University of Richmond

  • Abdul Qadeer Rehan

    University of Tennessee, University of York, Old Dominion University, Massachusetts Institute of Technology, Old Dominion University, Massachusetts Institute of Technology, Lawrence Berkeley National Laboratory, University of California, Berkeley, Institute of Physics - University of Sao Paulo, Naval Research Laboratory, St. Cloud State University, University of Illinois at Urbana-Champaign, Space Sciences Laboratory, Virginia Polytechnic Institute and State University, Space Sciences Laboratory, University of California Berkeley, University of Maryland - Baltimore County, Sandia National Laboratories, Pacific Northwest National Laboratory, Federal University of Bahia; University of Brasília, Federal University of Bahia, Department of Applied Physics, Yale University & Department of Physics, Yale University, Theoretical Division and Center for Nonlinear Studies, Los Alamos National Laboratory, Department of Physics, University of Illinois at Urbana-Champaign & Current affiliation: Seagate Research Group, Seagate Technology, Department of Physics and Astronomy, Wayne State University, Department of Physics, University of Illinois at Urbana-Champaign, Department of Applied Physics, Yale University, Swarthmore College, Western Washington University, Departments of Chemistry and Physics and The Baruch 60 Center for Biochemical Solar Energy Research at Rensselaer Polytechnic Institute, University of Florida, Wayne State University, Vanderbilt University, University of Maryland, College Park, NASA GSFC, CfA, California Institute of Technology, Skidmore College, Durham University, University of Alberta, University of Michigan, Curtin University, Michigan State University, University of Nevada, University of Chicago, Duke University, Cornell, Pennsylvania State University, New York University Abu Dhabi, NASA Ames Research Center, Kenyon Coll, Kenyon College, University of Texas at Austin, Flatiron Institute, University of California, Los Angeles, Ohio State University, University of Pennsylvania, HERA, HERA, Rochester Institute of Technology, Howard Community College, Carleton College, California State University at Long Beach, Bishop Ireton High School, Fayetteville State University, Univ of Oklahoma, University of Massachusetts Amherst, Carnegie Observatories, San Diego State University, Associate of the National Institute of Standards and Technology, National Institute of Standards and Technology, NTT Basic Research Laboratories and NTT Research Center for Theoretical Quantum Physics, JILA, University of Colorado, 440 UCB, Boulder, CO, Department of Physics, 390 UCB University of Colorado, University of Washington, James Franck Institute, Enrico Fermi Institute, University of Chicago Department of Physics, Princeton University, Department of Physics, Arizona State University, Indiana Univ - Bloomington, National Autonomous University of Mexico, Harvard University, Nagoya University, Toyota Technological Institute, University of Tokyo, Zhejiang University, Clark University, Natl Univ of Singapore, University of Richmond