SuperSynthIA: Physics-Ready Full-Disk Vector Magnetograms from HMI, Hinode, and Machine Learning

1New York University, Courant Institute of Mathematical Sciences
2New York University, Tandon School of Engineering
3University of Michigan, Department of Electrical Engineering and Computer Science
4University of Michigan, Department of Climate and Space Sciences and Engineering
5NorthWest Research Associates
6Stanford University
7Heliophysics Science Division, NASA Goddard Space Flight Center
8University of Michigan, Department of Climate and Space, Center for Space Environment Modelling
The Astrophysical Journal, 2024

If you want to use SuperSynthIA data, please fill out the form here or click the Request Data button.

SuperSynthIA for 80 Days, starting 1 Feb 2016
Clockwise from top-left: flux density \( (\alpha B), \alpha B_{R}, \alpha B_{\theta}, \alpha B_{\varphi} \)

Check out the SuperSynthIA predictions of the May 2024 G5 solar storm!

SuperSynthIA's prediction of the G5 storm
09 May 2024 to 13 May 2024
Left: \(\text{AIA}~173\text{Å}\), Right: \(\alpha B_{R}\)
This is more than 2 years later than our training data cut-off.

Motivation

What are Solar vector magnetograms?
They are the map of magnetic field vectors on the Sun's surface.

Why are they important?
Solar vector magnetograms are crucial for understanding and predicting solar activity like solar flares and coronal mass ejections. These activities impact space weather, satellite operation, communication systems, and global power grids. SuperSynthIA advances our ability to monitor and understand solar activity.

Abstract

Vector magnetograms of the Sun's photosphere are cornerstones for much of solar physics research. These data are often produced by data-analysis pipelines combining per-pixel Stokes polarization vector inversion with a disambiguation that resolves an intrinsic 180-degree ambiguity. We introduce a learning-based method, SuperSynthIA, that produces full disk vector magnetograms from Stokes vector observations. As input, SuperSynthIA uses Stokes polarization images from SDO/HMI. As output, SuperSynthIA simultaneously emulates the inversion and disambiguation outputs from the Hinode/SOT-SP pipeline. Our method extends our previous approach SynthIA by providing direct heliographic outputs and using an improved dataset and inference method.

SuperSynthIA provides another tool for solar data analysis in the form of vector magnetograms resembling Hinode/SOT-SP but available across the full disk with SDO/HMI. Compared to our previous SynthIA, SuperSynthIA provides physically-ready vector magnetograms and mitigates unphysical angle preferences and banding artifacts in SynthIA. SuperSynthIA data are substantially more temporally consistent than those from the SDO/HMI pipeline, most notably seen in, e.g., evolving active regions. SuperSynthIA substantially reduces noise in low-signal areas, resulting in less center-to-limb bias outside of strong-signal areas. We show that outputs from SuperSynthIA track the SDO/HMI-recorded evolution of the magnetic field. We discuss the limitations of SuperSynthIA that the user must understand, and we demonstrate a broad set of evaluations to test SuperSynthIA and discuss remaining known artifacts. Our tests provide both methodology and evidence that SuperSynthIA outputs are ready for use by the community, and that learning-based approaches are suitable for physics-ready magnetograms.

Key Idea

MY ALT TEXT

Solar magnetic fields are estimated by observing polarized light and then applying optimization methods. Different instruments produce results with different tradeoffs. As inputs, SDO/HMI stoke vectors are captured as coherent full disk images with low-cadence while Hinode/SOT-SP captures a narrow field of view with high-cadence and more details. Given these two satellites with complementary missions that co-observe the sun for over a decade, we train networks to merge the strengths of both, providing physics ready vector magnetograms for downstream tasks.

Method

MY ALT TEXT

Illustration of model structure

SuperSynthIA uses a UNet + Regression-via-Classification with adaptive bin size to mitigate underestimation exhibited by common regression methods.

MY ALT TEXT

Mitigating unphysical preferences in azimuthal quantities using logit dithering

Logit Dithering adds noise to log-probabilities predicted by the model, which is used to resolve unphysical directional preference for the azimuth in quiet regions.

MY ALT TEXT

Comparison of two methods for obtaining \( \alpha B_R \) from SuperSynthIA

SuperSynthIA supports direct or analytic (calculated from \(\alpha B\), inclination, and azimuth) methods to produce disambiguated components (\( \alpha B_{R}, \alpha B_{\theta}, \alpha B_{\varphi} \)), enabling users to estimate these components in gravity frame or sky frame for different purposes.

Data

MY ALT TEXT

Data preparation process of SuperSynthIA

SuperSynthIA is trained on 13.4K aligned scans from decade of co-observation by full-disk, less accurate HMI and small field-of-view, but highly accurate Hinode/SOT-SP. These scans are aligned using SIFT + Optical Flow.

Results

SuperSynthIA versus Hinode pipeline in data coverage

The above video shows the comparison of coverage between Hinode /SOT-SP and SuperSynthIA. Hinode SOT-SP cannot provide full-disk high-cadence coverage of activity due to its limited field of view. SuperSynthIA predictions look like the Hinode pipeline, but with the cadence and coverage of HMI.

SuperSynthIA shows great temporal consistency compared to HMI pipeline with substantially fewer flickers during flux emergence. This flux emergence is a particularly tricky case for consistency because the underlying Milne Eddington assumption is not correct, leading to issues in the pipeline.

An example of great short-term consistency demonstrated by SuperSynthIA (AR 12567)

MY ALT TEXT

Number of flickering pixels as a function of threshold for flickers

SuperSynthIA performs well in polar regions with a better signal-to-noise ratio compared to the HMI pipeline, enabling the study of vector magnetogram at the solar poles.

SuperSynthIA \(B_{R}\) prediction of the polar region during the May 2024 G5 storm
Left: [-3000, 3000] color scale, Right: [-1000, 1000] color scale

Poster

BibTeX

@article{Wang_2024,
  doi = {10.3847/1538-4357/ad41e3},
  url = {https://dx.doi.org/10.3847/1538-4357/ad41e3},
  year = {2024},
  month = {jul},
  publisher = {The American Astronomical Society},
  volume = {970},
  number = {2},
  pages = {168},
  author = {Ruoyu Wang and David F. Fouhey and Richard E. L. Higgins and Spiro K. Antiochos and Graham Barnes and J. Todd Hoeksema and K. D. Leka and Yang Liu and Peter W. Schuck and Tamas I. Gombosi},
  title = {SuperSynthIA: Physics-ready Full-disk Vector Magnetograms from HMI, Hinode, and Machine Learning},
  journal = {The Astrophysical Journal}
  }

Acknowledgments

All SDO data used are publicly available from the Joint Science Operations Center (JSOC) at Stanford University supported by NASA Contract NAS5-02139 (HMI); see http://jsoc.stanford.edu/ ; which also supported J.T.H. and Y.L. Hinode is a Japanese mission developed and launched by ISAS/JAXA, with NAOJ as domestic partner and NASA and STFC (UK) as international partners. It is operated by these agencies in cooperation with ESA and NSC (Norway). After publication, data and models used will be archived and given Digital Object Identifiers (DOIs), and D.F. will be able to provide runs-on-request. This work was started under and partly supported by NASA grant 80NSSC20K0600 for the NASA Heliophysics DRIVE Science Center (SOLSTICE) at the University of Michigan. K.D.L. and G.B. acknowledge support from NASA/LWS-SC 80NSSC22K0892, and Lockheed-Martin Space Systems contract No. 4103056734 for Solar-B FPP Phase E. D.F., R.W., K.D.L., and G.B. acknowledge support from NASA award 80NSSC22K0646. D.F. and R.W. thank Michigan CSE Division and the University of Michigan Advanced Research Computing for continued HPC support. The authors thank David Orozco Suárez for thoughtful feedback that improved the paper.