Weather-related research often requires synthesizing vast amounts of data that need archival solutions that are both economical and viable during and past the lifetime of the project. Public cloud computing services (e.g., from Amazon, Microsoft, or Google) or private clouds managed by research institutions are providing object data storage systems appropriate for long-term archives of such large geophysical data sets. , Current Status:
Our research group no longer needs to maintain archives of High Resolution Rapid Refresh (HRRR) model output at the University of Utah since complete publicly-accessible archives of HRRR model output are now available from the Google Cloud Platform and Amazon Web Services (AWS) as part of the NOAA Open Data Program.
Google and AWS store the HRRR model output in GRIB2 format, a file type that efficiently stores hundreds of two-dimensional variable fields for a single valid time. Despite the highly compressible nature of GRIB2 files, they are often on the order of several hundred MB each, making high-volume input/output applications challenging due to the memory and compute resources needed to parse these files.
With support from the Amazon Sustainability Data Initiative, our group is now creating and maintaining HRRR model output in an optimized format, Zarr, in a publicly-accessible S3 bucket- hrrrzarr. HRRR-Zarr contains sets for each model run of analysis and forecast files sectioned into 96 small chunks for every variable. The structure of the HRRR-Zarr files are designed to allow users the flexibility to access only the data they need through selecting subdomains and parameters of interest without the overhead that comes from accessing numerous GRIB2 files.
, and
History:
This effort began in 2015 to illustrate the use of a private cloud object store developed by the Center for High Performance Computing (CHPC) at the University of Utah. We began archiving thousands of two-dimensional gridded fields (each one containing over 1.9 million values over the contiguous United States) from the High-Resolution Rapid Refresh (HRRR) data assimilation and forecast modeling system. The archive has been used for retrospective analyses of meteorological conditions during high-impact weather events, assessing the accuracy of the HRRR forecasts, and providing initial and boundary conditions for research simulations. The archive has been accessible interactively and through automated download procedures for researchers at other institutions that can be tailored by the user to extract individual two-dimensional grids from within the highly compressed files. Over a thousand users have voluntarily registered to use the HRRR archive at the University of Utah.
Our archive has grown to over 130 Tbytes of model output but we no longer need to continue that effort since the GRIB2 files are available now via Google and AWS. As mentioned above, we now provide much of the same information in an alternative format that is appropriate particularly for machine-learning applications.
: Forests play a major role in the global carbon cycle. Previous studies on the capacity of forests to sequester atmospheric CO2 have mostly focused on carbon uptake, but the roles of carbon turnover time and its spatiotemporal changes remain poorly understood. Here, we used long-term inventory data (1955-2018) from 695 mature forest plots to quantify temporal trends in living vegetation carbon turnover time across tropical, temperate, and cold climate zones, and compared plot data to eight Earth system models (ESMs). Long-term plots consistently showed decreases in living vegetation carbon turnover time, likely driven by increased tree mortality across all major climate zones. Changes in living vegetation carbon turnover time were negatively correlated with CO2 enrichment in both forest plot data and ESM simulations. However, plot-based correlations between living vegetation carbon turnover time and climate drivers such as precipitation and temperature diverged from those of ESM simulations. Our analyses suggest that forest carbon sinks are likely to be constrained by a decrease in living vegetation carbon turnover time, and accurate projections of forest carbon sink dynamics will require an improved representation of tree mortality processes and their sensitivity to climate in ESMs.
Thin boundary layer Arctic mixed-phase clouds are generally thought to precipitate pristine and aggregate ice crystals. Here we present automated surface photographic measurements showing that only 35\% of precipitation particles exhibit negligible riming and that graupel particles $\geq1\,\rm{mm}$ in diameter commonly fall from clouds with liquid water paths less than $50\,\rm{g\,m^{-2}}$. A simple analytical formulation predicts that significant riming enhancement can occur in updrafts with speeds typical of Arctic clouds, and observations show that such conditions are favored by weak temperature inversions and strong radiative cooling at cloud top. However, numerical simulations suggest that a mean updraft speed of $0.75\,\rm{m\,s^{-1}}$ would need to be sustained for over one hour. Graupel can efficiently remove moisture and aerosols from the boundary layer. The causes and impacts of Arctic riming enhancement remain to be determined.