Validation Results

Summary: C3S v202012/v201912 vs ERA5 SMAP Period

  • Started validation on May 1, 2021, 3:58 p.m. UTC, finished on May 1, 2021, 8:55 p.m. UTC.
  • Compared 3 datasets:
    • Dataset 1: C3S (v202012, sm) [Filters: Variable in valid geophysical range; Data with no inconsistencies detected (flag = 0); ]
    • Dataset 2: C3S (v201912, sm) [Filters: Variable in valid geophysical range; Data with no inconsistencies detected (flag = 0); ]
    • Reference: ERA5 (v20190613, swvl1) [Filters: Soil not frozen; Variable in valid geophysical range; ]
  • Validated globally.
  • Validation period / temporal filter: April 1, 2015, midnight UTC to March 31, 2019, 11:59 p.m. UTC.
  • Validation metrics calculated from absolute values.
  • Triple collocation analysis was deactivated.
  • Scaling reference: ERA5 (v20190613, swvl1) [Filters: Soil not frozen; Variable in valid geophysical range; ]
  • Scaling method: Mean/standard deviation.
  • Processing took 297 minutes (wall time).
  • 0% (0 of 244450) of the processed locations (grid points) produced errors during calculation.
  • This result was published on zenodo with DOI 10.5281/zenodo.4736913.

Summary statistics

The mean, median and standard deviation are calculated on the validation results aggregated by metric and dataset. The reference dataset used is ERA5 (v20190613, swvl1).

Metric Mean Median IQ range Dataset
# observations 805.51 796. 569. All datasets
Bias (difference of means) [m³/m³] ~ 0 ~ 0 ~ 0 1-C3S (v202012)
Bias (difference of means) [m³/m³] ~ 0 ~ 0 ~ 0 2-C3S (v201912)
Mean square error [(m³/m³)²] 3.74e-03 2.84e-03 2.9e-03 2-C3S (v201912)
Mean square error [(m³/m³)²] 3.52e-03 2.61e-03 2.73e-03 1-C3S (v202012)
Mean square error bias [(m³/m³)²] ~ 0 ~ 0 ~ 0 2-C3S (v201912)
Mean square error bias [(m³/m³)²] ~ 0 ~ 0 ~ 0 1-C3S (v202012)
Mean square error correlation [(m³/m³)²] 3.74e-03 2.84e-03 2.9e-03 2-C3S (v201912)
Mean square error correlation [(m³/m³)²] 3.52e-03 2.61e-03 2.73e-03 1-C3S (v202012)
Mean square error variance [(m³/m³)²] ~ 0 ~ 0 ~ 0 2-C3S (v201912)
Mean square error variance [(m³/m³)²] ~ 0 ~ 0 ~ 0 1-C3S (v202012)
Pearson's r [-] 0.50 0.59 0.51 1-C3S (v202012)
Pearson's r [-] 0.47 0.56 0.53 2-C3S (v201912)
Pearson's r p-value [-] 3.44e-02 ~ 0 ~ 0 1-C3S (v202012)
Pearson's r p-value [-] 4.09e-02 ~ 0 ~ 0 2-C3S (v201912)
Residual sum of squares [(m³/m³)²] 2.60 2.29 2.14 2-C3S (v201912)
Residual sum of squares [(m³/m³)²] 2.43 2.11 2.01 1-C3S (v202012)
Root-mean-square deviation [m³/m³] 5.43e-02 5.11e-02 2.57e-02 1-C3S (v202012)
Root-mean-square deviation [m³/m³] 5.62e-02 5.32e-02 2.63e-02 2-C3S (v201912)
Spearman's rho [-] 0.45 0.52 0.55 2-C3S (v201912)
Spearman's rho [-] 0.49 0.55 0.51 1-C3S (v202012)
Spearman's rho p-value [-] 3.53e-02 ~ 0 ~ 0 1-C3S (v202012)
Spearman's rho p-value [-] 4.31e-02 ~ 0 1.41e-06 2-C3S (v201912)
Unbiased root-mean-square deviation [m³/m³] 5.43e-02 5.11e-02 2.57e-02 1-C3S (v202012)
Unbiased root-mean-square deviation [m³/m³] 5.62e-02 5.32e-02 2.63e-02 2-C3S (v201912)

Result files

#
Description goes here
#
Description goes here