Validation Results

Summary: C3S PQAR v3.0 - v202012/v201912 vs ISMN 0-5cm

  • Started validation on April 28, 2021, 3:07 p.m. UTC, finished on April 28, 2021, 3:13 p.m. UTC.
  • Compared 3 datasets:
    • Dataset 1: C3S (v202012, sm) [Filters: Not freezing and no snow-cover (flag != 1); No dense vegetation (flag != 2); Variable in valid geophysical range; Data with no inconsistencies detected (flag = 0); ]
    • Dataset 2: C3S (v201912, sm) [Filters: Not freezing and no snow-cover (flag != 1); No dense vegetation (flag != 2); Variable in valid geophysical range; Data with no inconsistencies detected (flag = 0); ]
    • Reference: ISMN (20210131 global, soil_moisture) [Filters: Variable in valid geophysical range; Quality flag is "good" (G); Use measurements at given depth: 0,0.05; Use ISMN networks: CTP-SMTMN,MySMNet,LAB-net,BNZ-LTER,COSMOS,FLUXNET-AMERIFLUX,iRON,PBO-H2O,RISMA,SCAN,USCRN,OZNET,AMMA-CATCH,CARBOAFRICA,DAHRA,BIEBRZA-S-1,FMI,FR-Aqui,HOBE,REMEDHUS,RSMN,SMOSMANIA,TERENO,WEGENERNET,WSMN; ]
  • Validated globally.
  • Validation period / temporal filter: Nov. 1, 1978, midnight UTC to Dec. 31, 2019, 11:59 p.m. UTC.
  • Validation metrics calculated from absolute values.
  • Triple collocation analysis was deactivated.
  • Scaling reference: ISMN (20210131 global, soil_moisture) [Filters: Variable in valid geophysical range; Quality flag is "good" (G); Use measurements at given depth: 0,0.05; Use ISMN networks: CTP-SMTMN,MySMNet,LAB-net,BNZ-LTER,COSMOS,FLUXNET-AMERIFLUX,iRON,PBO-H2O,RISMA,SCAN,USCRN,OZNET,AMMA-CATCH,CARBOAFRICA,DAHRA,BIEBRZA-S-1,FMI,FR-Aqui,HOBE,REMEDHUS,RSMN,SMOSMANIA,TERENO,WEGENERNET,WSMN; ]
  • Scaling method: Mean/standard deviation.
  • Processing took 6 minutes (wall time).
  • 0% (0 of 746) of the processed locations (grid points) produced errors during calculation.
  • This result was published on zenodo with DOI 10.5281/zenodo.4736927.

Summary statistics

The mean, median and standard deviation are calculated on the validation results aggregated by metric and dataset. The reference dataset used is ISMN (20210131 global, soil_moisture).

Metric Mean Median IQ range Dataset
# observations 1399.3 1247.0 1070.0 All datasets
Bias (difference of means) [m³/m³] -9.96e-10 -1.06e-09 2.22e-08 1-C3S (v202012)
Spearman's rho [-] 4.98e-01 5.42e-01 3.40e-01 2-C3S (v201912)
Spearman's rho [-] 5.1e-01 5.57e-01 3.36e-01 1-C3S (v202012)
Spearman's rho p-value [-] 1.99e-02 0.e+00 3.83e-28 2-C3S (v201912)
Spearman's rho p-value [-] 1.83e-02 0.e+00 3.e-31 1-C3S (v202012)
Pearson's r p-value [-] 1.91e-02 0.e+00 1.51e-30 2-C3S (v201912)
Pearson's r p-value [-] 1.55e-02 0.e+00 7.55e-32 1-C3S (v202012)
Mean square error variance [(m³/m³)²] 9.83e-18 3.31e-18 1.04e-17 2-C3S (v201912)
Mean square error variance [(m³/m³)²] 9.95e-18 3.89e-18 1.09e-17 1-C3S (v202012)
Mean square error correlation [(m³/m³)²] 4.75e-03 3.75e-03 4.06e-03 2-C3S (v201912)
Unbiased root-mean-square deviation [m³/m³] 6.33e-02 6.03e-02 3.17e-02 1-C3S (v202012)
Mean square error correlation [(m³/m³)²] 4.61e-03 3.63e-03 3.9e-03 1-C3S (v202012)
Mean square error bias [(m³/m³)²] 5.50e-16 1.23e-16 4.29e-16 1-C3S (v202012)
Mean square error [(m³/m³)²] 4.75e-03 3.75e-03 4.06e-03 2-C3S (v201912)
Mean square error [(m³/m³)²] 4.61e-03 3.63e-03 3.9e-03 1-C3S (v202012)
Residual sum of squares [(m³/m³)²] 6.22e+00 4.25e+00 6.50e+00 2-C3S (v201912)
Residual sum of squares [(m³/m³)²] 6.02e+00 4.13e+00 6.22e+00 1-C3S (v202012)
Root-mean-square deviation [m³/m³] 6.42e-02 6.12e-02 3.26e-02 2-C3S (v201912)
Root-mean-square deviation [m³/m³] 6.33e-02 6.03e-02 3.17e-02 1-C3S (v202012)
Pearson's r [-] 5.02e-01 5.53e-01 3.38e-01 2-C3S (v201912)
Pearson's r [-] 5.15e-01 5.64e-01 3.27e-01 1-C3S (v202012)
Bias (difference of means) [m³/m³] -1.23e-09 -1.39e-09 2.17e-08 2-C3S (v201912)
Mean square error bias [(m³/m³)²] 4.73e-16 1.20e-16 4.27e-16 2-C3S (v201912)
Unbiased root-mean-square deviation [m³/m³] 6.42e-02 6.12e-02 3.26e-02 2-C3S (v201912)

Result files

#
Description goes here
#
Description goes here