Skip to main content

Strategy

Evaluate models and uncertainty

Evaluate software, accounting, historical comparison, external corroboration, sensitivity, uncertainty and reproducibility as distinct checks.

The proposal

Assess software, accounting, historical evidence, external corroboration, sensitivity, uncertainty and reproducibility separately; avoid reducing them to a single ‘model validated’ judgement.

How to read it

Sources identify relevant rights, methods, findings or precedents. They do not automatically establish the full World4Humans formulation. Where the project makes its own choice, that choice remains open to criticism and revision.

Sources and literature

Authority
World4Humans proposal informed by external precedents.
Relationship
Established methods or concepts are reused; the project-level combination remains a separate proposal.

Cited publications

  • Oreskes et al., 1994

    Oreskes, N., Shrader-Frechette, K. & Belitz, K. (1994), “Verification, validation, and confirmation of numerical models in the Earth sciences,” Science 263:641–646. DOI 10.1126/science.263.5147.641. https://pubmed.ncbi.nlm.nih.gov/17747657

  • Pianosi et al., 2016

    Pianosi, F., Beven, K., Freer, J. et al. (2016), “Sensitivity analysis of environmental models: A systematic review with practical workflow,” Environmental Modelling & Software 79:214–232. DOI 10.1016/j.envsoft.2016.02.008. https://doi.org/10.1016/J.ENVSOFT.2016.02.008

  • Helton & Davis, 2003

    Helton, J.C. & Davis, F.J. (2003), “Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems,” Reliability Engineering & System Safety 81:23–69. DOI 10.1016/S0951-8320(03)00058-9. https://www.sciencedirect.com/science/article/pii/S0951832003000589

  • Morris, 1991

    Morris, M.D. (1991), “Factorial Sampling Plans for Preliminary Computational Experiments,” Technometrics 33:161–174. DOI 10.1080/00401706.1991.10484804. https://www.stat.cmu.edu/technometrics/90-00/vol-33-02/v3302161.pdf

  • Mara & Tarantola, 2012

    Mara, T.A. & Tarantola, S. (2012), “Variance-based sensitivity indices for models with dependent inputs,” Reliability Engineering & System Safety 107:115–121. DOI 10.1016/j.ress.2011.08.008. https://www.sciencedirect.com/science/article/pii/S0951832011001724

  • Song et al., 2016

    Song, E., Nelson, B.L. & Staum, J. (2016), “Shapley Effects for Global Sensitivity Analysis: Theory and Computation,” SIAM/ASA Journal on Uncertainty Quantification 4:1060–1083. DOI 10.1137/15M1048070. https://users.iems.northwestern.edu/~nelsonb/Publications/SongNelsonStaum.pdf

  • Pianosi & Wagener, 2015

    Pianosi, F. & Wagener, T. (2015), “A simple and efficient method for global sensitivity analysis based on cumulative distribution functions,” Environmental Modelling & Software 67:1–11. DOI 10.1016/j.envsoft.2015.01.004. https://www.sciencedirect.com/science/article/pii/S1364815215000237

  • Kwakkel & Pruyt, 2013

    Kwakkel, J.H. & Pruyt, E. (2013), “Exploratory Modeling and Analysis, an approach for model-based foresight under deep uncertainty,” Technological Forecasting & Social Change 80:419–431. DOI 10.1016/j.techfore.2012.10.005. https://www.sciencedirect.com/science/article/pii/S0040162512002491

  • Kennedy & O’Hagan, 2001

    Kennedy, Marc & O’Hagan, Anthony (2001), “Bayesian Calibration of Computer Models.” JRSS B 63:425–464. DOI 10.1111/1467-9868.00294. https://doi.org/10.1111/1467-9868.00294

See verified sources

Related entries