To discuss initiatives to further model comparison, documentation, reproduction, checking, validation etc. especially when in a policy context. Conference website at: https://ssc2021.uek.krakow.pl/ (registration necessary, but I think there will be no fees). All welcome to this online event.
This paper that defines four levels of reproducibility, suggesting criteria to help you decide which level your research software should be at, and recommending practices to reach these levels of reproducibility. https://zenodo.org/record/4761867
Thee House of Commons Science and Technology Committee has published its first report on the use of scientific advice to government in the COVID19 crisis (https://committees.parliament.uk/committee/135/science-and-technology-committee-commons/publications/). This looks at the evolution of structures for transmitting and discussing scientific advice in government, but worries about the longer-term openness of this process. They say (p.18): “…it remains… Read More Parliament’s Science and Technology Committee worries about long term openness of scientific advice to Government
There is a lot of talk about the “new open science”, but a study from the LSE does not find more openness in terms of data https://blogs.lse.ac.uk/impactofsocialsciences/2020/11/30/covid-19-where-is-the-data/
Abstract: The acceptance and usefulness of simulation models are often limited by the efficiency, transparency, reproducibility, and reliability of the modelling process. We address these issues by suggesting that modellers (1) “trace” the iterative modelling process by keeping a modelling notebook corresponding to the laboratory notebooks used by empirical researchers, (2) use a standardized notebook… Read More Good practice: TRACE – the equivalent of a lab notebook for modellers
Starting with a nice illustration as to the difference between alchemy and chemistry (the former was conducted in secret), leading to a critique of a similar situation with Big Data and how this is used by big internet corporations. Available at: https://www.bbc.co.uk/programmes/m000q3sr
A nice short piece basically advocating complete honesty in public pronouncements: “Five rules for evidence communication. Avoid unwarranted certainty, neat narratives and partisan presentation; strive to inform, not persuade.“ https://www.nature.com/articles/d41586-020-03189-1