Comment on:

The following comment refers to this/these guideline(s)

Guideline 7

Cross-phase quality assurance

Researchers carry out each step of the research process lege artis. When research findings are made publicly available (in the narrower sense of publication, but also in a broader sense through other communication channels), the quality assurance mechanisms used are always explained. This applies especially when new methods are developed.

Explanations:

Continuous quality assurance during the research process includes, in particular, compliance with subject-specific standards and established methods, processes such as equipment calibration, the collection, processing and analysis of research data, the selection and use of research software, software development and programming, and the keeping of laboratory notebooks.

If researchers have made their findings publicly available and subsequently become aware of inconsistencies or errors in them, they make the necessary corrections. If the inconsistencies or errors constitute grounds for retracting a publication, the researchers will promptly request the publisher, infrastructure provider, etc. to correct or retract the publication and make a corresponding announcement. The same applies if researchers are made aware of such inconsistencies or errors by third parties.

The origin of the data, organisms, materials and software used in the research process is disclosed and the reuse of data is clearly indicated; original sources are cited. The nature and the scope of research data generated during the research process are described. Research data are handled in accordance with the requirements of the relevant subject area. The source code of publicly available software must be persistent, citable and documented. Depending on the particular subject area, it is an essential part of quality assurance that results or findings can be replicated or confirmed by other researchers (for example with the aid of a detailed description of materials and methods).

Guideline 13

Providing public access to research results

As a rule, researchers make all results available as part of scientific/academic discourse. In specific cases, however, there may be reasons not to make results publicly available (in the narrower sense of publication, but also in a broader sense through other communication channels); this decision must not depend on third parties. Researchers decide autonomously – with due regard for the conventions of the relevant subject area – whether, how and where to disseminate their results. If it has been decided to make results available in the public domain, researchers describe them clearly and in full. Where possible and reasonable, this includes making the research data, materials and information on which the results are based, as well as the methods and software used, available and fully explaining the work processes. Software programmed by researchers themselves is made publicly available along with the source code. Researchers provide full and correct information about their own preliminary work and that of others.

Explanations:

In the interest of transparency and to enable research to be referred to and reused by others, whenever possible researchers make the research data and principal materials on which a publication is based available in recognised archives and repositories in accordance with the FAIR principles (Findable, Accessible, Interoperable, Reusable). Restrictions may apply to public availability in the case of patent applications. If self-developed research software is to be made available to third parties, an appropriate licence is provided.

In line with the principle of “quality over quantity”, researchers avoid splitting research into inappropriately small publications. They limit the repetition of content from publications of which they were (co-)authors to that which is necessary to enable the reader to understand the context. They cite results previously made publicly available unless, in exceptional cases, this is deemed unnecessary by the general conventions of the discipline.

Overarching quality assurance in the life sciences

In the life sciences, quality assurance in a research project begins with thorough research into the state of knowledge and a clear definition of where there are gaps in knowledge. Researchers are expected to use contemporary analytical methods for literature research and data analysis such as the use of subject-specific databases, which can be very helpful in addressing complex questions. Research will frequently include a reuse of existing data sets, too. The potential of existing data sets should always be considered when assessing the validity of a new research question. Systematic reviews are much more time-consuming, but they are important additions to the quality assurance of very complex scientific approaches.

In research within largely unknown contexts, it may initially make sense to proceed experimentally using a manageable volume of samples so as to generate scientific hypotheses. Findings are then often tested for possible generalisation and further validated using a range of different methodological approaches. This is where the relevance of insights already gained often emerges, enabling potential new correlations to be identified. If the research aims to achieve a further transfer of knowledge – in particular to a clinical application at a later stage – selected findings can be verified by confirmatory studies. These different approaches to research also differ in terms of the quality assurance measures they require, so this has to be reflected accordingly in research project design. For example, statistical planning is all the more important, the more the approach is based on previously established knowledge which is to be tested by means of confirmative trials.

In the life sciences, model systems are frequently used to establish research questions. The choice of a suitable model system poses a particular challenge since each model is subject to its own restrictions and limitations. For this reason, the strategy for choosing the model system must always be plausible and carefully assessed. In those areas of the life sciences where findings can be applied in practice, the choice of model should also reflect the transferability and compatibility of the results. The origin and characteristics of the data, organisms, materials or software used must be known and described in verifiable terms. Here it is advisable to use certified infrastructures or those with verifiable quality assurance functions as a source. When using animal models, the sex of the organism or other relevant parameters such as age may influence the results; this should be taken into account when planning and implementing projects. It is imperative that these issues are thought through and justified when planning a project. In ecosystem analyses, the spatial or temporal variability of the processes, structures and pools under investigation should be recorded if possible.

In particular, the diversity and speed of method development in the life sciences require an awareness of the limits of one’s own capabilities and a willingness to cooperate. Due to the rapid availability of methods through commercial “sets”, competence acquisition might superficially appear simple in connection with standard methods. As a rule, however, in-depth critical examination of the methodology is still required if the necessary quality standards are to be met.

When it comes to managing the resulting research data, appropriate precautions have to be taken early on in the planning phase of the project so as to ensure that the documentation is verifiable for other researchers and that key research data can be reused – at least after completion of the project, if not before. As a minimum requirement, projects can be expected to address the reuse potential of datasets, demonstrate an awareness of subject-specific metadata standards and suitable repositories, and make use of advisory and support services. The costs involved should be considered during planning, and data protection concerns must also be taken into account.

As in other fields of academic research, investigation in the life sciences sometimes focuses on events or generates findings that cannot be reproduced due to their singularity or contingency. However, there is still a fundamental requirement for the findings to be robust and applicable. This prerequisite is often ensured by indirectly confirming results based on different models. The targeted repetition (replication studies) of particularly key research findings has become established as a valuable additional contribution to quality assurance. Valuable insights into previously unknown aspects can also be gained from unsuccessful replications. Another helpful method for increasing the robustness and applicability of results is the pre-registration of studies or investigative approaches.

The comment belongs to the following categories:

GL7 (Life sciences) , GL13 (Life sciences)

|