Dataset and Statistical Outputs for Structured Peer Review: Pilot results from 23 Elsevier Journals
Abstract/Contents
- Abstract
- Structured peer review consisting of 9 questions was piloted in August 2022 in 220 Elsevier journals. We randomly selected 10% of these journals across all fields and IF quartiles and included manuscripts that in the first 2 months of the pilot received 2 reviewer reports. It was the goal of this pilot study to evaluate structured peer review implementation by: 1) exploring if and how reviewers answered structured peer review questions, 2) analysing reviewer agreement, 3) comparing that agreement to agreement before implementation of structured peer review, and 4) further enhancing the piloted set of structured peer review questions. As categories for outcome classification were developed throughout the data extraction process, the data file was constantly being updated. The final, cleaned dataset, is posted here alongside all statistical outputs of results. The original raw data, which contains proprietary Elsevier data, is available upon request from BM and will require a non-disclosure agreement.
Description
| Type of resource | Dataset |
|---|---|
| Publication date | February 1, 2024; February 1, 2024 |
Creators/Contributors
| Author | Malički, Mario |
https://orcid.org/0000-0003-0698-1930
(unverified)
|
|---|---|---|
| Author | Mehmani, Bahar |
https://orcid.org/0000-0003-4038-4531
(unverified)
|
Subjects
| Subject | peer review |
|---|---|
| Subject | structured peer review |
| Subject | inter-rater agreement |
| Genre | Data |
| Genre | Database |
| Genre | Data sets |
| Genre | Dataset |
| Genre | Databases |
Bibliographic information
Access conditions
- Use and reproduction
- User agrees that, where applicable, content will not be used to identify or to otherwise infringe the privacy or confidentiality rights of individuals. Content distributed via the Stanford Digital Repository may be subject to additional license and use restrictions applied by the depositor.
- License
- This work is licensed under a Creative Commons Attribution 4.0 International license (CC BY).
Preferred citation
- Preferred citation
- Malički, M. and Mehmani, B. (2024). Dataset and Statistical Outputs for Structured Peer Review: Pilot results from 23 Elsevier Journals. Stanford Digital Repository. Available at https://purl.stanford.edu/fn500hr0903. https://doi.org/10.25740/fn500hr0903.
Collection
Stanford Program on Research Rigor & Reproducibility (SPORR)
View other items in this collection in SearchWorksContact information
- Contact
- mmalicki@stanford.edu
Also listed in
Loading usage metrics...