• Register
X
Forgot Password

If you have forgotten your password you can enter your email here and get a temporary password sent to your email.

X

Leaving Community

Are you sure you want to leave this community? Leaving the community will revoke any permissions you have been granted in this community.

No
Yes
X
Forgot Password

If you have forgotten your password you can enter your email here and get a temporary password sent to your email.

  • Home
  • COVID-19 Preprint Screen

COVID-19 Preprint Screen

The COVID-19 health emergency is being met with a large response from the academic community. Publications are being released at an ever increasing rate, and due to the emergency nature of COVID, preprint publications which can be published in a single day are becoming very important in the international conversation. However, preprints are not peer reviewed, nor are they validated using established journal quality checklists. 


On the positive side, preprints are under a license permissive to text mining, making it possible to deploy AI-methods, which function as at cursory check on various items that under normal circumstances would likely be caught by editors or reviewers. 


The Automated Screening Working Group has been using our tools to screen COVID-19 preprints posted on bioRxiv and medRxiv.


All COVID preprints are screened with Jetfghter, SciScore, ODDPub, LimitationRecognizer, Barzooka, and Seek and Blastn. For more about each tool, please see the main tool page: https://scicrunch.org/ASWG


Combined reports from all tools are shared via hypothes.is. @SciScoreReports is a twitter account that posts direct links to reports, which can be viewed even if you do not have hypothes.is installed on your browser (see below).

An example of a medRxiv preprint with the report visible on the right hand side. 

     

There are three ways to view reports for a preprint.

  1. Download the hypothes.is browser add on in chrome, then go to the preprint on bioRxiv or medRxiv. Reports will be visible through hypothes.is (see below)
  2. Go to the metrics tab for the preprint and view tweets. Find the @SciScoreReports tweet and click on the “via hypothes.is” link to view the report (see below)
  3. Search for the preprint on Sciety.org to view ScreenIT reports as well as peer reviews. 

 

Method 1.


     


Method 2.
 
     
We understand that all rigor criteria are not applicable to all preprints, nor that preprints that passed all automated checks are reproducible, nor do we assert that preprints that do not meet the criteria are necessarily of poor quality. We intend to point out to the scientific community that certain criteria are not met by some preprints and that scientists may consider these key rigor metrics when attempting to review the manuscript and draw conclusions.

We cite sources for each criterion (e.g., sex as it relates to COVID) on this webpage:
https://scicrunch.org/ASWG/about/References

About

Welcome to the ASWG Community.

Recent News Entries

Is the future of peer review automated?

Automated screening of COVID-19 preprints: can we help authors to improve transparency and reproducibility?

rTransparent

Contact Us

Our Information

About SciCrunch | Privacy Policy | Terms of Service

SciCrunch
X

Are you sure you want to delete that component?