Skip to Main Content

Scholarly Communication Toolkit: Evaluating Journals

Evaluating Scholarly Journals

Changing publishing models, including the rise of open-access journals, have reshaped how scholars share and use journal articles. The author-pays model of some open-access publications did not give rise to predatory or vanity publishing as is often claimed, nor are such problems exclusive to open-access publishing. Even traditional subscription journals should be carefully analyzed for quality. Librarians should be aware of the various quality indicators and tools available to their constituents to evaluate potential publication places.

Determining Publisher's Quality (OASPA)

When reviewing an open-access publisher or journal for quality and legitimacy -- the following should be considered:

1. Peer review process: All of a journal’s content, apart from any editorial material marked as such, shall be subjected to peer review. Peer review is defined as obtaining advice on individual manuscripts from reviewers and experts in the field who are not part of the journal’s editorial staff. This process and any policies related to the journal’s peer review procedures shall be clearly described on the journal’s Web site.

2. Governing Body: Journals shall have editorial boards or other governing bodies whose members are recognized experts in the subject areas included within the journal’s scope. The full names and affiliations of the journal’s editors shall be provided on the journal’s Web site.

3. Editorial team/contact information Journals shall provide the full names and affiliations of the journal’s editors on the journal’s Web site as well as contact information for the editorial office.

4. Author fees: Any fees or charges that are required for manuscript processing and/or publishing materials in the journal shall be clearly stated in a place that is easy for potential authors to find before submitting their manuscripts for review or explained to authors before they begin preparing their manuscript for submission.

5. Copyright: Copyright and licensing information shall be clearly described on the journal’s Web site, and licensing terms shall be indicated on all published articles, both HTML and PDFs.

6. Identification of and dealing with allegations of research misconduct: Publishers and editors shall take reasonable steps to identify and prevent the publication of papers where research misconduct has occurred, including plagiarism, citation manipulation, and data falsification/fabrication, among others. In no case shall a journal or its editors encourage such misconduct or knowingly allow it to occur. Suppose a journal’s publisher or editors are made aware of any allegation of research misconduct relating to a published article in their journal. In that case, the publisher or editor shall follow COPE’s guidelines (or equivalent) in dealing with allegations.

7. Ownership and management: Information about the ownership and/or management of a journal shall be indicated on the journal’s Web site. Publishers shall not use organizational names that would mislead potential authors and editors about the nature of the journal’s owner.

8. Web site: A journal’s Web site, including the text that it contains, shall demonstrate that care has been taken to ensure high ethical and professional standards.

9. Name of journal: The Journal name shall be unique and not be one that is easily confused with another journal or that might mislead potential authors and readers about the Journal’s origin or association with other journals.

10. Conflicts of interest: A journal shall have clear policies on handling potential conflicts of interest of editors, authors, and reviewers and the policies should be clearly stated.

11. Accessibility: The way(s) the journal and individual articles are available to readers and whether there are associated subscription or pay-per-view fees shall be stated.

12. Revenue sources: Business models or revenue sources (eg, author fees, subscriptions, advertising, reprints, institutional support, and organizational support) shall be clearly stated or otherwise evident on the journal’s Web site.

13. Indexing Journals shall be indexed by major indexing and abstracting services. It indicates the quality and show discoverability

14. Publishing schedule: The periodicity at which a journal publishes shall be indicated.

15. Archiving: A journal’s plan for electronic backup and preservation of access to the journal content (for example, access to main articles via CLOCKSS or PubMedCentral) in the event a journal is no longer published shall be indicated.

16. Direct marketing: Any direct marketing activities, including solicitation of manuscripts that are conducted on behalf of the journal, shall be appropriate, well-targeted, and unobtrusive.

Think. Check. Submit.

think check submit logo A coalition of scholarly publishers and associations collaborated to create this short checklist for authors to refer to when evaluating a journal as a possible place of publication for his research. By asking a few short questions and evaluating the journal according to the checklist, authors can be assured that the journal they are considering, whether subscription based or open access, will be one of quality, rigor, and respect.

 

ThinkAsk yourself, can you trust this journal with your research? Does the journal publish research you would read yourself?

Check: Is the organization or publisher of the journal identifiable? Can you contact them easily? 

For journals with publication fees (color charges, Open Access) - are the fees clearly listed on the publisher's website? Reputable publishers should list their fees clearly and publicly. 

Do you know the names or reputations of any of the editorial board members? 

Are the articles indexed in services you use within your subject area?

Submit: If you can answer yes to these questions, then submit!

 

Additional Resources for Evaluating Journal Quality

Open Access Spectrum & Evaluation Tool

The Open Access Spectrum was developed by SPARC in collaboration with PLOS and OASPA. This tool displays the core components of open access across a spectrum indicating how closed or open a journal is based upon its policies on reader rights, reuse rights, copyrights, author posting rights, automatic posting, and machine readability. The How Open Is It? guide can be downloaded and shared with faculty and students who have questions about how to evaluate open access journals. The Open Access Spectrum Evaluation Tool can also be used to filter and locate journals based upon publisher policies on these key components.