DOAJ Seal

Myth-busting: Journals must meet the DOAJ Seal criteria to be indexed in DOAJ

This is a myth.

There is a common misunderstanding that for a journal to have its application accepted and be indexed in DOAJ it must meet all the criteria for the DOAJ Seal. There is an assumption, born out of that misunderstanding, that journals in DOAJ without the Seal are of inferior quality. This is also a myth.

What ‘Indexed in DOAJ’ means
Being indexed in DOAJ means that a journal application has passed our editorial review. Editorial review consists of an investigation by the DOAJ Editorial team and our volunteers who have researched whether or not the journal and its publisher do what they claim to do on the journal site and in their application to us. The investigation consists of checking all of the 50+ answers in an application to make sure that the information on the website is easy to find, clearly and accurately presented and matches the application. The editorial board is scrutinised and sometimes members of the board are contacted and their institutional connections verified, their work on the board is confirmed and which other boards that member sits on.

Being indexed in DOAJ means that the journal adheres to high levels of quality in its publishing services and services to authors and users, including: peer review, licensing terms, a strong open access statement, a fully functional editorial board and more. Being indexed in DOAJ means that the journal is a trusted open access journal and, in fact, many do meet one or more of the Seal criteria.

 

What the DOAJ Seal means
The DOAJ Seal is a stamp of quality. Journals that are awarded the Seal have verified that they correctly fulfil all seven criteria that DOAJ has chosen specifically as indicators of a Logo for the DOAJ Seal.clear commitment to open access best practices, of high levels of commitment to publishing standards and best practices, and that the open access model they adhere to is the most open.

 

The Seal has been allocated to just over 10% of the journals accepted into DOAJ since 2014. In some cases, the Seal has been withdrawn because the journal can no longer fulfil all seven criteria.

Journals cannot apply for the DOAJ Seal. The Seal is awarded after careful assessment of the journal website. If you think that your journal qualifies for the Seal, you should contact us to have it assessed.

It is important to remember that, whether they have the Seal or not, all journals in the DOAJ have met our criteria for inclusion as trusted, quality, open access journals.

We’ve added 2 new columns to the journal CSV.

In a series of enhancements to article metadata, we have released the third today.*

If you are familiar with DOAJ metadata then you probably already know that you can download a CSV file which contains the journal-level metadata for all the journals in DOAJ. It is updated every 30 minutes and is probably one of the most popular metadata services we have. It is certainly the best way to get an overview of all the journals in DOAJ.

Today, we’ve released a new version of that file which adds two new columns to it: the number of article records added to a journal in DOAJ and the date that the last article was added. (Columns BF and BG respectively)

The columns were added for two reasons:

  1. To give greater transparency to the information which we display on our homepage whcountere we state that 77% of the journals in DOAJ have article content loaded to them. This is slightly misleading because a journal which uploaded only 5 articles to us in 2013 is counted in that 77%. It is more interesting to know how recent the articles are from a particular title and how much content they have uploaded to us. While this information has always been available by selecting a journal ISSN and using the ‘articles’ filter in Search, we’ve never been able to show all the information in one place.I think that this development will be welcomed by all our users, especially publishers, librarians and those doing research on open access publishing developments.
  2. To allow us to review those journals which have been awarded the DOAJ Seal and remove that Seal from those which are not supplying article metadata to us. Supplying article metadata is one of the 7 Seal criteria and we haven’t yet been able to check, in an efficient manner, which journals are sticking to their promise. [In the application form, we ask if journals “intend” to supply metadata to us.] It’s going to take deeper analysis to get the final figure but I can see very quickly that 25 journals are going to lose their Seal.

I’d love to know what you think about this development so, as usual, do leave a comment or a question, or email me directly: dom@doaj.org.

P.S. The other development which I will post about soon is the removal of duplicated articles from the DOAJ database. More on that when I have it.

*The first and second developments are described in this blog post from February.

New article on DOAJ available at ScienceOpen

We have just published an article in the open access journal ScienceOpen Research, giving an overview of the history and current status of the DOAJ. Please read and share the article! We would welcome your participation in the post-publication peer review of this article and/or any comments.

Criteria for open access and publishing
Authors: Tom Olijhoek, Dominic Mitchell and Lars Bjornshauge
DOI: 10.14293/S2199-1006.1.SOR-EDU.AMHUHV.v1

After a brief historical overview, DOAJ policies regarding open access, intellectual property rights and questionable publishers are explained in detail. The larger part of the article is a much requested explanation on how DOAJ uses its new set of criteria for the evaluation of open access journals and the rationale behind choosing the seven extra criteria that qualify for the DOAJ Seal. A final section is devoted to the extended possibilities that DOAJ offers to scholars and publishers for searching the database and for uploading metadata.

‘Indexed in DOAJ’ versus ‘the DOAJ Seal’

I need to clarify what being indexed in DOAJ means and how the Seal is related to that, and how the reapplication process works.

There is a common misunderstanding that only journals that get the Seal are “indexed in DOAJ”, that only Seal journals are quality, peer reviewed open access journals. This is incorrect. ALL journals in DOAJ have been approved as quality, peer reviewed open access journals. The whole DOAJ list is the approved, community-curated list of reputable journals!

  1. What ‘Indexed in DOAJ’ means
    Being indexed in DOAJ means that a journal has passed up to 4 stages of independent and objective, manual review. It means that the journal has been investigated by our Editorial team who have researched whether or not the journal/publisher does what they claim to do on the journal site and in their (re)application to us. During the investigation, the DOAJ editors go through the pages on a journal’s site to make sure that all the information presented to a user is easy to find, clearly and accurately presented and easy to understand. The editorial board is investigated, and sometimes members of the board are contacted and their institutional connections verified, their work on the board is confirmed and which other boards that member sits on. Being indexed in DOAJ means that the journal adheres to high levels of quality of its publishing services and services to authors and users, including: peer review, licensing terms, a strong open access statement, a fully functional editorial board and more. Being indexed in DOAJ means that the journal is a good open access journal, a trusted open access journal.
  2. The reapplication process
    DOAJ upgraded its requirements for journals to get into DOAJ. The upgrade, which covered all new applications, was made live in March 2014. This meant that there were about 9000 journals already in DOAJ—accepted into DOAJ between 2003 and 2013—that had been accepted under less stringent requirements. We require that every one of them upgrades their information with us. To make it easier for users to see which journals have been accepted under the new criteria we added a green tick next to them. Journals without a tick next to them still have to be reviewed against the new criteria. Note however that even journals that have no tick against them have been manually reviewed and accepted into DOAJ as being reputable.If a journal is in DOAJ, it is on the list of approved and reputable journals.
  3. The DOAJ Seal
    The DOAJ Seal, think of it like this: journals that have the Seal are journals that adhere to outstanding best practice; journals that don’t have the Seal are good, trusted journals adhering to best practice. The Seal has been allocated to a handful of journals accepted into DOAJ since 2014. Journals that are awarded the Seal have answered ‘Yes’ to 7 questions that DOAJ has chosen specifically as indicators of an extra high and clear commitment to open access best practices, of extra high levels of commitment to publishing technologies, and the most ‘open’ form of open access. Importantly, the journals that DO NOT have the Seal still adhere to high levels of quality required for indexing in the DOAJ, especially those journals that have a green tick. No Seal DOES NOT mean low quality, non peer reviewed, questionable, ‘dodgy’, ‘scammy’.

I hope that this helps. DOAJ spends all of its time improving information on reliability, trustworthiness and accuracy. DOAJ also spends a lot of time ensuring that questionable journals do NOT get into the directory. DOAJ is already doing that work for you so that you can be exactly sure what levels of service you can expect when you choose a journal to submit to, to recommend to faculty, to read research in.

As ever, if you have any questions, leave a comment or get in touch!

DOAJ Seal is now live on the site

The DOAJ Seal is now live. Although DOAJ has been indicating which journals get the Seal since March 2014, the Seal is now displayed alongside those journals that qualify. Look for this symbol:

DOAJ_Seal_logo_mediumWe’ve also added a DOAJ Seal facet to the search so you can see all the Seal journals together.

Journals that adhere to an exceptionally high level of publishing standards and best practice are awarded the Seal as recognition of those efforts. The Seal is awarded to a journal that fulfills a set of criteria related to accessibility, openness, discoverability, reuse and author rights. It acts as a signal to readers and authors that the journal has generous use and reuse terms, author rights and adheres to the highest level of ‘openness’. The Seal has nothing to do with the scholarly quality of the material published in the journal.

To qualify for the Seal the journal must:

  • have an archival and preservation arrangement in place with an external party such as CLOCKSS, LOCKSS, Portico;
  • provide permanent identifiers in the published content such as DOIs;
  • provide article level metadata to DOAJ;
  • embed machine-readable CC licensing information in article level metadata;
  • allow reuse and remixing of content in accordance with a CC BY, CC BY-SA or CC BY-NC license;
  • have a deposit policy registered in a deposit policy directory such as SHERPA/RoMEO;
  • allow the author to hold the copyright without restriction.

To date, 88 journals have qualified for the Seal and we hope to see that number increase steadily.

Twelve exciting and important developments due for release

If the SPARC piece we recently featured in didn’t give you a good idea into the amount of work that we’re undertaking to improve DOAJ—and ultimately the overall quality of open access publishing—then this [incomplete] list of our developments for 2015 should provide you with a fuller picture.

We’re coming to the end of a fairly small but significant and, in my opinion, very exciting project that will do the following:

  • improve the visibility of individual articles, both locally in DOAJ and outside in external search engines
  • improve overall discoverability in, and linking from, external databases
  • improve metadata extraction for re-use
  • give visibility to new datasets from the information we are collecting in the new application form with a level of granularity we’ve never had before
  • update the UI and add better browsing
  • add a much needed visualisation for existing continuations and ultimately, the management of new ones
  • reduce DOAJ’s overall response times

As I have mentioned in previous posts, DOAJ’s front end is currently straddling two datasets and this project will start to reveal all the lovely, new data that we have been collecting since March 2014, in all its glory. As publishers reapply (1072 out of ~9700 journals have already submitted their reapplications), the old dataset will drop away and the new, updated data will be displayed on the site.

This will have a few implications, the most important being that our extractable (CSV*, OAI-PMH etc) and reportable (statistics, figures) datasets will vary wildly over the coming 6 months as we bed down into the new dataset and flush out the old stuff. For example, you will notice a big shift in our APC numbers, the total numbers for the countries of publishers, the numbers of journal languages and the accuracy of journal classifications. Get in touch if you’d like more detailed information on this part and, to use a cliché, pardon our dust as we clear away the old and build out the new.

Here’s a partial list of everything we will do this year. It’s only partial because we haven’t yet finalised the list for the latter part of 2015. I’ll be able to update you on that at a later date. I’ve broken it into two sections: Behind The Scenes, all features that are effectively invisible to the site user but will make a huge difference for the publishers and any service using DOAJ data; and The User Interface, where site users will notice improved site interaction and site response times.

* Our CSV file will be updated after this project completes.

 

Behind The Scenes

OpenURL

I am very pleased to report that our OpenURL service will be reinstated AND upgraded. When we migrated from our old platform in 2014, we were unable to move the OpenURL 0.1 service. We know that many of our institutional and business partners rely on OpenURL to connect out to the content in our database and this has led to some understandable frustration as the links have failed to resolve. We’ll be relaunching with OpenURL Version 1.0.

A landing page for every article

Another ‘feature’ that we are reinstating, every single article entry in DOAJ will have, once again, its own landing page. This will increase the visibility of open access content in search engines and in turn, traffic to journal sites. Individual articles will appear in search engine results. Site visitors will be able to surf directly to an article from an external engine search. We will be able to display more concise and specific information, within DOAJ, at the article level.

Structured metadata

We will be structuring the metadata of article content to give it fixed and recognisable fields, tagged in a way that will make it easier to index, ingest, link to and find.

Google Scholar compatibility

The structuring of the metadata will, among other things, allow Google Scholar to crawl and index every single article item in DOAJ. Although some article content appears in Google Scholar currently, our unstructured metadata means that the Google Scholar indexers are left to guess a lot of the information and, when they can’t do that successfully, they skip it. My contact at Google Scholar provided us with the metadata specifications needed to ensure indexing in Google Scholar and we are confident that this will have a great impact on traffic to the original articles on publishers’ sites. It can take Google Scholar up to 8 weeks to crawl new content (an up to 9 months to come back and re-crawl additional content!) so we will have to be patient before we see any noticeable results.

Improved OAI-PMH

The last of the ‘behind-the-scenes’ improvements, we’ll be adding more granularity to our OAI-PMH service. At the moment, we’re generating OAI metadata using standard Dublin Core which, while meeting basic needs, isn’t specific enough around certain DOAJ-specific information such as citation.

 

The User Interface

An upgrade to our facets

We have upgraded the software that enables our facet searching. We have done this to both facilitate future developments around searching but also to make the process of selecting and filtering using facets more intuitive. We will also be introducing new facets that will reveal the new information we are collecting about journals, such as type of peer review, full text format, and The DOAJ Seal.  We’d be interested to know what you think about the new interface.

Subject browser

Probably the most exciting feature we are adding is a fully functional subject browser. We have received a fair bit of feedback asking for better browsing by subject capabilities. In DOAJ, all journals and their articles are classified according to the Library of Congress Classification. Every journal has one or two subjects assigned to it when it is accepted into DOAJ. Users will now be able to expand and collapse a tree to reveal the subject categories, or start by typing a keyword to reveal relevant categories. The number of records assigned to that subject will be revealed and a button offered to take users to the results.

Improved search results

We’ve cleaned up the search results for both journal and article entries. We’ve standardised the display of search results for articles to the Vancouver citation style and where relevant, we’re adhering to the NISO PIE-J standard that details recommendations for the presentation and identification of  e-journals. This means a simpler, cleaner display with standardised information clearly identified in search results for both journals and articles. Importantly, we’ve surfaced the APC information in search results: not simply whether a journal charges APCs or not, but how much they charge and in which currency.

Revealing the new application form data

All of the data that we are capturing in the new application form will now be displayed against the journals and their articles. We are redesigning the journal landing pages so that the most pertinent information is higher up the page (such as APC data), long URLs are hidden and we’ve adopted a two column treatment to give greater visibility to all of the new data. New data includes: permanent article identifier, waiver policy, archiving policy, plagiarism policy, machine-readable license and deposit policy. We’ve decided to simply display this information on the journal landing pages, rather than create facets for all of them: a facet for every new category would make the search interface clunkier and slow down response times. We’d be interested to hear from you of you feel that some of the new categories definitely need a facet in search.

Shareable, stable URLs

A regular user of DOAJ will tell you how the URLs are incredibly long and don’t “share” very well. They were slightly unstable: if a piece of metadata in the URL included a special character, such as an accent, then when that URL was shared, it often broke. We’ve stabilised the platform so that users can share URLs and the links will never break. The URLs will still be long so we’re plugging in Bit.ly, right next to the search results, so that users can generate a shortened but stable URL to share.

Display of continuations

DOAJ has been studying the NISO PIE-J recommendations in the context of continuations, of which we have several hundred in DOAJ. (A continuation is when a journal changes its title, ISSN(s) or both and these have, until now, been invisible in DOAJ.) We will be adding the correct visualisation of continuations to the journal landing pages. Note that this won’t allow us to create new continuations: that piece of work will be done later in the year.

DOAJ Seal

We’ve been publishing our list of journals that have received the DOAJ Seal since January 2014 but, so far, we’ve been unable to display that information on the site. We will shortly start adding the DOAJ Seal logo to journal landing pages and journal entries in search results.