application form

‘Indexed in DOAJ’ versus ‘the DOAJ Seal’

I need to clarify what being indexed in DOAJ means and how the Seal is related to that, and how the reapplication process works.

There is a common misunderstanding that only journals that get the Seal are “indexed in DOAJ”, that only Seal journals are quality, peer reviewed open access journals. This is incorrect. ALL journals in DOAJ have been approved as quality, peer reviewed open access journals. The whole DOAJ list is the approved, community-curated list of reputable journals!

  1. What ‘Indexed in DOAJ’ means
    Being indexed in DOAJ means that a journal has passed up to 4 stages of independent and objective, manual review. It means that the journal has been investigated by our Editorial team who have researched whether or not the journal/publisher does what they claim to do on the journal site and in their (re)application to us. During the investigation, the DOAJ editors go through the pages on a journal’s site to make sure that all the information presented to a user is easy to find, clearly and accurately presented and easy to understand. The editorial board is investigated, and sometimes members of the board are contacted and their institutional connections verified, their work on the board is confirmed and which other boards that member sits on. Being indexed in DOAJ means that the journal adheres to high levels of quality of its publishing services and services to authors and users, including: peer review, licensing terms, a strong open access statement, a fully functional editorial board and more. Being indexed in DOAJ means that the journal is a good open access journal, a trusted open access journal.
  2. The reapplication process
    DOAJ upgraded its requirements for journals to get into DOAJ. The upgrade, which covered all new applications, was made live in March 2014. This meant that there were about 9000 journals already in DOAJ—accepted into DOAJ between 2003 and 2013—that had been accepted under less stringent requirements. We require that every one of them upgrades their information with us. To make it easier for users to see which journals have been accepted under the new criteria we added a green tick next to them. Journals without a tick next to them still have to be reviewed against the new criteria. Note however that even journals that have no tick against them have been manually reviewed and accepted into DOAJ as being reputable.If a journal is in DOAJ, it is on the list of approved and reputable journals.
  3. The DOAJ Seal
    The DOAJ Seal, think of it like this: journals that have the Seal are journals that adhere to outstanding best practice; journals that don’t have the Seal are good, trusted journals adhering to best practice. The Seal has been allocated to a handful of journals accepted into DOAJ since 2014. Journals that are awarded the Seal have answered ‘Yes’ to 7 questions that DOAJ has chosen specifically as indicators of an extra high and clear commitment to open access best practices, of extra high levels of commitment to publishing technologies, and the most ‘open’ form of open access. Importantly, the journals that DO NOT have the Seal still adhere to high levels of quality required for indexing in the DOAJ, especially those journals that have a green tick. No Seal DOES NOT mean low quality, non peer reviewed, questionable, ‘dodgy’, ‘scammy’.

I hope that this helps. DOAJ spends all of its time improving information on reliability, trustworthiness and accuracy. DOAJ also spends a lot of time ensuring that questionable journals do NOT get into the directory. DOAJ is already doing that work for you so that you can be exactly sure what levels of service you can expect when you choose a journal to submit to, to recommend to faculty, to read research in.

As ever, if you have any questions, leave a comment or get in touch!

Updates to DOAJ will be switched off while we upgrade the site

Earlier this month I wrote about the twelve developments that we were working on. These are now ready to be released to the live site this week and we will be making the upgrade between Tuesday (21st April) evening and Wednesday (22nd April) morning British Summer Time (GMT+1). During this time, we will switch off all parts of the site that allow new data to be submitted to us:

  • the application form
  • the form for adding article metadata
  • the XML upload page for uploading article metadata
  • the CSV upload page for submitting bulk reapplications
  • the reapplication form

All other aspects of the site will continue to function as normal. We expect a full service to be reinstated by Wednesday 12 noon BST. I will post further updates here.

Get involved and volunteer for DOAJ

We are always looking for ‪‎volunteers‬ to help us review the applications for journals wishing to be indexed in ‪‎DOAJ‬. We have well over 100 people, from all over the world, helping us already. It’s a growing and exciting network to be part of and the work being done directly contributes to the quality of peer-review, open access publishing. Are you interested in joining us?

How much work is it?
We ask our volunteers to give us 4 or 5 hours of their time per week but you are left to manage your own schedule.

Who should volunteer?
Anyone who has knowledge and enthusiasm for academic journals, scholarly publishing, ‪‎open access‬, electronic publishing, librarianship, digital preservation. We particularly welcome ‪librarians‬, information studies professionals and students, PhD students, researchers and people affiliated with research institutions. The important thing is that you understand some of the mechanics, principles and politics behind open access and scholarly publishing.

We are always looking for people who have an excellent grasp of English as a first, second or third language.

If you can speak the following languages, with English, we would love to hear from you:

‪‎Arabic (العربية)
Bulgarian‬ (български)
‪Chinese‬ (中文)
‪Czech‬ (česky)
‪Farsi‬ (فارسی)
‪French‬ (français)
German (deutsch)
‪Hungarian‬ (magyar)
‪Indonesian‬ (Indonesia)
‪Macedonian‬ (македонски)
‪Polish‬ (Polski)
‪Portuguese‬ (Português)
Romanian (român)
‪Russian‬ (Русский)
‪Serbo‬-Croatian
‪Slovak‬ (slovenský)
‪Slovenian‬ (slovensko)
‪Spanish‬ (Español)
‪Turkish‬ (Türkçe)

How do I apply?
There’s a bit more detail in the announcement I have just posted so you should read that first. If you have any questions, contact me here or email feedback@doaj.org

DOAJ is raising the quality bar for open access: SPARC blog post

DOAJ’s managing director, Lars Bjørnshauge, has been interviewed by SPARC about DOAJ’s enhanced application form and raising the quality bar in open access publishing. The post, published today, highlights how effectively the new form is providing a much-needed filter against questionable, unethical and non-transparent publishing practices.  Combined with OASPA’s efforts, the form is an important tool for fighting  “the scholarly community’s legitimate concerns over the quality of Open Access journals” said Heather Joseph, Executive Director of SPARC. “The actions that the DOAJ are taking… provide an important new safeguard, and helps raise the quality bar.”

Of course, we are delighted to hear that our efforts over the past two years are bearing fruit. With financial support from the community, via sponsorships and donations, we have worked hard to implement the new form and its comprehensive administration system that our volunteers use to review the applications. We are also helping publishers improve their practices, helping them understand how their operations can be more “professional, ethical, and transparent”.

DOAJ will not be resting on its laurels quite yet though as there is still much left to do. DOAJ is currently inviting 99% of all the journals indexed in it to reapply. It is anticipated that this process take the rest of this year to complete, progress of course depending on how fast publishers return their reapplications to us. The review work requires a large amount of manpower so we are seeking further financial contributions to help us speed up the process and more volunteers who know Turkish, Indonesian, Farsi, Spanish and Portuguese.

If you or your institutions would like to donate, you can do so here: http://doaj.org/supportDoaj. If you know anyone who might like to volunteer a few hours of their time reviewing applications with us, please show them this post.

Onwards!

Update on our reapplication process

I just read a great post in the Digital Commons’ DC Telegraph which has prompted me to write a little update of where we are with the reapplication process that we have been speaking about—that is, the process where all existing journals in DOAJ have to reapply to stay indexed.

As happens with some development projects, the launch of the functionality that will handle all the reapplications had to be moved out from our original estimated date. We’re sorry for the delay. The good news is that we are in testing now and, if all goes to plan, should be ready to release the functionality in December. If testing throws up some serious flaws in our developments then we may have to wait until January 2015. Either way, we are almost there.

As mentioned in the DC Telegraph, and in Nina Rose’s post on L.J. eds., we will be emailing all publishers as soon as we are ready so if you haven’t heard from us yet, that’s OK. We will also be publishing an announcement here, on Twitter, Facebook, Google+, LinkedIn AND every publisher that logs into their account will see a blue ‘sticky note’ across the top of their account letting them know that they have reapplications to make.

Sample sticky note

The sticky note appears in your Publishers’ Area once you have logged in.

As always, get in touch if you have questions.

 

Proactive not reactive

Earlier this week, Nature News & Comment published a piece about the DOAJ under the heading ‘Open-access website gets tough‘.

We are happy about the exposure but there are a couple of things to address.

1) Coming to the end of a process started in December 2012

The process of drafting new, tougher criteria started way before the so-called “Science sting” which found problems in the peer review process of many of the questionable open access journals deliberately selected for the study.

IS4OA (www.is4oa.org) officially took over the responsibility for DOAJ on 1st January 2013 but it announced on 18th December 2012 that one of the most important things it would do was to ensure the implementation of stronger selection criteria for journals to be included—and to stay included—in the DOAJ. This was primarily to make it easier for authors to find a proper open access journal in which to publish their work. It makes it easier also for research funders, universities and managers of open access publication funds to make an informed decision on which open access journals comply with their policies in terms of licensing, archiving and APCs. In June 2013, after input from the DOAJ Advisory Board, I tweeted that a draft of the new criteria was available for public comment:

The draft received a lot of attention and constructive input from the community and the new application form finally went live in March this year, after a platform migration and a good deal of development.

All new journals wishing to be indexed in DOAJ and all journals indexed currently have to complete the form and then pass a much more rigorous and detailed evaluation. All the information provided by the journals will eventually be publicly available and searchable, further empowering the community to make better decisions re which open access journal to publish in and to help the DOAJ team monitor compliance. At time of writing, 231 journals have been accepted into the DOAJ under these new criteria.

Naturally, this change means much more evaluation is needed per application—multiplying current operations by a factor of 10—so DOAJ put out a call in January 2014 for voluntary editors to assist in the (re)-evaluation of the journals. The call generated 250 applications from researchers, PhDs, professors, librarians and academic publishing professionals from more than 30 countries mastering more than 30 languages. For DOAJ to achieve its vision of being a truly global service, extending coverage around the world, this is an important landmark.

With further development, DOAJ has also implemented a 3-tier evaluation process which will, as far as possible, filter out any questionable journals. This process will take time, especially since 99% of the 9939 journals have to be re-evaluated. We expect the process to be completed late 2015.

2) Even more vital to the community

The DOAJ Team knows for a fact that these efforts are taking DOAJ in the right direction that will ensure it continues to meet the needs of the public. It has already had excellent feedback on the new developments via social media channels, via training sessions held by Redalyc throughout South America and from its sponsors and supporters. It is also known that many university open access publication funds list inclusion in the DOAJ as being one of the criteria for a successful funding request. Furthermore, someone looking for a quality, peer-reviewed, open access journal in their field is more likely to start their search with the DOAJ list of journals, than with any other list; a curated list of reputable journals that uses a 3-tier review process, that harnesses the skills and expertise of the community and that requires 48 pieces of different information from an applicant before a journal can be considered for inclusion.

All the improvements above add up to a dramatic change for the DOAJ and the way it operates. It can only continue this approach if the communities that use and value DOAJ continue to support it. DOAJ has been operating entirely on financial support and is one of the oldest community funded, open access infrastructure services. Along with its sponsors, more than 100 university libraries, 15 library consortia and others already support DOAJ financially but more are needed! Become part of this impressive group of sponsors and supporters by going to http://doaj.org/supportDoaj and donating.

A few notes about our legacy data

We regularly receive notification that DOAJ data has been used for analysis; analysis done by publishers, librarians, students, technologists, bloggers and many others. That the data is central to so many studies continues to reinforce the importance of the DOAJ in the open access movement. We are confident that, once our current upgrade is complete, and when all the existing journals have been re-evaluated, DOAJ will provide data of an even higher quality that is incomparable to the “old” DOAJ; that is updated more frequently and of a previously unseen level of granularity. It will be a dataset monitored by a large, international network of Associate Editors and Editors, consistently checking and reviewing.

That the data is so regularly used places a responsibility at DOAJ’s door to ensure that the level of data quality is high. This is a responsibility that we take seriously and so I thought it worth clarifying a few points about the DOAJ data.

 

“This site is undergoing maintenance”

The data in the DOAJ database has been collected over a 10 year period and in those last 10 years, not only has the data been through several migrations and transformations but we have seen the size of DOAJ grow from 300 to just short of 10 000 journals. That rate of growth is increasing year on year. This means that we have a large amount of legacy data.

In 2013, we announced that, in response to the changing nature of open access, we would change significantly the inclusion criteria for journals to be listed in the DOAJ, developing our back-end systems accordingly to match the dramatic increase in the resulting workload.  The Community was involved as we sought opinion on the changes we should make. The changes needed amounted to a huge piece of development which required certain activities to be put on hold. Additionally, DOAJ migrated platform in December 2013 so the routine activities of adding journals, removing journals and adding article metadata had to be placed on hold. (Adding new journals was eventually on hold for just over 4 months; removing journals for just under 3.) It wasn’t without a good reason though. DOAJ was migrated to an open source, standards based stable database, hosted by our technical partners Cottage Labs. This also necessitated a substantial clean up of the legacy data.

The result of such a huge project meant that the usual level of data maintenance by our Editorial Team decreased. It didn’t stop – during the first quarter of 2014, 92 journals were earmarked for removal – but for a few months, the public view of DOAJ remained relatively static because the usual weeding and refining was on hold for a few months. There are still areas of the DOAJ data that we know needs to be reviewed and corrected.

Previously, not all information was compulsory

A publisher applying for a journal to be included in the old DOAJ was only required to provide 6 initial pieces of information. Once accepted, the publisher was encouraged to return to the site to provide further information about the journal. One such piece of information was the author processing charge (APC). This is clearly an important piece of information that authors, in particular, like to know up front. Therefore we took the opportunity, when we were designing the new application form, to raise the visibility of this information, require it on application and make it a compulsory question. Naturally, this means that our legacy data has holes in it which need to be filled. All the new journals applying for inclusion after March 19th 2014 have already answered this question. Once we start the re-application process, the ~9700 existing journals in DOAJ will have to answer this question. This process is scheduled to begin in the 3rd quarter of 2014.

All DOAJ data is publisher-provided

While we can force an answer to a question in a web form, we cannot force someone to return to DOAJ and update their information. Of course, information changes over time and often we find that publishers have forgotten to update us. Our system of regular review – our aim is that every journal be reviewed at least once a year – hopes to catch these changes and correct them as quickly as possible. Our new network of Associate Editors will do this more efficiently and pro-actively than ever before but we still encourage the community to get in touch when it spots things that seem to differ. The community can play an important role as our eyes and ears and we encourage that.

 

We first announced the start of our transition period back in October 2013. Since then we have been very open, not only about our progress and development plans but also about the effects that the work would have on the DOAJ itself. Hopefully, with this post I have given you a little more detail as to why there may be inaccuracies in the DOAJ, what we have done to address those and what we will continue to do as our database develops.

We appreciate the patience and support from the community! As always, do please get in touch should you have questions or comments.