Author: DOAJ (Directory of Open Access Journals)

DOAJ, Independence and the Importance of Impartiality

DOAJ receives regularly questions and, sometimes, complaints from libraries, library consortia and other academic institutions about the role which publishers—by “publishers” I mean the traditional publishing organisations in academic publishing—play in DOAJ. A common misconception is that DOAJ is owned by, or wholly subsidised by these organisations and that DOAJ is only of benefit to these organisations. If you looked at the DOAJ homepage two years ago, you’d be forgiven for making that assumption: nearly all of our sponsors were publishing organisations and they were all on our homepage. It looked like DOAJ was owned by publishers.

(Avoiding that misconception is also why DOAJ is very careful about who it goes into partnership with. The organisations we partner with must share the same values as DOAJ, have the same vision and at least be intent on providing services to the community. DOAJ is proud to call organisations like Redalyc, SciELO, ISSN and COPE partners.)

The assumption that DOAJ is owned by, or wholly subsidised by publishers is of course incorrect. Publishers play an important financial role in supporting the services which DOAJ provides to all stakeholders. Some publishers donate an annual sponsorship to us; some of them are publisher members. These contributions enable DOAJ to provide continuous services, and improvements to these services, for everyone but any direct influence on DOAJ stops there. In 2017 contributions from publishers accounted for 40% of the income, whereas contributions from public sector institutions accounted for the rest (60%). In 2018 income from public sector institutions will account for 70%. All contributions to DOAJ are made voluntarily; all services provided by DOAJ, including the evaluation of journals, are free.

DOAJ is for librarians, for publishers, for researchers, for students, for journal owners, for everyone. More than 50% of our advisory board is from the library and consortia community. DOAJ is global and isn’t tied down to geographic borders. We are a virtual organisation, employing people from all over the world and with our own Ambassadors encouraging best practice in their home territories. DOAJ is 100% independent. DOAJ is 100% impartial. DOAJ’s holding company, IS4OA C.I.C., is registered in a way that makes it impossible for DOAJ to be purchased, acquired or sold.

Impartiality plays a huge role in the progress that DOAJ has made over the last 5 years and the DOAJ Team works hard to ensure that impartiality is foremost in everything we do. This is one of the reasons that DOAJ adheres to, and encourages other to adhere to, transparency, best practice and standards; best practices and standards which are internationally grown, adopted and recognised. We also recognise that applying those standards and operating within them can be challenging so we have to retain a certain amount of flexibility. A good example here would be licensing.

licensing

Example of the licensing information captured by DOAJ about a journal’s policies.

People often ask: why does DOAJ accept some of the more closed licenses when the BOAI definition [that DOAJ follows as a principle] is clear about what open means? When DOAJ put together its extended application form in 2013, it was clear that DOAJ needed to allow 6 variations on the CC BY license, with varying degrees of openness, to ensure that as many titles as possible could apply to be indexed. The typical DOAJ user should be presented with options and they should be allowed to make an informed choice based on the information we display about a journal’s licensing and copyright policies. However, DOAJ considers the use of CC licenses, particularly use of the most open licenses, as Best Practice and we promote that as one of the criteria for the DOAJ Seal.

In 2017 DOAJ was 9th in a worldwide list of platforms supporting the use of Creative Commons licenses. We believe this to be a direct result of our  preference for CC licenses and the influence of the DOAJ Seal.

For an initiative like DOAJ to work, it must remain as relevant as possible around the world. It must remain impartial and it must remain independent.

WANTED Turkish and Farsi/Persian speakers: a call for volunteer DOAJ Associate Editors

UPDATE: Applications are now closed.

DOAJ has a network of 130 skilled volunteers who spend a few hours a week processing new journal applications for us. Would you like to join us? We are now recruiting volunteers who understand Farsi and/or Turkish. (You do not have to be a native speaker.) You must also be proficient in written and spoken English.

As a DOAJ Associate Editor you will be expected to do a few hours of voluntary, unpaid work a week. You will be provided with training materials to help you carry out your duties. The work you do will directly contribute to the quality, reputation and prominence of open access, scholarly publishing across the world.

Requirements of the Role
In your role as DOAJ Associate Editor, you will be guided and supervised by an Editor and a Managing Editor.

Successful candidates will:

  • have a good knowledge about Open Access (OA);
  • be passionate about OA;
  • have a good knowledge about OA developments in scholarly publishing;
  • have a working understanding of OA publishing practices.

 

In your work you must:

  • be confident working online and have stable access to the internet;
  • support and promote DOAJ and its goals, and be a DOAJ advocate;
  • maintain confidentiality around information to which you have access in the DOAJ database and DOAJ Google Drive, particularly applications you review;
  • assist in evaluating journals suggested to DOAJ in your specialist language;
  • adhere to the recommendations around keeping personal data secure and confidential, as laid out by the DOAJ privacy policy.

Please note that if you are associated in any way with a journal in DOAJ, you may not be selected due to a conflict of interest.

If you wish to apply please complete and submit this form.

At this time, applications are only open to those with the requested languages skills. All other applications will be rejected. We will advertise further volunteering opportunities on this blog so please follow us here or on Twitter. @doajplus

Thank you for considering volunteering for DOAJ!

DOAJ Mission
DOAJ’s mission is to increase the visibility, accessibility, reputation, usage and impact of quality, peer-reviewed, open access scholarly research journals globally, regardless of discipline, geography or language. DOAJ will work with editors, publishers and journal owners to help them understand the value of best practice publishing and standards and apply those to their own operations. DOAJ is committed to being 100% independent and maintaining all of its services and metadata as free to use or reuse for everyone.

’10 web design features that are now browser history’ – or, at least, they should be.

A great blog post from the summer, published on the DataSalon blog and written by Jon Monday, caught our attention recently. Written in celebration of 25 years of the World Wide Web, the blog post looks ‘back on some design features from the early days of the Web’ which have been consigned to “browser history”.

Or at least they should have been.

At DOAJ, we review hundreds of journal applications every month from all corners of the globe, covering every topic imaginable. The applications themselves are always of varying degrees of quality and, sadly, so are the websites they refer to. From mid-December 2017 to mid-September 2018, our Triage function rejected without review 1754 poorly completed applications! Many of the reasons for rejection without review refer directly to a poorly constructed, poorly signposted website.

At least 6 of the items in Jon’s post are still seen by the DOAJ Team on a regular basis: hit counters; guestbooks; blinking text; scrolling text; animated gifs; and under constructions signs. So saying that they have been consigned forever to the bin may not be completely accurate but it certainly is wishful thinking on our part!

Sponsorship model and pricing for 2019

Last year, we launched our new sponsorship model. This was after feedback from existing sponsors that we needed to be clearer about the benefits and costs of sponsorship.

For 2019, after feedback from users, we will no longer be displaying sponsors on our homepage. This will help our homepage to render better on smaller screens.

DOAJ sponsorship costs and benefits for 2019

DOAJ 2019 sponsorship costs and benefits

 

In 2019, a Gold sponsorship for commercial organisations is £15,000 and £7500 for non-commercial entities.  A Silver sponsorship is £10,000, and £5000 respectively; a Bronze is £5000 and £2500 respectively. If you would like to know what the money is spent on, you can read this publishers report from 2017 (2018’s is coming soon) or this post about our new mission statement which covers the areas on which we are focussing. Alternatively you can send me an email and I would be very happy to give you more information.

If you are interested in becoming a 2019 Sponsor for one of the most important online resources in academic publishing, and in joining our existing group of fantastic sponsors, then please contact me directly: dom@doaj.org. I look forward to hearing from you!

Infrastructure and why sustainable funding so important to services like DOAJ

You can’t run a service like DOAJ on a shoestring, or fund it on a hand-to-mouth basis, which is how DOAJ has been funded until last year, so large amounts of sustained funding are really crucial to the database’s security, stability, scalability and, ultimately, survival. Last month, DOAJ came under attack and the whole process from diagnosing the problem to resolution revealed just how fragile the DOAJ ecosystem can be under those circumstances.

Below is a guest blog post is by Steven Eardley, the DevOps Engineer at our technology partner, Cottage Labs.  You may remember that the SCOSS initiative was launched last year to provide DOAJ and Sherpa/RoMEO with levels of sustainable funding that would ensure the survival of 2 services which had been earmarked as vital to the open access movement. I asked Steven to write this post because, after DOAJ took a battering, I thought it would be useful for our community to understand exactly what happens when DOAJ becomes unresponsive, what it takes to keep DOAJ up and running, and what a difference sustainable funding can make for a service like DOAJ.

Thanks for reading!

Dom

The Directory of Open Access Journals experienced some sustained and repeated downtime events mid July to mid August, which required significant intervention from Cottage Labs. This post describes what happened and explains how we mitigated the issue, and illustrates some of the inherent vulnerability which needs to be addressed.

The system
The main DOAJ database is built on ElasticSearch which we run over a number of virtual machines. The DOAJ web application is built on the Flask web framework and is written in Python.

As well as the search interface on the website, searches to our database come from the OAI-PMH interface, our Atom feed, and ‘widgets‘ embedded on users’ sites. The DOAJ also has an API for programmatic interactions with our content allowing, for example, publishers to upload their content. To keep the ElasticSearch index performing correctly for the rest of the site, we tend to tweak the rate limit for the API during periods of high load.

The problem
The DOAJ website communicates with its database (“data store”) via the web (also know as the ‘query endpoint’), giving us control over what kinds of requests are permitted and the ability to filter responses to prevent data from being leaked unintentionally. Not all of the requests to ElasticSearch come from our own servers however because the DOAJ search pages utilise JavaScript which runs on users’ browsers. This means that the data store must be publicly accessible for our search pages to work. We keep the rate limit for this fairly high so pages are responsive.

During the period mentioned, we saw an elevated request rate via the query endpoint which resulted in all of the site functions slowing down. Eventually the index was overloaded and the DOAJ website stopped responding. Recovery tended to be fairly quick and site performance would be restored for a number of hours. However, the downtime was persistent and reoccurring, sometimes multiple times in a day.

The cause
While we could see the quantity of queries to our index had at least doubled from its normal rate, we couldn’t identify the source of the queries causing the trouble and couldn’t look for long-term trends. We will find resource to improve this in the future but monitoring of this kind is costly and is currently out of budget. Therefore, we mainly had to diagnose via inference. Our immediate action was to disable the application components one by one, endeavouring to pinpoint the source of the excess load. We turned off the API, the Atom feed, the back end editorial admin pages, and finally the OAI-PMH interface. The latter had a small impact on the index stability – we saw reduced memory use in the index and it was coping somewhat better with the load. This pointed us towards the source of the problem: deep paging.

Deep Paging – ElasticSearch’s kryptonite
Deep paging essentially means that someone or something is scrolling through a large number of objects sequentially leading to high memory commitment; the server must hold the entire context in memory to get deeper and deeper into the results. We determined that someone was sending thousands of requests per hour directly via the query endpoint, instead of through the API, and furthermore essentially trawling through all results over a long period of time. That is to say: they weren’t using a provided feature, rather bypassing the features and using a hidden route.

Each time the system went down, the traffic took a while to resume, presumably because the trawl had to be started again from the beginning.

The solution
Our next task was therefore to block these external sources of deep paging. First, we changed the permitted referral parameter (e.g. “`ref=ui“` in the request URL) and the traffic dropped off. Success? Not quite. These parameters are easy to spoof so it was of no surprise that not long later, the site went down once again amid further high traffic. We tried the same configuration change again, this time changing the referral parameter to “`please-use-our-api“` – the ‘begging’ approach to reducing system load! Unfortunately that bought us even less time than before.

At this point we categorised this as something like a denial of service attack – although the chances are it wasn’t intentionally malicious, circumvention of our countermeasures and being a direct source of instability for thousands of other users is at least inconsiderate!

User agent blocking was the next measure we attempted to reduce the load. Since the query route is really just for our use, we decided it was reasonable to block some programmatic user agents, such as the Node.js http module, or the wget and curl utilities. Again we saw a temporary alleviation of the high load.

Of course, user agent strings are sent from the client from each request, so they can be altered at source. By now we’d identified the user’s IP address, and watched a few intermittent requests come in as the user was iterating and figuring out what we’d changed. Within a couple of hours, the torrent of requests resumed and our infrastructure once again creaked under the strain.

Since we’re not keen on IP banning and other heavy-handed measures we decided to address the problem within our application code and give the query endpoint some rules to filter out the sorts of traffic that give the index trouble: we now cap the results to a reasonable number expected to be viewed from the search page; we enforce paging limits to disallow queries that page a long way into our data set; and the query endpoint will reject a request that doesn’t look like it came from a user.

The lesson
We were a little complacent about our query endpoint’s obscurity. For a long time we’d planned to tighten up the rules on the search interface but, with DOAJ’s long list of other developments, it wasn’t a priority. Our endpoint was open and available to function like a little bonus undocumented API and this was stretched to the limit when it was being used to harvest all of our data rather than just facilitating search functions. This is a lesson for the design stage of the software process: keep the roles of system components as distinct and single-purpose as feasible.

In addition, this persistent grab of our data constituted a feature request – it should be easier to download our entire DOAJ dataset and we will be implementing that over the coming weeks.

The improvements
We have a handful of improvements coming soon in response to these lessons:

  • We’ll be re-writing our OAI-PMH interface to mitigate deep paging and high memory use.
  • The Search API will also see some more restrictions to paging depth and number of results – this will more closely reflect its role as a discovery interface and not a harvest endpoint.
  • Create a dump of our entire dataset on a regular basis, that way the entirety of the DOAJ’s data is more easily accessible to the public without strain on our infrastructure.

Watch out here and on our social media channels for further announcements regarding these new developments.

The Long-Term Preservation of Open Access Journals

The long term preservation of open access journals is one of the 7 criteria for the DOAJ Seal because DOAJ believes that it is an extremely important business process which a publisher of academic content should commit to. This couldn’t be more applicable than in the Global South where financial support and rigorous standards around journal publishing aren’t always available and, sadly, journals tend to just disappear from the Internet without warning. This is a huge problem for the academic footprint of the Global South, not to mention the hundreds of authors whose published papers just aren’t online any more and cannot be retrieved or ever cited.

When DOAJ established its criteria for the Seal in 2014, we were conscious that anything with a cost associated with it effectively put up a barrier to those low income or financially unstable journals to getting the Seal. DOAJ is committed to smooth that path as much as possible. In 2013, DOAJ announced a working agreement with CLOCKSS, one of the archives included on our application form, to seek out funding for a joint project which would get as many of DOAJ’s long-tail of single journals archived and preserved as possible. Unfortunately, those plans didn’t come to fruition and since then, the archiving and digital preservation landscape has changed somewhat.

What remains to be done is clear however: we must help ALL journals get into an archiving and digital preservation program and therefore I am delighted to welcome this guest post by Craig Van Dyck, the Executive Director of the CLOCKSS Archive.

Thanks for reading.

Dom, DOAJ Operations Manager

Users of scholarly content rely upon long-term access to that content. Scholarly research is long-lived, and users need to be able to re-access content repeatedly.

One concern about digital scholarly journals is that they could disappear from the web, which would undermine scholars’ ability to access the materials that they need.

In response to this concern, several Preservation services are available. These services work somewhat differently, but they all aim to ensure the long-term availability of scholarly content on behalf of end-users. Prominent services are CLOCKSS and Portico in the US, Scholars Portal and the Public Knowledge Project Preservation Network (PKP PN) in Canada, and CINES in Europe. Publishers are welcome to participate in any or all of these services. And some national libraries also have archival collections.

In today’s environment, it is considered best-practice for a scholarly publisher to include its content in a preservation service. To receive the DOAJ Seal, journals must be included in a preservation system.

In this post, we will focus on CLOCKSS, with some reference to PKP PN, because those two services both use the LOCKSS technology, which is arguably at the high-end of the spectrum of preservation solutions.

LOCKSS Technology

LOCKSS stands for Lots of Copies Keep Stuff Safe. The technology was invented at the Stanford University Library about 20 years ago. It relies upon multiple copies of the digital content being hosted at geographically distributed nodes. The software (which is open source) includes a unique polling-and-repair mechanism. The multiple nodes are constantly exchanging information about the content that they hold. If one node reports a difference vs. the other nodes, that one node is out-voted by the other nodes, and the variant node’s piece of content is replaced by the correct content from one of the other nodes. In this way, the archive is “dark”, meaning that end-users do not access the content, but the technology ensures that the data is in good repair.

The CLOCKSS Archive

  • The C in CLOCKSS stands for Controlled. This is because CLOCKSS uses twelve servers located at blue-chip libraries around the world, all with first-rate infrastructure and security. CLOCKSS is a free-standing 501(c)(3) charitable non-profit organization, using the LOCKSS technology and working with the LOCKSS technical and operational teams at Stanford, to preserve scholarly content for the long-term. CLOCKSS is certified as a Trusted Digital Repository. In its Trustworthy Repositories Audit & Certification report by the Council for Research Libraries, CLOCKSS received the only perfect score for technology.
  • CLOCKSS includes many Open Access publishers. For example, 24 publishers using the open source OJS publishing system are preserved in CLOCKSS. In total, CLOCKSS is preserving over 20,000 journal titles, with over 30 million journal articles and 75,000 books, growing rapidly each year.
  • One unique aspect of CLOCKSS is that when content is “triggered” for access, CLOCKSS makes the content freely available to all, under a Creative Commons license, which is a sign of the commitment to the concept of Open Access. A “trigger” occurs if a journal has disappeared, or will soon disappear, from the web. To date CLOCKSS has triggered 53 journals.
  • CLOCKSS can access publishers’ journals in two different ways: by harvesting the content from the publishing platform; or by the publisher providing the content to CLOCKSS by FTP.
  • Another unique aspect of CLOCKSS is the governance structure. The Board of Directors is comprised half by libraries and half by publishers. The scholarly community itself is thus responsible for the policies and practices of CLOCKSS.
  • Publishers sign an Agreement with CLOCKSS, which governs rights and responsibilities. There is a small annual cost for participating in CLOCKSS. CLOCKSS is financially sustainable, which is an important element for a long-term preservation archive. 350 libraries around the world, as well as 250 publishers, contribute to CLOCKSS’s sustainability.

Public Knowledge Project Preservation Network (PKP PN)

  • The Public Knowledge Project is a multi-university initiative developing (free) open source software and conducting research to improve the quality and reach of scholarly publishing. PKP is based at Simon Fraser University in Canada, which is where the Open Journal Systems (OJS) software was originally developed.
  • The PKP Preservation Network is an additional capability that enables easy long-term preservation of journals using OJS version 2.4.8 or higher. PKP PN uses the LOCKSS preservation software.
  • There are currently 800 journals preserving their content in PKP PN.
  • There are no fees for participating in the PKP PN. A journal manager must agree to Terms of Use.

Conclusion

It is strongly recommended that scholarly journals and books should be preserved for the long-term in a preservation system. Content that is not preserved is at-risk of being lost. And publishers who do not contribute their content to a preservation system are at-risk of not being considered a serious publisher. The value of long-term preservation is well worth a small cost.

Craig Van Dyck
Executive Director, CLOCKSS Archive
cvandyck@clockss.org

The 10 Principles of Plan S

The welcome announcement last week from Marc Schiltz‘s Science Europe about cOAlition S and the publication of The 10 Principles of Plan S was well received at DOAJ Headquarters. The key principle of Plan S is:

“After 1 January 2020 scientific publications on the results from research funded by public grants provided by national and European research councils and funding bodies, must be published in compliant Open Access Journals or on compliant Open Access Platforms.”

The document continues to outline important factors surrounding the desired model of open access and this model sometimes follows closely DOAJ’s preferred model for open access:

  1. Authors will retain copyright.
  2. Content will be published under an open license which fulfils the requirements defined by the Berlin Declaration.
  3. All scientists should be able to publish Open Access even if they have limited means.
  4. Publications fees should be standardised or capped.
  5. The hybrid model of publishing is not compliant with the principles.

DOAJ is pleased to see these principles so in line with the DOAJ criteria.

Lars Bjørnshauge, DOAJ Founder and Managing Director, said: ‘While we should remember that these principles only cover Europe and focus on science and that they may not be applicable on all continents or to the humanities, they will hopefully have a positive impact. Their announcement is timely and they are a welcome move in the right direction. DOAJ is proud to support their implementation.’