Metadata

Update on discontinued journals

DOAJ will remove all journals that have ceased to publish unless they are continued by another title.

Although reversing a previous decision, we have taken this step after careful consideration in order to keep our metadata as relevant and as accurate as possible. Although there are clear advantages to retaining published articles from discontinued journals, there is also a downside. With the current number of discontinued journals in DOAJ standing at 208, over time this generates a lot of broken links—link rot increases over time—affecting the quality of our metadata. All of the library catalogues, discovery services, search engines and other downstream services which rely heavily on our metadata start inheriting that link rot.

[UPDATE: I should clarify that removing a journal and its content from DOAJ simply makes it unavailable to the public. DOAJ doesn’t delete anything. We are hoping to collaborate with an archiving partner to help preserve journal content. If those plans come to fruition there is no reason why some removed journals could not be reinstated. However, it is early days on those discussions. – Dom]

 

Parts of DOAJ metadata in my catalogue/discovery service/A-Z List have changed, are out-of-date or are missing completely. Why?

It’s time to update your index and/or ask your discovery service provider to do so!

We have received  several messages via our Feedback account from library catalogue administrators, their readers, and researchers asking why all of a sudden so many of the articles indexed from DOAJ are now missing? Within library catalogues, users are perhaps seeing a 404 message. On DOAJ itself, users are noticing that the article content included in DOAJ is much changed and reduced. Why is this?

Hopefully it is old news to you now that DOAJ has been undertaking its Reapplication project. Over the last 6 months, the DOAJ Team has made a final, huge push to process all the reapplications. This project is so very nearly complete: out of the 6359 reapplications submitted to us, only a handful are still to be re-checked. 2072 of the reapplications did not pass our new standards. This means that the range of journals in DOAJ has changed considerably; very quickly over a relatively short period of time.

Aggregators / Service Providers / Library Catalogue administrators: we strongly advise you to re-index / update / download again the DOAJ article metadata offering—via OAI-PMH, or our API—so that your catalogues have the most up-to-date version of our index. The DOAJ index changes weekly so it might be time to revisit how often you come to us for updates and increase that frequency. Learn more about how to interact with DOAJ.

If you are using the search or browse features at DOAJ, then be aware that some of the journals you are used to seeing in the Directory may no longer be there.

If you have any questions about the effect of the reapplication project on DOAJ, about indexing DOAJ via our API or OAI-PMH services, or even how to search and browse, then please leave a comment here or send email to feedback@doaj.org.

We have improved our XML validation

xml

We are happy to announce that we have improved the features of our xml validation. As an article XML is uploaded to DOAJ from the publisher area we will check to see if the uploaded file meets a number of criteria:

  • Is it actually XML? (have you given us a PDF by mistake?)
  • Does the XML meet the DOAJ article schema requirements?
If your upload doesn’t meet either of those criteria you will get an error message straight away.  It will either tell you we didn’t think the file was XML, or it will give you a message from our validator which identifies the first problem found when validating.
If your file does pass those checks, it will get entered into our upload queue.  You will need to check back on your upload page in a while to see if the upload was processed successfully.  When we process your upload, we carry out some more checks to make sure that the data in DOAJ remains consistent:
  • Do you reference any ISSNs that belong to journals you don’t own?  You can’t attach articles to someone else’s journals.
  • Do you reference any ISSNs that don’t appear in DOAJ at all?  We only take uploads for journals we know about, and your journal records need to contain all the correct identifiers if you want to reference them.
  • Do you reference ISSNs that are owned by more than one user?  Sometimes it’s possible for the DOAJ to think that more than one user has a stake in an ISSN.  In these cases we need to resolve who the true owner is before you can upload.
If any of these situations arise with your file upload, we won’t import any of the articles, and instead record an error against the upload.  When you look at the upload record on the page you will see a link in the Notes column which says “show error details“.  When you click on that it will tell you in what way the articles failed to process, and which ISSNs were causing the problems.
If you see any other error messages on your upload page, you should click on the “show error details” link if it is available.  If not, you should contact us at feedback@doaj.org and we will get back to you as soon as we can.

 

The Redalyc JATS project strides towards standardisation.

Every now and then we hear news that is music to our ears and this time its news from Redalyc who have recently announced their project to transition their journals to the JATS XML format. The decision to make the transition was taken last year and on August 29th Redalyc will be launching their new online tool (Marcalyc) for XML JATS markup. From the press release:

‘Redalyc has undertaken a transition to the adoption of XML-JATS which provides a standardized format for describing and exchanging structured data. Redalyc’s strategy is based on empowering editors by providing tools and knowledge to make XML tagging a sustainable process. Redalyc is launching a new online tool (Marcalyc) for XML JATS markup—compatible with the JATS4R recommendation—as a free service for the Open Access journals indexed by Redalyc, a tool which is not designed to be used by technical experts or programmers.

Once having XML files, Redalyc will provide enriched file formats like ePUB and intelligent readers resulting in greater visibility and accessibility for Open Access research in Latin America, lowering costs for journals and leveraging the power of new technologies.’*

Redalyc are also launching an XML JATS reader which will improve the reader experience for the user, with powerful features like responsiveness, reference linking, search inside, image gallery, section navigation and automatic conversion to ePUB, PDF and HTML, all based in JATS4R specification. They have also provided a free online certification course (https://attendee.gotowebinar.com/register/9160206569091767555), the last of which runs today, in which they have trained editors in the adoption of JATS.

Arianna Becerril, Director of Technology and Innovation at Redalyc and DOAJ Advisory Board member, said: “We believe the adoption of JATS in Redalyc will help the Open Access science produced in Latin America achieve a greater international visibility, increasing the possibilities for that content to be discovered, read and cited. And also, this new feature will help journals to reach higher standards like the DOAJ criteria in the case of machine readability. [Today] we’re feeding article metadata for almost 100 journals into DOAJ with links to the full-text PDF. Now we’ll be providing links not only to the PDF file but also ePUB, the smart reader and HTML for the journals with XML markup.”

Well done Redalyc! This will surely play an important role in the continued growth of academic publishing from Latin America.

*much more information about this excellent project is available in Spanish at https://xmljatsredalyc.org/

A lot goes a long way: data quality improvement at DOAJ

Since 2012, DOAJ has been on a path of data quality improvement. DOAJ metadata is used all over the world and all over the Web. Improving and fixing the quality of our metadata can be painstaking work but the effort goes a long way as changes propagate across the Web via search engines, aggregator databases, library portals and other databases.

Along these lines, the largest publisher (in terms of the number of journals) in DOAJ recently added missing abstracts to over 100,000 articles and fixed broken special characters in approximately 2000 more. This was a huge effort on their part and DOAJ is grateful for the work that has gone into this project. It is an achievement that will be welcomed by DOAJ metadata consumers.

To date, Hindawi has 161,334 articles loaded to DOAJ and until recently was the largest contributor of metadata to our index. That title was taken from them recently when DOAJ ingested the entire PLOS archive from Europe PMC.

DOAJ. Now with added PLOS.

Finally, after saying: “It’s coming” for almost a year, DOAJ has added the entire PLOS catalogue to its database. A total of 182,500 articles were added and the harvester is set to go out and collect new articles at 5.30am every morning. The harvester collects the metadata from Europe PMC.

This is a milestone for DOAJ: not only because it has been eager to get the PLOS article metadata for a long time; but also because the harvester can be re-tuned to go and search for other large bodies of content from other publishers on E-PMC. Eventually, with some extra development, we’ll be able to point the harvester at any body of content.

If you think your publisher would benefit from this approach, do please get in touch! Thanks to our technical partners, Cottage Labs, for their help in reaching this milestone.

NEW: continuations, improved tables of contents, feedback on a journal, APC granularity, and more…

Very soon, we will be releasing new functionality on DOAJ that will improve the detail in the journal record, increase DOAJ’s accuracy even more and will encourage greater input from the community. We have also abandoned our policy to remove journals that have ceased publication.

Continuations

Ever since we migrated to our new platform, we have been trying to find a slot in our development schedule to correctly display journal continuations on our site. It was important for us to get this correct, both in terms of the metadata and the display, so that users could easily understand how one, or several, journals transformed into a journal with a new title and ISSN. This new development will allow us to correctly display a journal’s timeline as it goes through name and ISSN changes.

Send us feedback on a journal

A decreasing amount of the data in DOAJ is old and DOAJ is always grateful to receive updates from users who get in touch to alert us to broken URLs or a change of title. With this in mind, and to make feeding back as simple as possible, we will add a ‘Tell us about this journal’ button to every journal entry in DOAJ. We hope this will encourage greater input from our users and lead to more updates to journal entries. This development is perfectly aligned with DOAJ being curated by the community and really facilitates an up-to-date resource.

Greater granularity for APC information

We know. The APC information on DOAJ was misleading. It lumps together 2 distinct groups of journals into one big ‘No’ group. We have broken that group out into: No, where we have up-to-date information from journals that they DO NOT charge APCs; and No information. ‘No information’ is the group of journals which has submitted a reapplication to us and we have yet to review it. The number of ‘No information’ journals will diminish in size as we work our way through the reapplications. I wrote about this inaccuracy previously.

Retaining the records – journals that have ceased publication

As long as they fulfil some basic criteria, we will no longer remove journals that cease publishing and we will even add back into DOAJ journals that were removed only because they stopped publishing. This change of policy could potentially add hundreds of articles back into DOAJ along with tens of archived journals.

Access from China

We have had several complaints from users in China that they were unable to use DOAJ. We realised that this is because the site uses Google javascript services and Google is banned in some parts of China, or by some institutions. We have now migrated most services off Google-related services (apart from Analytics) and are confident that the user experience for users in China will be vastly improved. This is perfectly times as we embark on a year-long project to increase awareness of open access in China.

Oh, and watch this space… In early June, we’ll be adding ~175 000 PLoS articles to DOAJ… More on that later.