Metadata

We have improved our XML validation

xml

We are happy to announce that we have improved the features of our xml validation. As an article XML is uploaded to DOAJ from the publisher area we will check to see if the uploaded file meets a number of criteria:

  • Is it actually XML? (have you given us a PDF by mistake?)
  • Does the XML meet the DOAJ article schema requirements?
If your upload doesn’t meet either of those criteria you will get an error message straight away.  It will either tell you we didn’t think the file was XML, or it will give you a message from our validator which identifies the first problem found when validating.
If your file does pass those checks, it will get entered into our upload queue.  You will need to check back on your upload page in a while to see if the upload was processed successfully.  When we process your upload, we carry out some more checks to make sure that the data in DOAJ remains consistent:
  • Do you reference any ISSNs that belong to journals you don’t own?  You can’t attach articles to someone else’s journals.
  • Do you reference any ISSNs that don’t appear in DOAJ at all?  We only take uploads for journals we know about, and your journal records need to contain all the correct identifiers if you want to reference them.
  • Do you reference ISSNs that are owned by more than one user?  Sometimes it’s possible for the DOAJ to think that more than one user has a stake in an ISSN.  In these cases we need to resolve who the true owner is before you can upload.
If any of these situations arise with your file upload, we won’t import any of the articles, and instead record an error against the upload.  When you look at the upload record on the page you will see a link in the Notes column which says “show error details“.  When you click on that it will tell you in what way the articles failed to process, and which ISSNs were causing the problems.
If you see any other error messages on your upload page, you should click on the “show error details” link if it is available.  If not, you should contact us at feedback@doaj.org and we will get back to you as soon as we can.

 

The Redalyc JATS project strides towards standardisation.

Every now and then we hear news that is music to our ears and this time its news from Redalyc who have recently announced their project to transition their journals to the JATS XML format. The decision to make the transition was taken last year and on August 29th Redalyc will be launching their new online tool (Marcalyc) for XML JATS markup. From the press release:

‘Redalyc has undertaken a transition to the adoption of XML-JATS which provides a standardized format for describing and exchanging structured data. Redalyc’s strategy is based on empowering editors by providing tools and knowledge to make XML tagging a sustainable process. Redalyc is launching a new online tool (Marcalyc) for XML JATS markup—compatible with the JATS4R recommendation—as a free service for the Open Access journals indexed by Redalyc, a tool which is not designed to be used by technical experts or programmers.

Once having XML files, Redalyc will provide enriched file formats like ePUB and intelligent readers resulting in greater visibility and accessibility for Open Access research in Latin America, lowering costs for journals and leveraging the power of new technologies.’*

Redalyc are also launching an XML JATS reader which will improve the reader experience for the user, with powerful features like responsiveness, reference linking, search inside, image gallery, section navigation and automatic conversion to ePUB, PDF and HTML, all based in JATS4R specification. They have also provided a free online certification course (https://attendee.gotowebinar.com/register/9160206569091767555), the last of which runs today, in which they have trained editors in the adoption of JATS.

Arianna Becerril, Director of Technology and Innovation at Redalyc and DOAJ Advisory Board member, said: “We believe the adoption of JATS in Redalyc will help the Open Access science produced in Latin America achieve a greater international visibility, increasing the possibilities for that content to be discovered, read and cited. And also, this new feature will help journals to reach higher standards like the DOAJ criteria in the case of machine readability. [Today] we’re feeding article metadata for almost 100 journals into DOAJ with links to the full-text PDF. Now we’ll be providing links not only to the PDF file but also ePUB, the smart reader and HTML for the journals with XML markup.”

Well done Redalyc! This will surely play an important role in the continued growth of academic publishing from Latin America.

*much more information about this excellent project is available in Spanish at https://xmljatsredalyc.org/

A lot goes a long way: data quality improvement at DOAJ

Since 2012, DOAJ has been on a path of data quality improvement. DOAJ metadata is used all over the world and all over the Web. Improving and fixing the quality of our metadata can be painstaking work but the effort goes a long way as changes propagate across the Web via search engines, aggregator databases, library portals and other databases.

Along these lines, the largest publisher (in terms of the number of journals) in DOAJ recently added missing abstracts to over 100,000 articles and fixed broken special characters in approximately 2000 more. This was a huge effort on their part and DOAJ is grateful for the work that has gone into this project. It is an achievement that will be welcomed by DOAJ metadata consumers.

To date, Hindawi has 161,334 articles loaded to DOAJ and until recently was the largest contributor of metadata to our index. That title was taken from them recently when DOAJ ingested the entire PLOS archive from Europe PMC.

DOAJ. Now with added PLOS.

Finally, after saying: “It’s coming” for almost a year, DOAJ has added the entire PLOS catalogue to its database. A total of 182,500 articles were added and the harvester is set to go out and collect new articles at 5.30am every morning. The harvester collects the metadata from Europe PMC.

This is a milestone for DOAJ: not only because it has been eager to get the PLOS article metadata for a long time; but also because the harvester can be re-tuned to go and search for other large bodies of content from other publishers on E-PMC. Eventually, with some extra development, we’ll be able to point the harvester at any body of content.

If you think your publisher would benefit from this approach, do please get in touch! Thanks to our technical partners, Cottage Labs, for their help in reaching this milestone.

NEW: continuations, improved tables of contents, feedback on a journal, APC granularity, and more…

Very soon, we will be releasing new functionality on DOAJ that will improve the detail in the journal record, increase DOAJ’s accuracy even more and will encourage greater input from the community. We have also abandoned our policy to remove journals that have ceased publication.

Continuations

Ever since we migrated to our new platform, we have been trying to find a slot in our development schedule to correctly display journal continuations on our site. It was important for us to get this correct, both in terms of the metadata and the display, so that users could easily understand how one, or several, journals transformed into a journal with a new title and ISSN. This new development will allow us to correctly display a journal’s timeline as it goes through name and ISSN changes.

Send us feedback on a journal

A decreasing amount of the data in DOAJ is old and DOAJ is always grateful to receive updates from users who get in touch to alert us to broken URLs or a change of title. With this in mind, and to make feeding back as simple as possible, we will add a ‘Tell us about this journal’ button to every journal entry in DOAJ. We hope this will encourage greater input from our users and lead to more updates to journal entries. This development is perfectly aligned with DOAJ being curated by the community and really facilitates an up-to-date resource.

Greater granularity for APC information

We know. The APC information on DOAJ was misleading. It lumps together 2 distinct groups of journals into one big ‘No’ group. We have broken that group out into: No, where we have up-to-date information from journals that they DO NOT charge APCs; and No information. ‘No information’ is the group of journals which has submitted a reapplication to us and we have yet to review it. The number of ‘No information’ journals will diminish in size as we work our way through the reapplications. I wrote about this inaccuracy previously.

Retaining the records – journals that have ceased publication

As long as they fulfil some basic criteria, we will no longer remove journals that cease publishing and we will even add back into DOAJ journals that were removed only because they stopped publishing. This change of policy could potentially add hundreds of articles back into DOAJ along with tens of archived journals.

Access from China

We have had several complaints from users in China that they were unable to use DOAJ. We realised that this is because the site uses Google javascript services and Google is banned in some parts of China, or by some institutions. We have now migrated most services off Google-related services (apart from Analytics) and are confident that the user experience for users in China will be vastly improved. This is perfectly times as we embark on a year-long project to increase awareness of open access in China.

Oh, and watch this space… In early June, we’ll be adding ~175 000 PLoS articles to DOAJ… More on that later.

 

New article on DOAJ available at ScienceOpen

We have just published an article in the open access journal ScienceOpen Research, giving an overview of the history and current status of the DOAJ. Please read and share the article! We would welcome your participation in the post-publication peer review of this article and/or any comments.

Criteria for open access and publishing
Authors: Tom Olijhoek, Dominic Mitchell and Lars Bjornshauge
DOI: 10.14293/S2199-1006.1.SOR-EDU.AMHUHV.v1

After a brief historical overview, DOAJ policies regarding open access, intellectual property rights and questionable publishers are explained in detail. The larger part of the article is a much requested explanation on how DOAJ uses its new set of criteria for the evaluation of open access journals and the rationale behind choosing the seven extra criteria that qualify for the DOAJ Seal. A final section is devoted to the extended possibilities that DOAJ offers to scholars and publishers for searching the database and for uploading metadata.

Our new CSV file is online!

Our new, improved CSV file of journal metadata is now online and ready to be downloaded!

The updated file includes all of the new information that we have been collecting and recently started displaying with our site upgrade such as APC information, whether the journal is part of an archiving program, which type of peer review and more! The old file had 17 columns of information; the new one has 54!

Remember that the amount of information in the CSV will increase as each journal has their reapplication accepted to remain indexed in DOAJ. There are currently 510 journals with the new information completed.

All information in the CSV file is shared with you under the terms of a CC BY-SA license.

As always, let me know if you have feedback or questions!