New feature

We have improved our XML validation

xml

We are happy to announce that we have improved the features of our xml validation. As an article XML is uploaded to DOAJ from the publisher area we will check to see if the uploaded file meets a number of criteria:

  • Is it actually XML? (have you given us a PDF by mistake?)
  • Does the XML meet the DOAJ article schema requirements?
If your upload doesn’t meet either of those criteria you will get an error message straight away.  It will either tell you we didn’t think the file was XML, or it will give you a message from our validator which identifies the first problem found when validating.
If your file does pass those checks, it will get entered into our upload queue.  You will need to check back on your upload page in a while to see if the upload was processed successfully.  When we process your upload, we carry out some more checks to make sure that the data in DOAJ remains consistent:
  • Do you reference any ISSNs that belong to journals you don’t own?  You can’t attach articles to someone else’s journals.
  • Do you reference any ISSNs that don’t appear in DOAJ at all?  We only take uploads for journals we know about, and your journal records need to contain all the correct identifiers if you want to reference them.
  • Do you reference ISSNs that are owned by more than one user?  Sometimes it’s possible for the DOAJ to think that more than one user has a stake in an ISSN.  In these cases we need to resolve who the true owner is before you can upload.
If any of these situations arise with your file upload, we won’t import any of the articles, and instead record an error against the upload.  When you look at the upload record on the page you will see a link in the Notes column which says “show error details“.  When you click on that it will tell you in what way the articles failed to process, and which ISSNs were causing the problems.
If you see any other error messages on your upload page, you should click on the “show error details” link if it is available.  If not, you should contact us at feedback@doaj.org and we will get back to you as soon as we can.

 

DOAJ. Now with added PLOS.

Finally, after saying: “It’s coming” for almost a year, DOAJ has added the entire PLOS catalogue to its database. A total of 182,500 articles were added and the harvester is set to go out and collect new articles at 5.30am every morning. The harvester collects the metadata from Europe PMC.

This is a milestone for DOAJ: not only because it has been eager to get the PLOS article metadata for a long time; but also because the harvester can be re-tuned to go and search for other large bodies of content from other publishers on E-PMC. Eventually, with some extra development, we’ll be able to point the harvester at any body of content.

If you think your publisher would benefit from this approach, do please get in touch! Thanks to our technical partners, Cottage Labs, for their help in reaching this milestone.

NEW: continuations, improved tables of contents, feedback on a journal, APC granularity, and more…

Very soon, we will be releasing new functionality on DOAJ that will improve the detail in the journal record, increase DOAJ’s accuracy even more and will encourage greater input from the community. We have also abandoned our policy to remove journals that have ceased publication.

Continuations

Ever since we migrated to our new platform, we have been trying to find a slot in our development schedule to correctly display journal continuations on our site. It was important for us to get this correct, both in terms of the metadata and the display, so that users could easily understand how one, or several, journals transformed into a journal with a new title and ISSN. This new development will allow us to correctly display a journal’s timeline as it goes through name and ISSN changes.

Send us feedback on a journal

A decreasing amount of the data in DOAJ is old and DOAJ is always grateful to receive updates from users who get in touch to alert us to broken URLs or a change of title. With this in mind, and to make feeding back as simple as possible, we will add a ‘Tell us about this journal’ button to every journal entry in DOAJ. We hope this will encourage greater input from our users and lead to more updates to journal entries. This development is perfectly aligned with DOAJ being curated by the community and really facilitates an up-to-date resource.

Greater granularity for APC information

We know. The APC information on DOAJ was misleading. It lumps together 2 distinct groups of journals into one big ‘No’ group. We have broken that group out into: No, where we have up-to-date information from journals that they DO NOT charge APCs; and No information. ‘No information’ is the group of journals which has submitted a reapplication to us and we have yet to review it. The number of ‘No information’ journals will diminish in size as we work our way through the reapplications. I wrote about this inaccuracy previously.

Retaining the records – journals that have ceased publication

As long as they fulfil some basic criteria, we will no longer remove journals that cease publishing and we will even add back into DOAJ journals that were removed only because they stopped publishing. This change of policy could potentially add hundreds of articles back into DOAJ along with tens of archived journals.

Access from China

We have had several complaints from users in China that they were unable to use DOAJ. We realised that this is because the site uses Google javascript services and Google is banned in some parts of China, or by some institutions. We have now migrated most services off Google-related services (apart from Analytics) and are confident that the user experience for users in China will be vastly improved. This is perfectly times as we embark on a year-long project to increase awareness of open access in China.

Oh, and watch this space… In early June, we’ll be adding ~175 000 PLoS articles to DOAJ… More on that later.

 

Widgets! Embed DOAJ directly into your site.

Happy New Year to all of you! We have a gift: two shiny widgets! You can now embed a set of search results or a DOAJ search box directly into your web sites.

Embedding search results
It works like this: 1) carry out a search in DOAJ 2) filter and refine the results until they are as precise as you need them 3) use the Embed button ‘share|embed’ button at the top of the search results to reveal the code that you will paste into your web page. The results that you embed in your site update automatically as DOAJ updates.

Some possible uses might be: a publisher can now display a list of all its journals or articles, indexed in DOAJ, on its own site; a library can display all DOAJ indexed journals with no APCs that have the Seal; a researcher might embed a list of all open access articles with a CC BY license that are pertinent to her research group.

Embed a DOAJ search box in your site
You can also embed a DOAJ search box directly into your site, allowing your users to search for open access, peer reviewed journals and articles directly. A user carrying out a search in this way will be taken to the search results in DOAJ. The search box can be embedded into your site, library portal, web page or blog, making quality open access material more easily accessible alongside other content.

We’ve created a new page for the widgets which has a little more technical detail on how to configure them so they behave exactly as you want them to. As ever, we’re always interested in your feedback!

 

 

Development plan for 2015/6

Recent discussions with a partner reminded me that we haven’t published a development plan.

I’ve put together a high level list of our developments: what we are currently doing and what we have next on the list. As it stands, it will take us through to mid-2016 but it is a very fluid document. We have the flexibility to add in items and move others so the 2016 items will be revisited in January 2016 and reviewed to make sure nothing else has cropped up in the meantime.

Some of these items I have already announced in earlier posts. I’ve collected those here.

As always, I’d welcome your feedback.

The new site upgrades are live; it’ll take some time for the data to settle

All of our new site upgrades were successfully rolled out to the site last Wednesday. We’d like to hear what you think of the upgrades!

A few comments about what you will see now on the site:

  • I mentioned that we will need some time for the data to settle. The site displays the new dataset only. That means that the data will grow as publishers resubmit their reapplications and those are accepted back into DOAJ. If you have been monitoring the data closely, there will be a large jump in the figures you are reporting on so you’ll need to account for that in any analysis that you do. Specifically, the number of journals with or without APCs has changed and the totals for the number of articles published per year have also shifted. I shall publish a blog post shortly that contains the last counts of the APC data and articles per year before the site was upgraded. This will serve as a historic record only but it is important that it is available online.
  • Every journal has an extended ‘home page’ on DOAJ that reveals all the new data we’ve been collecting in our new form. There’s all the important bits up at the top, especially the APC information and then, by clicking on the ‘More’ button, you can reveal information about licensing, copyright and best practices that the journal adheres to.
  • We’ve improved the way that tables of contents are displayed so you can now see clearly the volumes, issues and, if a journal has one, a continuation.
  • We’ve tidied up the URLs. For example URLs for journals now look like this http://doaj.org/toc/2175-8042 instead of like this http://doaj.org/toc/0006191878084b8d8bddae52ce72c948. An improvement; I hope you agree!
  • Try our built-in URL shortening service from Bit.ly. It turns this:
    https://doaj.org/search?source={%22query%22%3A{%22filtered%22%3A{%22filter%22%3A{%22bool%22%3A{%22must%22%3A[{%22term%22%3A{%22_type%22%3A%22article%22}}%2C{%22term%22%3A{%22index.license.exact%22%3A%22CC%20BY%22}}%2C{%22term%22%3A{%22index.classification.exact%22%3A%22Health%20Sciences%22}}]}}%2C%22query%22%3A{%22match_all%22%3A{}}}}%2C%22from%22%3A0%2C%22size%22%3A10} into http://bit.ly/1IQ11j3 in two clicks!
  • Finally, we’ve added OpenURL back to the site so for any of you who were using that service to link out to DOAJ, you should find that those links now resolve again.

Thanks for your patience as we settle into the new data structure. It’s going to take some time for things to even out, not least because our site upgrade has revealed the true nature of the data and we have some data clean-up tasks to do.

If you have any specific questions about what you are seeing then do get in touch!

Updates to DOAJ will be switched off while we upgrade the site

Earlier this month I wrote about the twelve developments that we were working on. These are now ready to be released to the live site this week and we will be making the upgrade between Tuesday (21st April) evening and Wednesday (22nd April) morning British Summer Time (GMT+1). During this time, we will switch off all parts of the site that allow new data to be submitted to us:

  • the application form
  • the form for adding article metadata
  • the XML upload page for uploading article metadata
  • the CSV upload page for submitting bulk reapplications
  • the reapplication form

All other aspects of the site will continue to function as normal. We expect a full service to be reinstated by Wednesday 12 noon BST. I will post further updates here.