Open Access vs. open excess: DOAJ and AI scraper bots
Web scraping to train large language models has surged in the past few years, overwhelming open access infrastructures like DOAJ with massive bot traffic. In this post, DOAJ Platform Manager Brendan O’Connell discusses how we’re responding to these challenges. Since the launch of ChatGPT in 2022, it’s been impossible to escape endless news headlines about…
