Content licensing company TollBit claimed artificial intelligence companies are bypassing website restrictions in order to use web scraping technology on publishers’ work without their consent, Reuters reports. TollBit said in a letter to publishers that “AI agents from multiple sources (not just one company) are opting to bypass the robots.txt protocol to retrieve content from sites.”
Full story