Amazon Investigates Allegations of Scraping Abuse Leading to Confusion
Amazon’s cloud division is currently investigating Perplexity AI to determine if the artificial intelligence search startup is violating Amazon Web Services rules by scraping websites that have blocked it. The Robot Exclusion Protocol, a web standard that specifies which pages should not be accessed by robots and automated crawlers, is being ignored by Perplexity AI. … Read more