News Sites Push For More Robots.txt Control
A global group of publishers is rallying behind a set of extensions to the robots.txt protocol called Automated Content Access Protocol (ACAP). Comprised mainly of publishers and news organizations like the Associated Press, the consortium is fighting for more control over what content the search engines can gain access to.
ACAP currently only offers provisions for text and still images, but publishers can choose to limit how long the engines can cache their content, enforce page-wide no follows, and other options. The protocol has been tested with French search engine Exalead for functionality.
Publishers -- and more importantly, the engines -- will have to adopt the protocol on a large scale for it to gain traction. Google for example, is arguing that ACAP hasn't been proven effective for publishers outside of the news media. And Danny Sullivan notes that while robots.txt is definitely in need of an upgrade, online retailers and blog sites might need provisions that ACAP doesn't cover.
Recent Around the Net in Search Marketing Articles
-
DuckDuckGo Search Traffic Rises 33% Since NSA Revealed June 19, 3:50 p.m.
Billed as an alternative to Google, DuckDuckGo has increased traffic by 33% since the NSA news ... -
Health Care Industry Increasing Search, Tracking Capabilities June 19, 2:55 p.m.
While some search engines and apps believe they don't need tracking technology to serve up relevant ... -
Meet Evidon, Ghostery's Parent Company June 19, 12:47 p.m.
Evidon, which bought Ghostery in 2010, helps companies improve their use of "tracking code by selling ... -
Making Redirects As Simple As Change Of Address June 18, 5:58 p.m.
301 redirects can clean up messy architectures, solve outdated content problems, and improve user experiences when ... -
Amazon Launches Electronic Birthday Gift Cards On Facebook June 18, 12:49 p.m.
Amazon Tuesday introduced the Birthday Gift giving feature allowing friends to surprise friends and relatives on their ... -
Brands Missing Op In Twitter Vine? June 18, 12:47 p.m.
Vine, with its 6-second short videos, could provide another targeting option in Twitter for brands. John ... -
How Bing Voice Search Got Faster, More Accurate June 18, 12:43 p.m.
Bing has made voice search on Windows more accurate and twice as fast through technology called ... -
Cannes Going Branded Content June 17, 2:49 p.m.
Will search marketers head to Cannes Lions next year? That's the first thing I thought after ... -
How Google Promotes An Entrepreneurial Culture June 17, 12:15 p.m.
Google has created its own YouTube "intern" series where viewers can follow five real interns during ... -
The Stuff In Google Glass June 14, 2:51 p.m.
A hardware teardown reveals the components and technology in Google Glass, a head-mounted voice-controlled Android computer ...
Be the first to comment on "News Sites Push For More Robots.txt Control "
Leave a Comment