Just an Online Minute... Spiders and Robots
Spiders and robots automatically search Web content for information. They are used for a number of tasks including retrieval of content information for commercial search engines, gathering content pages for offline viewing, tracking advertising activity and identification of "What's new information".
At any given time there may be a multitude of these agents on a site. Without this master list, sites may have a problem distinguishing between non-human spider and robot activity and consumer interactions, thus skewing the metrics that are reported to advertisers.
The ABCi/IAB list will be updated monthly and is available to IAB members and ABCi clients free of charge. It is the third step in a chain of recommendations, which will culminate in guidelines that the IAB will issue by the end of the year, all geared to improving the quality of online ad campaign measurement.
IAB President/CEO Robin Webster said the primary benefits of the list will be to reduce the time, effort and cost to publishers, third party ad servers and agencies associated with report reconciliation, and to provide advertisers with accurate measurement metrics. "Publishers will be able to filter out robot traffic from their reporting to advertisers, instilling greater confidence in the medium."
Next steps in the process will include additional analysis and research conducted by ABCi on the effect of spiders and robots on the two different methods of ad serving: client-initiated and server-initiated, followed by the release of measurement guidelines by year-end.
Recent Just An Online Minute Articles
-
A Vulcan Salute For The Best Ad Campaigns May 14, 2:39 p.m.
Last Wednesday, during Creative Week, The One Club held its annual One Show honoring the best ...
-
A Little Rain Can't Keep Email Insiders Down May 3, 3:15 p.m.
AMELIA ISLAND, Fla. – Rapleaf’s Cecily Jaros wondered what she had missed at the Email Insider ...
-
You Don't Need to Search Far for Fun on Amelia Island May 1, 12:52 p.m.
On Sunday through this morning, search experts descended upon Amelia Island for MediaPost’s bi-annual Search Insider ...
-
500 Women Strong At Horizon Media April 26, 12:54 p.m.
On Tuesday, April 23, Horizon Media opened their doors and their amazing roof deck to 500 ...
-
Redefining The Meaning Of Housewarming With Yext March 8, 12:08 p.m.
On March 5 I headed over to Yext’s housewarming party to celebrate their new digs, located ...
-
An Evening with the Skinnygirl Feb. 7, 12:44 p.m.
On Tuesday, February 5th, Warner Bros. Brand Networks celebrated their fall line-up at Amy Sacco’s newly ...
-
'Check Out My Web Series!': NATPE In Miami Jan. 31, 12:18 p.m.
NATPE Miami: Content First Jan. 28 – 30 Fontainebleau Resort It’s the end of January -- ...
-
Agencies Tie One On At Creative Media Awards Jan. 24, 1:08 p.m.
Last Wednesday over 200 agency big thinkers, decked out in their dapper best, descended upon The ...
-
Vibrant Media Reinvents Halloween Nov. 19, 12:31 p.m.
What happened to Halloween?! The effects of Hurricane Sandy caused major devastation, loss and inconvenience - ...
-
In A Word, BuzzFeed Music Event Was So OMG (Okay, So It's An Acronym, Not A Word, But You Get My Drift) Oct. 26, 6 p.m.
The digital elite were out on the town Tuesday night to fête the launch of BuzzFeed’s ...


Be the first to comment on "Just an Online Minute... Spiders and Robots"
Leave a Comment