Real-Time Search Fills Internet With Garbage
Now that Google, Microsoft, Yahoo and others have figured out a way to make the Internet come alive as events happen, the next challenge will become filtering the garbage that real-time search creates.
The most interesting part of real-time search will materialize when engines develop a method to track behavior and serve up ads based on the intent people expose in real-time search queries. Being able to link ads to that moment in time will give brands incredible insight into consumers and another measurement to add to the marketing funnel.
In a chat room poll asking how search engines will filter the garbage coming from Twitter tweets and Facebook status updates in real-time search, one SEO professional who answers to the screen name "Contempt" tells me "there will always be a way around it, always a way to abuse it, always a way to get in it. And, if it makes money, people will find a way to abuse it." Another SEO expert went as far as calling real-time search "bullshit."
Don't get me wrong. Catching a glimpse of important news trending on Twitter about the release of Apple's tablet or an earthquake in Haiti can provide the first look into breaking news, but people who search the Internet for information want to trust the data they sift through, especially the mounds of tweets sent through Google Alerts.
David Dague, Localeze vice president of marketing, tells me search engines have identified, but not solved, the problem of filtering the garbage to find the "value" from Twitter tweets and Facebook posts. "Trying to verify the source of the information is the first challenge," he says.
The debate rages on about the value of real-time search. Some argue that it adds character and human perspective to a topic, while others believe it fills the Internet with false facts and garbage.
Mark Drummond, chief executive officer at Wowd, a real-time search engine whose company mantra is "discovering what's popular on the Web right now," agrees the issue has two sides.
"First, what are you searching through when you issue a search query: tweets, blog posts, the entire Web? If you're only searching through the space of tweets, then you're pretty well guaranteed to get a bunch of phatic social commentary that just happens to match your search query," he says. "If instead you're searching through the entire Web, and all the pages that the global Web contains, then you've got a much better chance of finding some quality content."
The second issue related to real-time search "garbage" is ranking, Drummond explains. Even in real-time search, it's important to actually rank content according to quality and relevance to the query. And while time is an important factor of such a ranking calculation, it's not the only factor.
That's fine, but as one panelist during Tuesday's OMMA Social panel "Debate: Is Real-Time Search for Real? Or Just Another Tweet in the Pan?" put it, only Google knows where to find the end of the Internet.
Moderating the panel, Uwe Hook, Direct Partners senior vice president, told attendees that more people died on Twitter in 2009 than actually did in real life, demonstrating the point that one shouldn't trust all the information in tweets.
I agreed with Gregory Keller, vice president of product management at lijit, which focuses on social graphs, who says Twitter is a black hole that consumes time. The OMMA Social panelist told attendees information isn't generated through the microblogging site, but rather data that half the time produces a nonsensical mess that clutters the Internet.
"There's no such thing as real-time search," Keller says, calling real-time search engines "content generators," or data; only when a human can synthesize the post does the data become useful.
Twitter's 140-character messages provide a window into the information, but can't possibly share it all. The site has somewhere between 25 million and 30 million messages streaming daily, according to Gerry Campbell, chief executive officer at real-time search engine Collecta, citing a variety of sources. "Marisa Mayer of Google says there's somewhere around a billion-plus new pieces of real-time information being published every day," he adds. "It's important to keep those things in perspective."
Campbell believes Twitter provides society with an incredible tool to access instant information, but you can't always express everything in 140 characters. The industry will need filters to sift through the garbage generated from real-time search, something that Ben Carlson, president at Fizziology, knows all too well.
Watching real-time search chatter works for Carlson. His company, which monitors social media metrics for the entertainment industry, uses real-time search to monitor buzz on movies. "Just looking at the real-time feeds of everything being tweeted about is kind of meaningless," he says. "You have to just look for opinions, and how those opinions get shaped and change over time."