Inviting The Crawlers To Dig Deeper On Your Site
Armed with this info, you can try to identify any patterns in the pages that weren't indexed. For example, are there any internal pages that have inadequate link juice? Member profile pages that don't really need to be indexed? Perhaps there are duplicate content issues between the product description pages and the shopping cart. If it's a lack of link juice, Smarty suggests finding quality deep-linking directories to bulk up the deep links to your subdirectory pages.
Lastly, you want to make sure that you're not forcing the crawlers to spend too much time on bulky content. "Googlebot works on a budget," Smarty says. "If you keep it busy crawling huge files, or waiting for your page to load, or following duplicate content URLs, you might be missing the chance to show it your other pages."
Recent Around the Net in Search Marketing Articles
-
Google Acquires Makani Power May 23, 12:46 p.m.
Google has acquired Makani Power, a startup described as building power-generating cable-tethered flying wind turbines, to ... -
Qihoo 360 Takes On Baidu May 22, 12:45 p.m.
China's Qihoo 360 continues to ramp up its search services with the help of e-commerce giant ... -
Tips On Authorship May 21, 1:10 p.m.
Authorship has the potential to change the way marketers and consumers view content and its authors. ... -
The Double-Serve Through A Google Loophole Effect May 20, 1:19 p.m.
Google warns against not serving up the same ad twice in a short period of time, ... -
Google Turns Open Into Real-Time Bids May 20, 1:18 p.m.
Google last week released a customizable toolkit for building real-time bidding applications that the company calls ... -
Google, NASA Form Lab To Study Quantum Computing May 16, 12:18 p.m.
Google and NASA will partner on a project focused on machine learning and study how quantum ... -
What States Use Bing, Google Most? May 16, 12:17 p.m.
A WebpageFX study tracking more than 1,000 providers in Google Analystics found that Bing owns 8.3724% ... -
Microsoft, Yahoo Inch Up To Nearly 30% Search Market Share May 16, 12:16 p.m.
comScore released April 2013 search engine rankings Wednesday. As usual, Google sites led the U.S. explicit core ... -
Will Google Announce Music Subscription Service At I/O? May 15, 12:36 p.m.
The rumors that Google will launch a subscription music service should not come as a surprise ... -
Prepaid Smartphones Gaining Ground May 15, 10:03 a.m.
Will it matter to brands if the consumers they try to reach through advertising turn to ...
Be the first to comment on "Inviting The Crawlers To Dig Deeper On Your Site "
Leave a Comment