Speed Bumps and Walls for SE Crawlers
Certain types of site navigation and site structure may hold back or entirely prevent search engines from getting your website's content. As search engine spiders crawl the internet, they rely on the structural design of hyperlinks to find new documents and revisit those that may have changed.
Complex linking strategies and deep site structures, with little distinctive content and too much graphics may serve as "bumps", while the information that cannot be accessed by spiderable links may qualify as "walls." So don't use fancy editing tricks to tell a story. Use them only to enhance the story.
Possible "Speed Bumps" for SE Crawlers:
Collected article from http://www.rankingtoday.com/articles/3/1/Site-Navigation-and-SEO.html
Certain types of site navigation and site structure may hold back or entirely prevent search engines from getting your website's content. As search engine spiders crawl the internet, they rely on the structural design of hyperlinks to find new documents and revisit those that may have changed.
Complex linking strategies and deep site structures, with little distinctive content and too much graphics may serve as "bumps", while the information that cannot be accessed by spiderable links may qualify as "walls." So don't use fancy editing tricks to tell a story. Use them only to enhance the story.
Possible "Speed Bumps" for SE Crawlers:
- URLs with more than two dynamic parameters
- Pages with over 100 unique links to other pages (crawlers may not follow each of them)
- Pages more than 3 clicks away from the the home page
- Pages using a "Session ID" or Cookie during navigation (spiders may not be able to use these elements)
- Pages with "frames" can hold back the site crawling and confuse spiders about which pages to rank in the results
- Pages requiring a drop down menu (HTML attribute) to access them
- Image map navigation structure
- Flash content and navigation
- Pages accessible only via a select form and submit button
- Documents accessible only via a search box
- Documents blocked purposefully (via a robots meta tag or robots.txt)
- Pages requiring a login
- Pages that re-direct before showing content
Collected article from http://www.rankingtoday.com/articles/3/1/Site-Navigation-and-SEO.html
Comments