John Andrews is a Competitive Webmaster and Search Engine Optimization Consultant in Seattle, Washington. This is John Andrews blog on issues of interest to the SEO community and competitive webmasters. Want to know more?

johnon.com  Competitive Webmastering & SEO
July 17th, 2006 by john andrews

Google User Agent Strings and Cloaking

For all those “Black Hatters” out there cloaking Google by User Agent (heh heh) we have one new UA to add to your list. Michael Gray reports that Google is now using yet one more user agent string for it’s AdWords Quality Checker. So, if you are a cloaker and have been using UA strings like these:

Mediapartners-Google/2.1
Googlebot/2.1 (+http://www.googlebot.com/bot.html)
Googlebot/2.1 (+http://www.google.com/bot.html)
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/)
Googlebot/2.0 beta (googlebot@googlebot.com)
Googlebot/2.0 (+http://googlebot.com/bot.html)
Googlebot/1.0 (googlebot@googlebot.com)
Googlebot/2.1w (+http://googlebot.com/bot.html)
Googlebot-w/2.1 (+http://googlebot.com/bot.html)
Googlebot/1.0
Googlebot-Image/1.0
Google WAP Proxy/1.0
Nokia-WAPToolkit/1.2 googlebot(at)googlebot.com

you now have one more to add:

Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)

My my my, what has the world come to.

DISCLAIMER: Well, for some reason I feel I must save the newbie from getting misled by my tongue in cheek posts around here. First, it is always a bad idea to cloak based on User Agent. Anybody can spoof that from their own browser and reveal your deception. Also, Google can control UA as it wants, thus detecting your deception. The consequences of cloaking are said to be serious (I would not know :-)

It has been said for years that Google sends stealth bots out without UA strings, from non-Google IPs as a test for cloaking. I always believed it, but never tested it. Why should I? I know UA cloaking is easy to defeat, so why use it? Well now Mr. Gray shows pretty solid evidence that Google is more than willing to cloak for competitive gain. Proof. There ya go.

This post of mine jokingly suggests you add that generic IE UA string to your cloaking list… that would be stupid. It’s a basic UA string used by versions of Microsoft’s Internet Explorer. You’d be cloaking a large percentage of your users. Don’t do that, ok? Don’t be stupid. The point (if your head doesn’t already have one) is that you can’t effectively cloak by UA. See?

Topical Tags:
★★ Click to Share!    Digg this     Create a del.icio.us Bookmark     Add to Newsvine

Competitive Webmaster

Wonder how to be more competitive at some aspect of the web? Submit your thoughts.

SEO Secret

Not Post Secret

Click HERE



about


John Andrews is a mobile web professional and competitive search engine optimzer (SEO). He's been quietly earning top rank for websites since 1997. About John

navigation

blogroll

categories

comments policy

archives

credits

Recent Posts: ★ Ted Leonsis’ Crazy Ideas, Revisited ★ Affiliate Summit Las Vegas - Free Pass ★ Affiliate Link Bashing and The Self-defeating Marketing community ★ Canon 5D Mark II in the hands of..imagers? ★ Canon 5D Mark II DigitalSLR w/HD Video ★ SEOs Do Your Homework ★ It’s Good Content, but is it “real”? Do you care? ★ Yahoo GLUE Mashup ★ “Just Make Good Content” is Bullsh*t ★ Reminder: Set Your Clocks and Check Your SSL Certificates ★ Google has Priorities, just like my 8 year old ★ Google’s Brand Arrogance & Typo Domains Revisited ★ It seems EVERYONE is stuffing your local Flash storage… ★ Reputation Management Domains : SEO Online Reputation Web sites ★ Live Blogging T.R.A.F.F.I.C. East, New York ★ Canon 5DMkII debuts with 1080p pro video ★ New York Times trashes AOL Brand ★ Hacking the Nike+ iPod sensor interface ★ Google’s Figured Out Better Ways to Know About You ★ Breeding Bad Domain Names ★ Google Chrome Bait ‘n Switch? ★ Google Chrome and Your Privacy ★ I’m Going to Work for Google ★ What is Google Hiding? 403 Forbidden: “your query looks similar to automated requests” ★ The Platform is Not the Message, Mark Cuban. 

Subscribe

☆ about

John Andrews is a mobile web professional and competitive search engine optimzer (SEO). He's been quietly earning top rank for websites since 1997. About John

☆ navigation

  • John Andrews and Competitive Webmastering
  • E-mail Contact Form
  • What does Creativity have to do with SEO?
  • How to Kill Someone Else's AdSense Account: 10 Steps
  • Invitation to Twitter Followers
  • ...unrelated: another good movie "Clean" with Maggie Cheung
  • ...unrelated: My Hundred Dollar Mouse
  • Competitive Thinking
  • Free SEO for NYPHP PHP Talk Members
  • Smart People
  • Disclosure Statement
  • Google Sponsored SPAM
  • Blog Post ideas
  • X-Cart SEO: How to SEO the X Cart Shopping Cart
  • IncrediBill.blogspot.com
  • the nastiest bloke in seo
  • Seattle Domainers Conference
  • Import large file into MySQL : use SOURCE command
  • Vanetine's Day Gift Ideas: Chocolate Fragrance!
  • ☆ blogroll

  • Bellingham SEO
  • Hans Cave Diving in Mexico
  • Healthcare Search Marketing
  • John Andrews
  • John Andrews SEO
  • Mixminion
  • PrivateBloggingWiki
  • Privoxy
  • SEO Quiz
  • SMX Search Marketing Expo
  • T.R.A.F.F.I.C. East 2007
  • TOR
  • ☆ categories

    Competition (37)
    Competitive Intelligence (14)
    Competitive Webmastering (412)
    Webmasters to Watch (4)
    domainers (47)
    Oprah (1)
    photography (1)
    Privacy (10)
    Public Relations (164)
    SEO (304)
    Client vs. SEO (2)
    Link Building (2)
    Search Engines vs. SEO (1)
    SEO SECRETS (9)
    SEO vs. SEO (1)
    ThreadWatch Watching (5)
    Silliness (22)
    society (7)
    Uncategorized (21)

    ☆ archives

  • December 2008
  • November 2008
  • October 2008
  • September 2008
  • August 2008
  • July 2008
  • June 2008
  • May 2008
  • April 2008
  • March 2008
  • February 2008
  • January 2008
  • December 2007
  • November 2007
  • October 2007
  • September 2007
  • August 2007
  • July 2007
  • June 2007
  • May 2007
  • April 2007
  • March 2007
  • February 2007
  • January 2007
  • December 2006
  • November 2006
  • October 2006
  • September 2006
  • August 2006
  • July 2006