{"id":806,"date":"2019-07-03T10:09:58","date_gmt":"2019-07-03T16:09:58","guid":{"rendered":"https:\/\/kennethcurtis.com\/articles\/?p=806"},"modified":"2019-07-03T11:08:36","modified_gmt":"2019-07-03T17:08:36","slug":"the-all-powerful-google-has-spoken","status":"publish","type":"post","link":"https:\/\/kennethcurtis.com\/articles\/2019\/07\/03\/the-all-powerful-google-has-spoken\/","title":{"rendered":"The all powerful Google has spoken"},"content":{"rendered":"<p><img loading=\"lazy\" class=\"size-medium wp-image-811 alignright\" src=\"https:\/\/kennethcurtis.com\/articles\/wp-content\/uploads\/2019\/07\/robots-235x300.jpg\" alt=\"robot\" width=\"235\" height=\"300\" srcset=\"https:\/\/kennethcurtis.com\/articles\/wp-content\/uploads\/2019\/07\/robots-235x300.jpg 235w, https:\/\/kennethcurtis.com\/articles\/wp-content\/uploads\/2019\/07\/robots.jpg 244w\" sizes=\"(max-width: 235px) 100vw, 235px\" \/>So the title is a little bit incendiary in my opinion mainly because of my attitude toward Google lately. When Google first appeared on the WWW stage it was a breath of fresh air. Finally there was a site that seemed to want to provide a quality service that didn&#8217;t just care about money unlike many of the search engines of the time. My pre-google favorite was Alta Vista and without any hesitation I dumped AV and ran to Google. Besides having a clean interface, accurate results, and of course who could forget the, &#8220;I feel lucky&#8221; button made me want Google to succeed. This was all back in about 1999, if my memory serves me correctly. In a very short period of time Google was the most popular search engine and in my opinion the quality of their search warranted it.<\/p>\n<p>That seems so long ago now. The once playful attitude and quality search has, in my opinion been replaced with a huge corporation that feels that it has the duty to police the web. <!--more-->Where they fit into the internet landscape of what I remember to be the Wild Wild West of web sites, they won the battle. They saw the deficiencies <em>and worked within them<\/em> to become number one. Good on you, Google.<\/p>\n<div class=\"mks_pullquote mks_pullquote_left\" style=\"width:300px; font-size: 24px; color: #000000; background-color:#ffffff;\">\u2026 they are stepping on every web designer to control their own business model<\/div>As mentioned, that was a long time ago, and now, it is my opinion that they are stepping on every web designer to control their own business model. With 63% of the search market (<a href=\"https:\/\/www.statista.com\/statistics\/267161\/market-share-of-search-engines-in-the-united-states\/\">https:\/\/www.statista.com\/statistics\/267161\/market-share-of-search-engines-in-the-united-states\/<\/a>) they have a massive control on whether a site gets seen or not seen to the general public. This means that if you&#8217;re a web designer you must follow Google&#8217;s rules if the site you&#8217;re working on is going to be listed by Google. Yeah, I know, Google is a private company and they should be allowed to do their business the way they choose. Well yes, in theory I agree, but that doesn&#8217;t mean that I have to like them for doing it. In fact I left Google search for <a href=\"http:\/\/www.DuckDuckGo.com\">DuckDuckGo.com<\/a> about five years ago mostly because of Google&#8217;s tracking of my movements around the web.<\/p>\n<p><img loading=\"lazy\" class=\"size-medium wp-image-816 alignright\" src=\"https:\/\/kennethcurtis.com\/articles\/wp-content\/uploads\/2019\/07\/drevil-300x213.jpg\" alt=\"Google is evil\" width=\"300\" height=\"213\" srcset=\"https:\/\/kennethcurtis.com\/articles\/wp-content\/uploads\/2019\/07\/drevil-300x213.jpg 300w, https:\/\/kennethcurtis.com\/articles\/wp-content\/uploads\/2019\/07\/drevil-250x177.jpg 250w, https:\/\/kennethcurtis.com\/articles\/wp-content\/uploads\/2019\/07\/drevil.jpg 423w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/>This post is based on an article that I read at <a href=\"https:\/\/thenextweb.com\/google\/2019\/07\/02\/google-wants-to-make-the-25-year-old-robots-txt-protocol-an-internet-standard\/\">The Next Web<\/a> entitled, &#8220;<em>Google wants to make the 25-year-old robots.txt protocol an internet standard<\/em>.&#8221; For anyone not sure what robots.txt is, it&#8217;s basically a way for a web designer to instruct bots how to behave when they come to the site. It can deny or allow bots from indexing the site or can give instructions about whether to include or exclude separate files or folders. It is a very weak method of a code of behavior for the bot. I say it&#8217;s weak because there isn&#8217;t any way that you can control the bot, the robots.txt has no teeth and can&#8217;t stop a bad bot from doing what it wants. Now Google has decided to make standards for the robots.txt. My very first thought is, what? My second was, &#8220;who the hell is Google to set standards?&#8221; I get it, their business is mostly, if not solely on the web and they are a huge corporation, but that doesn&#8217;t give them the right to make rules and then possibly enforce them through denying someone&#8217;s site from being listed. In fact all I see is a huge corporation trying to make their job easier.<\/p>\n<p>I want to be clear, I get it. Google has a right as a private company to do what it wants. Some, or even all of their rules make sense at some level and could make the WWW a safer place, maybe. What I dislike is that I trusted them so long ago and the result was that I helped create a monster. A corporate giant with the desire to control something that they have no right to control. I want a little chaos on the web, I want the freedom to do what I want, and mostly to not have anyone tell me that my site is bad because Google doesn&#8217;t list it. It&#8217;s not Google&#8217;s job to judge, they should index the web and display the results. Period.<\/p>\n<p>Afte<img loading=\"lazy\" class=\"size-medium wp-image-818 alignleft\" src=\"https:\/\/kennethcurtis.com\/articles\/wp-content\/uploads\/2019\/07\/justsayno-300x295.jpg\" alt=\"Just say no to corporate influence of the web\" width=\"300\" height=\"295\" srcset=\"https:\/\/kennethcurtis.com\/articles\/wp-content\/uploads\/2019\/07\/justsayno-300x295.jpg 300w, https:\/\/kennethcurtis.com\/articles\/wp-content\/uploads\/2019\/07\/justsayno-250x246.jpg 250w, https:\/\/kennethcurtis.com\/articles\/wp-content\/uploads\/2019\/07\/justsayno.jpg 400w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/>r I have said my piece about Google, I started to envision people sticking up for them. <em>&#8220;Come on, it&#8217;s a good thing. Google is just pushing for what good designers are already doing.&#8221; <\/em>In theory I agree, this is nothing in the big picture. A robots.txt file is nothing but a simple text file that wouldn&#8217;t take 2 minutes to complete. The core of my displeasure over what Google is doing is I can see a time when we lose the freedom to surf the net. That sites like google will create a tiered system of web sites that supports large corporate sites and omits or neglects to serve smaller sites.\u00a0 I will take it a step further too, there may be in the very near future legislation that controls who can add a site, or ban a site if it doesn&#8217;t fit <em>their standards<\/em> (whoever &#8220;their&#8221; is). What if Google decides that it should ban a candidates site in the upcoming election?\u00a0 That, I hope we can agree on, would be a very bad thing. How far are we from this happening now?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>So the title is a little bit incendiary in my opinion mainly because of my attitude toward Google lately. When Google first appeared on the WWW stage it was a breath of fresh air. Finally there was a site that seemed to want to provide a quality service that didn&#8217;t just care about money unlike many of the search engines of the time. My pre-google favorite was Alta Vista and without any hesitation I dumped [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":811,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[168,3],"tags":[163,164,166,167,105,165],"_links":{"self":[{"href":"https:\/\/kennethcurtis.com\/articles\/wp-json\/wp\/v2\/posts\/806"}],"collection":[{"href":"https:\/\/kennethcurtis.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kennethcurtis.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kennethcurtis.com\/articles\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/kennethcurtis.com\/articles\/wp-json\/wp\/v2\/comments?post=806"}],"version-history":[{"count":12,"href":"https:\/\/kennethcurtis.com\/articles\/wp-json\/wp\/v2\/posts\/806\/revisions"}],"predecessor-version":[{"id":821,"href":"https:\/\/kennethcurtis.com\/articles\/wp-json\/wp\/v2\/posts\/806\/revisions\/821"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/kennethcurtis.com\/articles\/wp-json\/wp\/v2\/media\/811"}],"wp:attachment":[{"href":"https:\/\/kennethcurtis.com\/articles\/wp-json\/wp\/v2\/media?parent=806"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kennethcurtis.com\/articles\/wp-json\/wp\/v2\/categories?post=806"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kennethcurtis.com\/articles\/wp-json\/wp\/v2\/tags?post=806"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}