To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine's database by using a meta tag specific to robots. When a search engine visits a site, the robots.txt located in the root directory is the first file crawled. The robots.txt file is then parsed and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam.[46]

The most common form of organic SEM is search engine optimization (SEO). SEO refers to a variety of techniques designed to help your website rank higher in search engine results. Optimizing your website involves doing a little bit of research on what keywords or phrases your customers or potential customers are searching for when they are looking for your products or services online. It then involves writing web content using those keywords in a way that is both easy for search engines to pick up but still readable and pleasant for your website visitors.
Webmasters and content providers began optimizing websites for search engines in the mid-1990s, as the first search engines were cataloging the early Web. Initially, all webmasters needed only to submit the address of a page, or URL, to the various engines which would send a "spider" to "crawl" that page, extract links to other pages from it, and return information found on the page to be indexed.[5] The process involves a search engine spider downloading a page and storing it on the search engine's own server. A second program, known as an indexer, extracts information about the page, such as the words it contains, where they are located, and any weight for specific words, as well as all links the page contains. All of this information is then placed into a scheduler for crawling at a later date.
However, you can use paid campaigns to reinforce core messages that you’ve shared via organic posts. For example, if the company has been involved in a public crisis (think Volkswagen and the emissions crisis), then information you’ve provided to people who have contacted you can be used as part of a wider educational marketing program with paid ads to extend the message reach.
For our client: We only used a smaller quantity of very high-quality link building each month. So, for example we only built 40 of the best links each month to supplement the work we were doing on the content marketing front. We also invested heavily into tracking competitor backlink profiles, using Majestic SEO and Open Site Explorer. We worked out how the competitor's acquired specific backlinks, then by using outreach and content creation we obtained these links.
As of 2009, there are only a few large markets where Google is not the leading search engine. In most cases, when Google is not leading in a given market, it is lagging behind a local player. The most notable example markets are China, Japan, South Korea, Russia and the Czech Republic where respectively Baidu, Yahoo! Japan, Naver, Yandex and Seznam are market leaders.
Early versions of search algorithms relied on webmaster-provided information such as the keyword meta tag or index files in engines like ALIWEB. Meta tags provide a guide to each page's content. Using metadata to index pages was found to be less than reliable, however, because the webmaster's choice of keywords in the meta tag could potentially be an inaccurate representation of the site's actual content. Inaccurate, incomplete, and inconsistent data in meta tags could and did cause pages to rank for irrelevant searches.[10][dubious – discuss] Web content providers also manipulated some attributes within the HTML source of a page in an attempt to rank well in search engines.[11] By 1997, search engine designers recognized that webmasters were making efforts to rank well in their search engine, and that some webmasters were even manipulating their rankings in search results by stuffing pages with excessive or irrelevant keywords. Early search engines, such as Altavista and Infoseek, adjusted their algorithms to prevent webmasters from manipulating rankings.[12]
11th point to me would be too look at your social media properties, work out how you can use them to assist your SEO strategy. I mean working on competitions via social channels to drive SEO benefit to your main site is great, working on re-doing your YouTube videos to assist the main site and also working on your content sharing strategy via these social sites back to the main site.
I agree with the point that a small or medium-sized business will have limits for budget and resources in generating brand search, but I wouldn't say that stops them from potentially producing huge growth there if they do something interesting/innovative etc. I can think of quite a few small to medium sized brands that have more name recognition than larger companies in their space. The challenge is that many of those brands are led by people who are very good at generating marketing and publicity - it's harder for small brands to be able to afford to pay for a top level consultant or agency.
I feel we can also focus a lot on the kind of keywords we target. I had a client who was in a very competitive market place, we optimized their site for some really targeted, long tailed keywords which didn’t have very high search volume, so the traffic didn’t really go up drastically but the amount of conversions & the kind of CTRs the site received was incredible.
Paid Search (PPC): Paid search results are advertisements. A business pays to have their ads displayed when users do a search containing specific keywords. The ads are typically displayed above and to the right of organic search results. The exact placement of the ads is determined by both a bidding process and quality score. The advantages and drawbacks of paid search are often the opposite of organic listings.
Webmasters and content providers began optimizing websites for search engines in the mid-1990s, as the first search engines were cataloging the early Web. Initially, all webmasters needed only to submit the address of a page, or URL, to the various engines which would send a "spider" to "crawl" that page, extract links to other pages from it, and return information found on the page to be indexed.[5] The process involves a search engine spider downloading a page and storing it on the search engine's own server. A second program, known as an indexer, extracts information about the page, such as the words it contains, where they are located, and any weight for specific words, as well as all links the page contains. All of this information is then placed into a scheduler for crawling at a later date.
(function(){"use strict";function s(e){return"function"==typeof e||"object"==typeof e&&null!==e}function a(e){return"function"==typeof e}function u(e){X=e}function l(e){G=e}function c(){return function(){r.nextTick(p)}}function f(){var e=0,n=new ne(p),t=document.createTextNode("");return n.observe(t,{characterData:!0}),function(){t.data=e=++e%2}}function d(){var e=new MessageChannel;return e.port1.onmessage=p,function(){e.port2.postMessage(0)}}function h(){return function(){setTimeout(p,1)}}function p(){for(var e=0;et.length)&&(n=t.length),n-=e.length;var r=t.indexOf(e,n);return-1!==r&&r===n}),String.prototype.startsWith||(String.prototype.startsWith=function(e,n){return n=n||0,this.substr(n,e.length)===e}),String.prototype.trim||(String.prototype.trim=function(){return this.replace(/^[\s\uFEFF\xA0]+|[\s\uFEFF\xA0]+$/g,"")}),String.prototype.includes||(String.prototype.includes=function(e,n){"use strict";return"number"!=typeof n&&(n=0),!(n+e.length>this.length)&&-1!==this.indexOf(e,n)})},"./shared/require-global.js":function(e,n,t){e.exports=t("./shared/require-shim.js")},"./shared/require-shim.js":function(e,n,t){var r=t("./shared/errors.js"),i=(this.window,!1),o=null,s=null,a=new Promise(function(e,n){o=e,s=n}),u=function(e){if(!u.hasModule(e)){var n=new Error('Cannot find module "'+e+'"');throw n.code="MODULE_NOT_FOUND",n}return t("./"+e+".js")};u.loadChunk=function(e){return a.then(function(){return"main"==e?t.e("main").then(function(e){t("./main.js")}.bind(null,t))["catch"](t.oe):"dev"==e?Promise.all([t.e("main"),t.e("dev")]).then(function(e){t("./shared/dev.js")}.bind(null,t))["catch"](t.oe):"internal"==e?Promise.all([t.e("main"),t.e("internal"),t.e("qtext2"),t.e("dev")]).then(function(e){t("./internal.js")}.bind(null,t))["catch"](t.oe):"ads_manager"==e?Promise.all([t.e("main"),t.e("ads_manager")]).then(function(e){undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined}.bind(null,t))["catch"](t.oe):"publisher_dashboard"==e?t.e("publisher_dashboard").then(function(e){undefined,undefined}.bind(null,t))["catch"](t.oe):"content_widgets"==e?Promise.all([t.e("main"),t.e("content_widgets")]).then(function(e){t("./content_widgets.iframe.js")}.bind(null,t))["catch"](t.oe):void 0})},u.whenReady=function(e,n){Promise.all(window.webpackChunks.map(function(e){return u.loadChunk(e)})).then(function(){n()})},u.installPageProperties=function(e,n){window.Q.settings=e,window.Q.gating=n,i=!0,o()},u.assertPagePropertiesInstalled=function(){i||(s(),r.logJsError("installPageProperties","The install page properties promise was rejected in require-shim."))},u.prefetchAll=function(){t("./settings.js");Promise.all([t.e("main"),t.e("qtext2")]).then(function(){}.bind(null,t))["catch"](t.oe)},u.hasModule=function(e){return!!window.NODE_JS||t.m.hasOwnProperty("./"+e+".js")},u.execAll=function(){var e=Object.keys(t.m);try{for(var n=0;n=c?n():document.fonts.load(l(o,'"'+o.family+'"'),a).then(function(n){1<=n.length?e():setTimeout(t,25)},function(){n()})}t()});var w=new Promise(function(e,n){u=setTimeout(n,c)});Promise.race([w,m]).then(function(){clearTimeout(u),e(o)},function(){n(o)})}else t(function(){function t(){var n;(n=-1!=y&&-1!=v||-1!=y&&-1!=g||-1!=v&&-1!=g)&&((n=y!=v&&y!=g&&v!=g)||(null===f&&(n=/AppleWebKit\/([0-9]+)(?:\.([0-9]+))/.exec(window.navigator.userAgent),f=!!n&&(536>parseInt(n[1],10)||536===parseInt(n[1],10)&&11>=parseInt(n[2],10))),n=f&&(y==b&&v==b&&g==b||y==x&&v==x&&g==x||y==j&&v==j&&g==j)),n=!n),n&&(null!==_.parentNode&&_.parentNode.removeChild(_),clearTimeout(u),e(o))}function d(){if((new Date).getTime()-h>=c)null!==_.parentNode&&_.parentNode.removeChild(_),n(o);else{var e=document.hidden;!0!==e&&void 0!==e||(y=p.a.offsetWidth,v=m.a.offsetWidth,g=w.a.offsetWidth,t()),u=setTimeout(d,50)}}var p=new r(a),m=new r(a),w=new r(a),y=-1,v=-1,g=-1,b=-1,x=-1,j=-1,_=document.createElement("div");_.dir="ltr",i(p,l(o,"sans-serif")),i(m,l(o,"serif")),i(w,l(o,"monospace")),_.appendChild(p.a),_.appendChild(m.a),_.appendChild(w.a),document.body.appendChild(_),b=p.a.offsetWidth,x=m.a.offsetWidth,j=w.a.offsetWidth,d(),s(p,function(e){y=e,t()}),i(p,l(o,'"'+o.family+'",sans-serif')),s(m,function(e){v=e,t()}),i(m,l(o,'"'+o.family+'",serif')),s(w,function(e){g=e,t()}),i(w,l(o,'"'+o.family+'",monospace'))})})},void 0!==e?e.exports=a:(window.FontFaceObserver=a,window.FontFaceObserver.prototype.load=a.prototype.load)}()},"./third_party/tracekit.js":function(e,n){/**

Everyone wants to rank for those broad two or three word key phrases because they tend to have high search volumes. The problem with these broad key phrases is they are highly competitive. So competitive that you may not stand a chance of ranking for them unless you devote months of your time to it. Instead of spending your time going after something that may not even be attainable, go after the low-hanging fruit of long-tail key phrases.

Paid inclusion is a search engine marketing method in itself, but also a tool of search engine optimization, since experts and firms can test out different approaches to improving ranking and see the results often within a couple of days, instead of waiting weeks or months. Knowledge gained this way can be used to optimize other web pages, without paying the search engine company.

That’s not to say that there isn’t the same kind of competitive intelligence where SEO is concerned. In fact, I’m a big fan of analyzing your competitor’s SEO landscape. You can check what keywords they’re targeting and their sources of referral traffic to strengthen your strategy. But the bottom line is this: Your competitors can’t steal your content. The experience that you provide to users is unique to you.The more organic traffic you have, the more currency you have in the online space.

It’s unreasonable to assume that you will pull top rank in Google for every keyword relating to your industry. Your goal should be to pull top rank on the most desired keywords. This is an exercise that will take the effort of both marketing and management. Think about how people would search for your products and services, make a list of these keywords, and check the traffic for each term with a tool like Google’s Keyword Planner. Naturally you will want to rank for the keywords with the most traffic, so whittle your list down to the highest-trafficked, most relevant terms.


Lynn, you have one of the best sites for affiliate marketing that I've ever seen. Just read your interview with Rosalind Gardner and found some interesting nuggets. Marketers should note the intuitive and spontaneous way you approached a niche and keywords. This is usually where "paralysis analysis" begins … some spend weeks with keyword and research tools until there is no "creative energy" left to build the site.
Black hat SEO refers to the practice of trying to trick the search engines into giving you higher rankings by using unethical tactics, such as buying links. The risk is just too great. Even if you enjoy a temporary boost in rankings due to black hat tactics, it’s likely to be short lived. Google is getting better and better at spotting dirty tricks and sooner or later the progress you made will be wiped out by an algorithm update, or worse, your site will get removed from the index altogether.
A good call to action has a clear message and action. It should move people in the direction of purchasing. On a blog post, a good CTA may point people to more in-depth content like an e-book. It can also point people to your products and services. However, the in-depth content is more effective. You can then pitch your product or service using the in-depth content.

While SEO seems to be the perfect plan for building your brand, one of the setbacks of this strategy is that it works in a slow-paced manner, and you might just be overwhelmed. Most keywords are usually already dominated by bigger brands. So if you are just starting up and are targeting to compete with other big brands, SEO services for small businesses like you might not be the perfect fit.
You know who and where your best customers are — Bing Ads lets you choose when and how to reach them. Control where your ads appear by city, state, country and worldwide. Fine-tune your targeting even further by setting the time of day to display your ads and on which devices. By targeting only your most relevant customers, you can reduce unnecessary spending.
Optimization techniques are highly tuned to the dominant search engines in the target market. The search engines' market shares vary from market to market, as does competition. In 2003, Danny Sullivan stated that Google represented about 75% of all searches.[63] In markets outside the United States, Google's share is often larger, and Google remains the dominant search engine worldwide as of 2007.[64] As of 2006, Google had an 85–90% market share in Germany.[65] While there were hundreds of SEO firms in the US at that time, there were only about five in Germany.[65] As of June 2008, the marketshare of Google in the UK was close to 90% according to Hitwise.[66] That market share is achieved in a number of countries.
With the development of this system, the price is growing under the high level of competition. Many advertisers prefer to expand their activities, including increasing search engines and adding more keywords. The more advertisers are willing to pay for clicks, the higher the ranking for advertising, which leads to higher traffic.[15] PPC comes at a cost. The higher position is likely to cost $5 for a given keyword, and $4.50 for a third location. A third advertiser earns 10% less than the top advertiser, while reducing traffic by 50%.[15] The investors must consider their return on investment and then determine whether the increase in traffic is worth the increase.
Look to successful brands to see how they keep customers engaged. Do you need to constantly update content, as Home Depot does with its seasonal DIY tips? Or do you need to position yourself as a lifestyle brand, following in Red Bull’s footsteps by running a series of videos on YouTube? Whatever method you adopt, it’s important to have some quantifiable way to measure how successful you are, so keep your ultimate goal in mind as you evaluate your return on investment.

You’re not going to like this answer. But wouldn’t it be so simple if we would tell you to do one or the other and get stellar results? The truth is, an effective marketing campaign should include a bit of both strategies. For the short-term, a paid search campaign can give your business a quick boost, helping you gain exposure to customers searching for the relevant keywords in your campaign; however, sometimes consumers don’t trust—or even look at—paid ads. Using organic search methods, which consumers tend to see as trustworthy, will help drive traffic and increase revenue over the long haul, and solidify your position as a leader and authority in your niche.


The home page of your site is usually a good place to start. It typically holds a wide array of information about your product or service and will lead the website visitor to where they want to go. However, if you have other informative pages on your site that you think would be more helpful, you may want to choose one of those pages in addition to, or instead of, the home page.
On the other hand, structured data are also a real asset to increase your organic traffic and improve your CTR. They refers to values that help search engines categorize and index your content in a creative ways for the user. While there is no direct correlation between those data and a SEO improvement, structured data can really help you boost your visibility in SERPs.
In addition to helping you find keywords you should be bidding on, thorough keyword research can also help you identify negative keywords – search terms that you should exclude from your campaigns. Negative keywords aren’t terms with negative connotations, but rather irrelevant terms that are highly unlikely to result in conversions. For example, if you sell ice cream, you might want to exclude the keyword “ice cream recipes”, as users searching for ice cream recipes are unlikely to be in the market for your product.

Because so few ordinary users (38% according to Pew Research Center) realized that many of the highest placed "results" on search engine results pages (SERPs) were ads, the search engine optimization industry began to distinguish between ads and natural results.[citation needed] The perspective among general users was that all results were, in fact, "results." So the qualifier "organic" was invented to distinguish non-ad search results from ads.[citation needed]
×