To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine's database by using a meta tag specific to robots. When a search engine visits a site, the robots.txt located in the root directory is the first file crawled. The robots.txt file is then parsed and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam.[46]
At the end of the day, webmasters just need to know their sites: chances are your analytics tool is more like a person than a software package, and will classify traffic in irrational ways. I’ve stumbled across website traffic originating from diverse and confusing sources being classed as direct — often requiring a considerable amount of thought and exploration to work out what is happening.

I still believe that Facebook and Google are great platforms to promote your business, but only if you are willing to pay. If your goal is Organic growth, I recommend looking at newer platforms such as Quora, Reddit, Snapchat, Medium, Instagram, Tumblr and similar. These are all established platforms that still offer some opportunities for organic reach, because although popular, they are nowhere near the saturation levels of Facebook and Google. You can also look at startups that you feel will become very successful in the future, take a small gamble perhaps and try to establish a strong presence there.
Search engine optimization (SEO) campaigns generate organic traffic. The goal of SEO is to improve website ranking for relevant keywords. You want your website to show up on the first page of organic search results – ‘organic’ refers to the middle section of results you see in search engines – for what you’re selling, and you’d probably be considered super human if you did that without organic SEO.
AdWords is recognized as a web-based advertising utensil since it adopts keywords which can deliver adverts explicitly to web users looking for information in respect to a certain product or service. It is flexible and provides customizable options like Ad Extensions, access to non-search sites, leveraging the display network to help increase brand awareness. The project hinges on cost per click (CPC) pricing where the maximum cost per day for the campaign can be chosen, thus the payment of the service only applies if the advert has been clicked. SEM companies have embarked on AdWords projects as a way to publicize their SEM and SEO services. One of the most successful approaches to the strategy of this project was to focus on making sure that PPC advertising funds were prudently invested. Moreover, SEM companies have described AdWords as a practical tool for increasing a consumer’s investment earnings on Internet advertising. The use of conversion tracking and Google Analytics tools was deemed to be practical for presenting to clients the performance of their canvas from click to conversion. AdWords project has enabled SEM companies to train their clients on the utensil and delivers better performance to the canvass. The assistance of AdWord canvass could contribute to the growth of web traffic for a number of its consumer’s websites, by as much as 250% in only nine months.[30]

Google is moving into more and more aggressively commercial spaces, like jobs, flights, products, all of these kinds of searches where previously there was opportunity and now there's a lot less. If you're Expedia or you're Travelocity or you're Hotels.com or you're Cheapflights and you see what's going on with flight and hotel searches in particular, Google is essentially saying, "No, no, no. Don't worry about clicking anything else. We've got the answers for you right here."


SEO techniques can be classified into two broad categories: techniques that search engine companies recommend as part of good design ("white hat"), and those techniques of which search engines do not approve ("black hat"). The search engines attempt to minimize the effect of the latter, among them spamdexing. Industry commentators have classified these methods, and the practitioners who employ them, as either white hat SEO, or black hat SEO.[49] White hats tend to produce results that last a long time, whereas black hats anticipate that their sites may eventually be banned either temporarily or permanently once the search engines discover what they are doing.[50]
Understanding the working mechanism of social algorithms is not a piece of cake. The algorithm for each social platform works differently. For instance, on Facebook, a core factor that affects the rankings of a post is its relevancy score, whereas on YouTube the total watch time of the video per session decides whether a video enters a ‘Recommended Video’ section or not.
Content that ranks well in organic search – and does so for a long time – is particularly hard to out-rank due to the strong, positive signals it sends to the search engines and the subsequent authority it has developed. Gearing content to meet natural search intent is perfect for businesses looking to create a lasting presence and develop authority in relevant topics and/or industries. Focus on evergreen queries, question-based content and topic optimisation (where you look to cover every single facet of a topic) and you will be on your way.

Your strategy defines your audience, your platform, your content, and even how you measure success. For example, if you sell a product for a young demographic, you may decide that Instagram is the best place to build your brand by using a series of witty pictures with a strong call to action to make a purchase. Alternatively, you may decide to extend the reach of your brand by attempting to break into a new market, such as building a rapport with women, who comprise a large proportion of Pinterest users. Micro-blogging may be an ideal way to give busy business people the bite-sized content they need on their morning commute, while infographics provide visual punch to make a point instantly.
However, you can use paid campaigns to reinforce core messages that you’ve shared via organic posts. For example, if the company has been involved in a public crisis (think Volkswagen and the emissions crisis), then information you’ve provided to people who have contacted you can be used as part of a wider educational marketing program with paid ads to extend the message reach.
Retargeting: Each platform offers retargeting to help you reach people who’ve already visited your website. The benefit of retargeting is that a conversion is more likely when you know the prospect is interested. You might also upload an email list and use Facebook Custom Audiences to serve ads directly to subscribers. In the following example, we see two ads that show in the Facebook sidebar to reach former web visitors.
Novelty wears off. Even if people aren’t getting sick of your ads, your product itself will become less revolutionary over time. When Casper launched, a direct-to-customer mattress-in-a-box company was a hot new take on the traditional sleep industry. Now there are so many competitors that the idea of a mattress showing up at your door in a box just isn’t as exciting.
SEO may generate an adequate return on investment. However, search engines are not paid for organic search traffic, their algorithms change, and there are no guarantees of continued referrals. Due to this lack of guarantees and certainty, a business that relies heavily on search engine traffic can suffer major losses if the search engines stop sending visitors.[60] Search engines can change their algorithms, impacting a website's placement, possibly resulting in a serious loss of traffic. According to Google's CEO, Eric Schmidt, in 2010, Google made over 500 algorithm changes – almost 1.5 per day.[61] It is considered wise business practice for website operators to liberate themselves from dependence on search engine traffic.[62] In addition to accessibility in terms of web crawlers (addressed above), user web accessibility has become increasingly important for SEO.

Here users can find what services are around, or where to buy a particular product. Meanwhile, local searches provide instant information and specific data on customers’ needs, such as a telephone numbers, the address of a company or its public opening hours. Also, do not forget your smartphone as a tool to find information anywhere. 77% of the users of these devices use them to find information preferably in their immediate environment.


To sum up all of this information, even organic traffic, like direct traffic, has some gray areas. For the most part, though, organic traffic is driven by SEO. The better you are ranking for competitive keywords, the more organic traffic will result. Websites that consistently create content optimized for search will see a steady increase in organic search traffic and improved positioning in the search results. As a marketer, it is important to look at your keywords and high-ranking pages to identify new SEO opportunities each month.  
Paid social can help amplify organic content, using social network advertising tools to target the audience. Using the rugby example, on Facebook you could target people who like other leading rugby fan pages. I recommend testing paid social campaigns to promote key content assets like reports and highlight important news/announcements. With a small budget you can quickly measure amplification impact.
Paid or sponsored ads usually charge you for a click, while SEO doesn’t require you to pay for impressions or clicks. But do keep in mind that quality SEO isn’t exactly free. Depending on the target market you are in, you will have to invest time and money into getting the desired results. And if you’re not an SEO expert, then you would have to work with a reputable SEO company do it for you.
Each paid ad will likely point to a product page, a specific landing page, or something that has the potential to drive financial results. As paid marketing would suggest by its name alone, you’re spending money on ads to drive specific actions. You need to determine ROAS beyond vanity metrics alone (like engagement or total leads). Say you drove five leads but spent $5,000 on your paid campaign. Your ROAS would be $1,000 per lead, which is a bit steep (depending on your industry). In this case, you’d want to adjust your strategy to avoid wasting money.

Your website should be the cornerstone of your content building strategy. Your website is the one piece of real-estate on the internet that you truly own. Facebook, Twitter, and Google are nice, but you don’t own anything on those platforms other than your intellectual property rights. The services they provide now may change in the future. Invest in the content on your website.

Paid social media is anything that is influenced by advertising dollars spent. Any post in your news feed that has the “Sponsored” tag is paid social media. If you then “like” that post, that is considered a paid reaction. Paid social media includes boosted posts, ads optimized for clicks, lead generation forms, video ads, among other objectives, and can be targeted by a variety of demographic and behavioral factors.


Great analysis and tips, Rand. Your first tip was to focus on branded search... but when it comes to small-medium businesses, there's a limit on how much brand search-demand one can produce. Are you saying that google search will eventually become an engine made only for entities/businesses we already know of? Where does that leave the whole discovery process?
Consumer demand for organically produced goods continues to show double-digit growth, providing market incentives for U.S. farmers across a broad range of products. Organic products are now available in nearly 20,000 natural food stores and nearly 3 out of 4 conventional grocery stores. Organic sales account for over 4 percent of total U.S. food sales, according to recent industry statistics.
Optimize for opt-ins. Make sure you lead to something more than your content. What this means is that when people read your content, they must know where to go next. This may come in the form of a call to action or your offering of additional content, appearing perhaps as a PDF. Growing organic traffic is important, but it doesn’t matter if you are not converting those viewer into leads. Your business doesn’t pay its bills using raw traffic.
Most businesses are aware that the search engines can drive massive traffic to their web properties. Not just any traffic, but traffic that actually converts into leads and sales. Even though there are other ways to gain online exposure, Google still leads the pack when it comes to helping you get the best bang for your marketing buck. This is mainly due to its huge user base and market share.
Keyword research and analysis involves three "steps": ensuring the site can be indexed in the search engines, finding the most relevant and popular keywords for the site and its products, and using those keywords on the site in a way that will generate and convert traffic. A follow-on effect of keyword analysis and research is the search perception impact.[13] Search perception impact describes the identified impact of a brand's search results on consumer perception, including title and meta tags, site indexing, and keyword focus. As online searching is often the first step for potential consumers/customers, the search perception impact shapes the brand impression for each individual.
Web search is one of the most powerful tools we have today. Just like you, people from all walks of life use Google to find solutions, learn new things and understand the world around. One of those new things may be determining whether SEO vs SEM is best for your business. Whether you’re an online business or a local business, chances are that people are actively looking for you.
For our client: We were lucky enough to remove most from the prior agency outreach, we also went directly to many webmasters in which we wanted to remove links. We did not use the Disavow tool as it was not around when we completed this link cleanup, but we all know it has been said that if you are going to use the Disavow Tool to use it with caution.

One of the things that can slow-bleed the traffic from your site is the quality (or lack thereof) of the content you publish on your site. Previous Google updates like Panda have already been released specifically to deal with the issue of low-quality content on websites. Long story short: Panda intended to stop sites with bad content from appearing in the search results.

Ad groups allow for each campaign to be further subcategorized for relevance. In our hardware store example, one ad group could be for different types of rakes or varying models of leaf blowers. For the power tools campaign, one ad group might focus on power drills, while another could focus on circular saws. This level of organization might take slightly longer to set up initially, but the rewards – namely higher CTRs at lower cost – make this effort worthwhile in the long run.


While there are several HTML tagging techniques that improve a page’s Google SEO results, creating relevant page content is still the best way to rank high. A big part of content creation is your use of targeted keywords. You should include important keywords in your first 50 words, since early placement can be a signal of relevance. And while you should never repeat keywords too often at the expense of good writing, you should repeat keywords in your content two or three times for short pages and four to six times for longer pages. Also, you may wish to use some keyword variation in your content – such as splitting keywords up – as this could potentially improve your ranking.
Small business owners sometimes think that search engine marketing (SEM), also known as pay-per-click advertising (PPC), is not lucrative option for them. They may think they can’t afford it, or that their online presence is not important if they are a local or service-based business. The truth is, as search engines have undeniably become a part of our lifestyles as consumers, there are many ways to leverage them for businesses of any size. This post will introduce you to the basics and benefits of search engine marketing (SEM).
Internet marketing professionals refer to search that isn’t organic as paid search. Instead of organically, or naturally, reaching the top of the search results for a particular keyword, businesses can pay to get noticed. So, paid search is a bit like doing a local endorsement, TV ad or radio spot—but for the internet. When a consumer types in a search term that you’ve incorporated into your campaign, your ad will show up at the top of search page results, above the organic results. Sometimes, your ad may appear in the sidebar. Only if the consumer clicks on your ad do you pay anything.
×