Let’s say you wish to block all URLs that have the PDF. extension. If you write in your robots.txt a line that looks like this: User-agent: Googlebot Disallow: /*.pdf$. The sign “$” from the end basically tells bots that only URLs ending in PDF shouldn’t be crawled while any other URL containing “PDF” should be. I know it might sound complicated, yet the moral of this story is that a simple misused symbol can break your marketing strategy along with your organic traffic. Below you can find a list with the correct robotx.txt wildcard matches and, as long as you keep count of it, you should be on the safe side of website’s traffic.

Here is a common narrative that many e-tailers can relate to: You identified your “sweet spot” in the marketplace and know that charging above this threshold leads to price sensitivity. Your core products drive volume — which allows you to achieve amazing growth. Then, one day, your focus shifted. Maybe you stopped churning out iterations of your best sellers, or maybe you tried to focus on your higher-revenue products — all the while alienating the people who liked your previous offerings.
Haven’t heard of search engine optimization yet? Search engine optimization (or SEO for short) is initiated to help boost the rankings of your website within organic search results. Some examples of techniques used to boost organic SEO include using keywords, building local citations or mentions of your business across the web, and writing content that’s valuable and relevant for real people. The goal is to have unique and quality content, a user-friendly website, and relevant links pointing to your site. These are just a few of the things that can influence the rank of a site within an organic search.
One of the most significant changes to Google’s algorithm over the years has been how it uses keywords to match relevant content to queries. The days of simply matching search terms to the keywords on your page are behind us, and Google’s machine learning algorithms are able to match the topical relevance of your content to the contextual meaning behind user searches.
For an Agency like Aira, the speed of AccuRanker is a huge feature - the ability to do fast checks and instant refreshes on keywords means we can diagnose issues as and when they happen, during meetings or when on a client call. We love how quick Accuranker is and how scalable it is across regions around the world. We use it all the time for client reports and are now also making use of the Data Studio connector to pull data into our own existing report templates.

Let’s say that you want to move your blog from a subdirectory URL (yourwebsiterulz.com/blog) to a subdomain (blog.yourwebsiterulz.com). Although Matt Cutts, former Google engineer, said that “they are roughly equivalent and you should basically go with whichever one is easier for you in terms of configuration, your CMSs, all that sort of stuff”, it seems that things are a bit more complicated than that. 
By far the best rank tracking software on the market. We’ve tested a variety of different rank tracking softwares and AccuRanker is by far the most precise on the market. As a tool AccuRanker is very intuitive to use and the support is just great. We appreciate the speed and the possibilities regarding filters, tagging and especially the instant refresh function. These features and a bunch others is something we use a lot and I myself has been satisfied using it since 2016.
Now, it is not that these sites are not interested in Google users. In fact, they have hired us to help them increase their share. However, they are getting so much traffic from sites like Facebook that it seems there is less urgency about attracting this traffic and less willingness to change the site to meet organic standards. Not long ago, sites would urgently and unquestioningly abide by Google’s standards to court that traffic.
According to our data, twenty-three out of the twenty-five largest retailers use Product Listing Ads (PLAs), which are cost-per-click ads that are purchased through AdWords to promote products. Google initially launched Product Listing Ads in the US market in 2011. However, the advertising format experienced an astronomical rise around 2014, when the search engine launched the feature in other countries. Today, PLAs account for 43 percent of all retail ad clicks and a staggering 70 percent of non-branded clicks!

The Google, Yahoo!, and Bing search engines insert advertising on their search results pages. The ads are designed to look similar to the search results, though different enough for readers to distinguish between ads and actual results. This is done with various differences in background, text, link colors, and/or placement on the page. However, the appearance of ads on all major search engines is so similar to genuine search results that a majority of search engine users cannot effectively distinguish between the two.[1]
Wonderful little article, lovely detailing and the possible sources of direct traffic which could lead to various positives and negatives to your overall SEO strategies. Direct traffic could be the prime conversion getter for your eCommerce website or could be a flaw in your website as a whole which looks like direct traffic has a correlation with organic traffic as well. As organic traffic increases, your overall direct traffic increases along with it. Does some type of bot activities lead to direct traffic as well?s

The moral of this story is that everything is contextual. And this applies to everyday happenings and to your online marketing, traffic sources, and conversion rates as well. It happens that what looks like an opportunity to be actually a setback and vice-versa. We all make changes within our sites with the purpose of having tons of traffic. We are in a continuous race for inbound links, domain authority, technical SEO, diagnosing traffic drops, search volume, keyword research and we forget to take a few steps back and see how all of these influence our overall site’s performance. We’ve documented the ranking drop issue in an earlier post as well and you can take a look at it as well to better understand this phenomenon.
hey james - congrats on your success here. just a question about removing crummy links. for my own website, there are hundreds of thousands of backlinks in webmaster tools pointing to my site. The site has no penalties or anything  - the traffic seems to be growing every week. would you recommend hiring someone to go through the link profile anyway to remove crummy links that just occur naturally?
Conduct a quick Google search using “site:yourwebsite.com” to make sure your pages are actually indexed. If you’re noticing that critical pages aren’t appearing in the SERPs, you’ve likely found the culprit. Check your robots.txt file to make sure you haven’t blocked important pages or directories. If that looks good, check individual pages for a noindex tag.
For the short-term, PPC is generally your best bet. The minute your ad runs, it delivers results. But when the budget stops, so do the benefits. Because SEO relies on your website’s content, linking structure, and meta data, developing a thorough strategy that delivers real results takes more time than setting up a PPC campaign. However, SEO’s results may be more valuable to you and your organization in the long run.
Fantastic post Tom! There's a lot of confusion on direct traffic to begin with. These are even more finer nuances that you have explained. I have a client whose top source of traffic is direct, and part of it is maybe due to the fact that they don't do any promotion, and it's mostly shared around internally within their team. But I just noticed that their URL is http and not https so this might be something for me to take back to the team. Thanks!

Are you currently excluding all known bots and spiders in Google Analytics? If not, you may be experiencing inflated traffic metrics and not even know it. Typically, bots enter through the home page and cascade down throughout your site navigation, mimicking real user behavior. One telltale sign of bot traffic is a highly trafficked page with a high bounce rate, low conversions and a low average time on page.
Who are you man!? You better be back here till tomorrow and give me number 51 or you will be doing push ups for the rest of your blogging life!!! RLMAO Hey Steve, thanks so much for the comment and I am glad that there is someone after all that is getting all the traffic his webhost can take! I am already thinking of how to enter your Webmaster tools and redirect your whole blog to mine... thinking, thinking, thinking.... Thanks for the RT and love having you as my blogging friend!
Recent studies have found that upwards of 80% of consumers’ outbound sharing from publishers’ and marketers’ websites now occurs via these private channels. In terms of numbers of active users, messaging apps are outpacing social networking apps. All the activity driven by these thriving platforms is typically bucketed as direct traffic by web analytics software.
In order to get the whole bundle of internal links for your website, in the same Search Console, you need to go to the Search Traffic > Internal Links category. This way you’ll have a list with all the pages from your website (indexed or not) and also the number of links pointing to each. This can be a great incentive for discovering which pages should be subject to content pruning.

Hey Ryan, glad I could help :) I am going to find them later and steal all of them, lol. You had an idea straight away, but some bloggers get stuck and say "I don't have anything to give away". Yes, you do, everyone has something. You can always turn your best posts in different kinds of media, like PDFs, videos, audios, slideshows and just share them everywhere. Thanks so much for the comment!
In the end of the day it depends on the size of the website you are working with and how well known the brand is in the market. You can adapt some of the strategies listed above in the post on scale and it can have a highly positive impact on a web property, the property in question is a real content house so any thing is possible. What else do you suggest we should do I will advise you if it has been done already?

Brankica, Excellent list. The only one I could think of is mentioning through email to family and friends. Example: Hey Guys and Gals, Sorry I haven't been in touch for a while. I've been working my tail off building something I hope will be special. I would appreciate it if you could do me a huge favor. My blog is still new and I need some opinions on where it can improve. Let me know the good, bad and ugly:) Also, can you pass it along to some of your friends? The more opinions the better idea I have at what works and what doesn't. etc. Thanks for the post. Live it LOUD!

This is a fantastic list! I thought I had it covered, but I'm only half way there. I can't wait to tackle some of these. It can all get overwhelming at times, because there's so much information and so many resources out there. I would like to take advantage of Facebook and Google ads, but I'm not sure if they'll be worth the investment when compared to everything else out there. I just started guest posting, I have three due this weekend. And I'm going to start writing articles for Biznik.com - which is a great site and has put me in touch with loads of local people. Love it. The forums is an area that I just recently started dancing around it and I'm still finding my way. Thanks for sharing this great information.
Connect with people you know and they will see your updates. If you are a good writer and post great content, you will receive traffic from them. You can generate traffic by joining LinkedIn groups and helping people in your niche by pointing them to your relevant posts. Besides groups, there is an answers section. Answer questions the best you can and point people to relevant links (your blog).
For our client: We were lucky enough to remove most from the prior agency outreach, we also went directly to many webmasters in which we wanted to remove links. We did not use the Disavow tool as it was not around when we completed this link cleanup, but we all know it has been said that if you are going to use the Disavow Tool to use it with caution.
Use long tail keywords. Don’t just go with the most popular keywords in your market. Use keywords that are more specific to your product or service. In time, Google and other search engines will identify your website or blog as a destination for that particular subject, which will boost your content in search rankings and help your ideal customers find you. These tools will help.
×