Robots.txt is not an appropriate or effective way of blocking sensitive or confidential material. It only instructs well-behaved crawlers that the pages are not for them, but it does not prevent your server from delivering those pages to a browser that requests them. One reason is that search engines could still reference the URLs you block (showing just the URL, no title or snippet) if there happen to be links to those URLs somewhere on the Internet (like referrer logs). Also, non-compliant or rogue search engines that don't acknowledge the Robots Exclusion Standard could disobey the instructions of your robots.txt. Finally, a curious user could examine the directories or subdirectories in your robots.txt file and guess the URL of the content that you don't want seen.

Thanks Matt for the informative post. However I do have some questions regarding blog comments. Let say a blog post of mine have PR 10, the page has 10 links, 3 of them are my internal link to my other related post, the other 7 links are external links from blog comment. Based on your explanation, even the 7 external links are nofollow, my 3 internal link will only get 1 PR each which is still the same if the 7 external link is dofollow. Therefore there is no point of adding nofollow for the sake of keeping the PR flow within your own links. Is this correct?


The biggest problem that most people have when trying to learn anything to do with driving more traffic to their website or boosting their visibility across a variety of online mediums, is that they try to do the least amount of work for the greatest return. They cut corners and they take shortcuts. Because of that, they fail. Today, if you're serious about marketing anything on the web, you have to gain Google's trust.
Thanks for the post Chelsea! I think Google is starting to move further away from PageRank but I do agree that a higher amoount of links doesn’t necessarily mean a higher rank. I’ve seen many try to shortcut the system and end up spending weeks undoing these “shortcuts.” I wonder how much weight PageRank still holds today, considering the algorithms Google continues to put out there to provide more relevant search results.
An essential part of any Internet marketing campaign is the analysis of data gathered from not just the campaign as a whole, but each piece of it as well. An analyst can chart how many people have visited the product website since its launch, how people are interacting with the campaign's social networking pages, and whether sales have been affected by the campaign (See also Marketing Data Analyst). This information will not only indicate whether the marketing campaign is working, but it is also valuable data to determine what to keep and what to avoid in the next campaign.
I find it amazing that youtube.com has been “nofollowing” its featured videos for last 12 months (still doing it as I type) when it now seems that this means “i dont trust this content” and “i want to page rank to flow to this content”. In fact a quick glance at a youtube page tells you that youtube are currently flushing 50% of their page rank (very approx) down the toilet on every page.
Keep resources crawlable. Blocking page resources can give Google an incomplete picture of your website. This often happens when your robots.txt file is blocking access to some or all of your page resources. If Googlebot doesn't have access to a page's resources, such as CSS, JavaScript, or images, we may not detect that it's built to display and work well on a mobile browser. In other words, we may not detect that the page is "mobile-friendly," and therefore not properly serve it to mobile searchers.
Brand awareness has been proven to work with more effectiveness in countries that are high in uncertainty avoidance, also these countries that have uncertainty avoidance; social media marketing works effectively. Yet brands must be careful not to be excessive on the use of this type of marketing, as well as solely relying on it as it may have implications that could negatively harness their image. Brands that represent themselves in an anthropomorphizing manner are more likely to succeed in situations where a brand is marketing to this demographic. "Since social media use can enhance the knowledge of the brand and thus decrease the uncertainty, it is possible that people with high uncertainty avoidance, such as the French, will particularly appreciate the high social media interaction with an anthropomorphized brand." Moreover, digital platform provides an ease to the brand and its customers to interact directly and exchange their motives virtually.[33]
After finding websites that have good metrics, you have to make sure the website is related to your site. For each competitor backlink, try to understand how your competitor got that link. If it was a guest article, send a request to become a contributor as well. If it was a product review by a blogger, contact the writer and offer them a good deal in exchange for a similar review.
Regarding nofollow on content that you don’t want indexed, you’re absolutely right that nofollow doesn’t prevent that, e.g. if someone else links to that content. In the case of the site that excluded user forums, quite a few high-quality pages on the site happened not to have links from other sites. In the case of my feed, it doesn’t matter much either way, but I chose not to throw any extra PageRank onto my feed url. The services that want to fetch my feed url (e.g. Google Reader or Bloglines) know how to find it just fine.
As a webmaster or business owner, you're going to get a plethora of emails or form submissions offering things like guest posting services, backlink building offers, offers to buy domains with a "high page rank" and whatnot - like the one right here I got just today. Don't entertain them! It's tempting to think that hey, "I can pay someone to build more backlinks to my website and reap the fruits of their labors... mwahaha" but 99% of those services are more trouble than they'll ever be worth. Why?
A content specialist needs to be a Jack or Jill of all trades, utilizing excellent written and verbal communication skills, above-average computer literacy, and a natural interest in trends. This job is ultimately about translating the key aspects of the product into content the target demographic finds appealing. This is part art, part critical thinking, and 100% attention to detail.
Targeting, viewability, brand safety and invalid traffic: Targeting, viewability, brand safety and invalid traffic all are aspects used by marketers to help advocate digital advertising. Cookies are a form of digital advertising, which are tracking tools within desktop devices; causing difficulty, with shortcomings including deletion by web browsers, the inability to sort between multiple users of a device, inaccurate estimates for unique visitors, overstating reach, understanding frequency, problems with ad servers, which cannot distinguish between when cookies have been deleted and when consumers have not previously been exposed to an ad. Due to the inaccuracies influenced by cookies, demographics in the target market are low and vary (Whiteside, 2016).[42] Another element, which is affected within digital marketing, is ‘viewabilty’ or whether the ad was actually seen by the consumer. Many ads are not seen by a consumer and may never reach the right demographic segment. Brand safety is another issue of whether or not the ad was produced in the context of being unethical or having offensive content. Recognizing fraud when an ad is exposed is another challenge marketers face. This relates to invalid traffic as premium sites are more effective at detecting fraudulent traffic, although non-premium sites are more so the problem (Whiteside, 2016).[42]

Yes, the more links on a page the smaller the amount of page rank it can pass on to each, but that was as it was before. With regard to what happens to the ‘missing’ page rank, it seems that if this is the case all over the Internet, and it will be, the total amount of page rank flow is reduced the same all over so you don’t need as much page rank flow to your good links to maintain relative position.
For Search Engines, backlinks help to determine the page’s importance and value (i.e. authority). Historically, the quantity of backlinks was an indicator of a page’s popularity.  Today, due to the way backlinks are evaluated based on different industry-related ranking factors, it is less quantity focused and more about the quality of sites from which the links are coming.
I did this post because I wanted people to understand more about PageRank, how it works, and to clarify my answers at SMX Advanced. Yes, I would agree that Google itself solely decides how much PageRank will flow to each and every link on a particular page. But that’s no reason to make PageRank a complete black box; if I can help provide people with a more accurate mental model, overall I think that’s a good thing. For example, from your proposed paragraph I would strike the “The number of links doesn’t matter” sentence because most of the time the number of links do matter, and I’d prefer that people know that. I would agree with the rest of your paragraph explanation–which is why in my mind PageRank and our search result rankings qualifies as an opinion and not simply some rote computation. But just throwing out your single paragraph, while accurate (and a whole lot faster to write!), would have been deeply unsatisfying for a number of people who want to know more.

Due to the importance of backlinks, there are lots of bad practices followed by website owners to gain backlinks. Some of these bad practices are: purchasing backlinks, link exchange networks, selling backlinks, etc. Most of these practices are not recommended by search engines. They usually deindex and penalize websites suspected of involvement in such practices.
There is another way to gain quality backlinks to your site, in addition to related site themes: anchor text. When a link incorporates a keyword into the text of the hyperlink, we call this quality anchor text. A link's anchor text may be one of the under-estimated resources a webmaster has. Instead of using words like "click here" which probably won't relate in any way to your website, using the words "Please visit our tips page for how to nurse an orphaned kitten" is a far better way to utilize a hyperlink. A good tool for helping you find your backlinks and what text is being used to link to your site is the Backlink Anchor Text Analysis Tool. If you find that your site is being linked to from another website, but the anchor text is not being utilized properly, you should request that the website change the anchor text to something incorporating relevant keywords. This will also help boost your quality backlinks score.

Balancing search and display for digital display ads are important; marketers tend to look at the last search and attribute all of the effectiveness to this. This then disregards other marketing efforts, which establish brand value within the consumers mind. ComScore determined through drawing on data online, produced by over one hundred multichannel retailers that digital display marketing poses strengths when compared with or positioned alongside, paid search (Whiteside, 2016).[42] This is why it is advised that when someone clicks on a display ad the company opens a landing page, not its home page. A landing page typically has something to draw the customer in to search beyond this page. Things such as free offers that the consumer can obtain through giving the company contact information so that they can use retargeting communication strategies (Square2Marketing, 2012).[43] Commonly marketers see increased sales among people exposed to a search ad. But the fact of how many people you can reach with a display campaign compared to a search campaign should be considered. Multichannel retailers have an increased reach if the display is considered in synergy with search campaigns. Overall both search and display aspects are valued as display campaigns build awareness for the brand so that more people are likely to click on these digital ads when running a search campaign (Whiteside, 2016).[42]


It is increasingly advantageous for companies to use social media platforms to connect with their customers and create these dialogues and discussions. The potential reach of social media is indicated by the fact that in 2015, each month the Facebook app had more than 126 million average unique users and YouTube had over 97 million average unique users.[27]
Changes to the algorithms that produce search engine rankings can place a heightened focus on relevance to a particular topic. While some backlinks might be from sources containing highly valuable metrics, they could also be unrelated to the consumer's query or interest. An example of this would be a link from a popular shoe blog (with valuable metrics) to a site selling vintage pencil sharpeners. While the link appears valuable, it provides little to the consumer in terms of relevance.
Excellent! I was wondering when Google would finally release information regarding this highly controversial issue. I have always agreed with and followed Matt’s advice in having PR flow as freely as possible, natural linking is always the best linking in my experience with my search engine experience and results. I am very glad that you have addressed the topic of nofollow links having no effects in the Google SERPs, I was getting tired of telling the same topics covered in this article to my clients and other “SEOs”.
Social media is a mixed bag when it comes to backlinks. There is a modicum of value, as social media sites allow you to link to your website in your profile. However, these days Facebook, Twitter, and other social media sites mark links as 'nofollow,' meaning that they don't pass SEO value (sometimes referred to as "link juice") to the linked site. These links won't do anything to boost your site's performance in search results.
Page and Brin founded Google in 1998.[22] Google attracted a loyal following among the growing number of Internet users, who liked its simple design.[23] Off-page factors (such as PageRank and hyperlink analysis) were considered as well as on-page factors (such as keyword frequency, meta tags, headings, links and site structure) to enable Google to avoid the kind of manipulation seen in search engines that only considered on-page factors for their rankings. Although PageRank was more difficult to game, webmasters had already developed link building tools and schemes to influence the Inktomi search engine, and these methods proved similarly applicable to gaming PageRank. Many sites focused on exchanging, buying, and selling links, often on a massive scale. Some of these schemes, or link farms, involved the creation of thousands of sites for the sole purpose of link spamming.[24]
Great post, it is very valuable info indeed. I just want to ask, I am trying to market a business to business website, I find it quite hard to market the website in the appropriate categories as it is specialized. Many of the websites I am designing are FCA regulated so when it comes to advertising or giving advise, I am limited as to what I can and can’t do/say. What business to business websites do you recommend for backlinking specialist websites? I find that I am also limited in the social media area and its just LinkedIn that helps
nofollow is beyond a joke now. There is so much confusion (especially when other engines’ treatment is factored in), I don’t know how you expect a regular publisher to keep up. The expectation seems to have shifted from “Do it for humans and all else will follow” to “Hang on our every word, do what we say, if we change our minds then change everything” and nofollow lead the way. I could give other examples of this attitude (e.g. “We don’t follow JavaScript links so it’s ‘safe’ to use those for paid links”), but nofollow is surely the worst.
If you're not using internet marketing to market your business you should be. An online presence is crucial to helping potential clients and customer find your business - even if your business is small and local. (In 2017, one third of all mobile searches were local and local search was growing 50% faster than mobile searches overall.) Online is where the eyeballs are so that's where your business needs to be. 
But I also don’t wanna lose PageRank on every comment with a link… If I can give PageRank and lose none, I wanna let the comment there, even without nofollow. But if I lose PageRank on every link, even inside original post, EVEN MORE if nofollow also takes PageRank out of me, I may just start using JavaScript or simple text without anchor for links… I definetely don’t like this idea, but I dislike even more losing PageRank on each outlink on my site. I’d just link top quality sites that I actively wanna vote for Search Engines.
×