To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine's database by using a meta tag specific to robots (usually ). When a search engine visits a site, the robots.txt located in the root directory is the first file crawled. The robots.txt file is then parsed and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam.[46]


“Google itself solely decides how much PageRank will flow to each and every link on a particular page. In general, the more links on a page, the less PageRank each link gets. Google might decide some links don’t deserve credit and give them no PageRank. The use of nofollow doesn’t ‘conserve’ PageRank for other links; it simply prevents those links from getting any PageRank that Google otherwise might have given them.”

What an article… thank you so much for the priceless information, we will be changing our pages around to make sure we get the highest page rank available to us, we are trying to get high page rank sites to link to us, hopefully there is more information out there to gather as we want to compete within our market to gain as much market-share as possible.


Just as some backlinks you earn are more valuable than others, links you create to other sites also differ in value. When linking out to an external site, the choices you make regarding the page from which you link (its page authority, content, search engine accessibility, and so on) the anchor text you use, whether you choose to follow or nofollow the link, and any other meta tags associated with the linking page can have a heavy impact on the value you confer.
Matt, this is an excellent summary. I finally got around to reading “The Search” by John Battelle and it was very enlightening to understand much of the academia behind what led to the creation of Backrub.. er Google.Looking at how many times the project was almost shutdown due to bandwidth consumption (> 50% of what the university could offer at times) as well as webmasters being concerned that their pages would be stolen and recreated. It’s so interesting to see that issues we see today are some of the same ones that Larry and Sergey were dealing with back then. As always, thanks for the great read Matt!
Chris_D, great question. If you have a single product page that can have multiple urls with slightly different parameters, that’s a great time to use a rel=canonical meta tag. You can use rel=canonical for pages with session IDs in a similar fashion. What rel=canonical lets you do is say “this page X on my host is kinda of ugly or otherwise isn’t the best version of this page. Use url Y as the preferred version of my page instead.” You can read about rel=canonical at http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=139394. Bear in mind that if you can make your site work without session IDs or make it so that you don’t have multiple “aliases” for the same page, that’s even better because it solves the problem at the root.
SEO may generate an adequate return on investment. However, search engines are not paid for organic search traffic, their algorithms change, and there are no guarantees of continued referrals. Due to this lack of guarantees and certainty, a business that relies heavily on search engine traffic can suffer major losses if the search engines stop sending visitors.[60] Search engines can change their algorithms, impacting a website's placement, possibly resulting in a serious loss of traffic. According to Google's CEO, Eric Schmidt, in 2010, Google made over 500 algorithm changes – almost 1.5 per day.[61] It is considered wise business practice for website operators to liberate themselves from dependence on search engine traffic.[62] In addition to accessibility in terms of web crawlers (addressed above), user web accessibility has become increasingly important for SEO.
By relying so much on factors such as keyword density which were exclusively within a webmaster's control, early search engines suffered from abuse and ranking manipulation. To provide better results to their users, search engines had to adapt to ensure their results pages showed the most relevant search results, rather than unrelated pages stuffed with numerous keywords by unscrupulous webmasters. This meant moving away from heavy reliance on term density to a more holistic process for scoring semantic signals.[13] Since the success and popularity of a search engine is determined by its ability to produce the most relevant results to any given search, poor quality or irrelevant search results could lead users to find other search sources. Search engines responded by developing more complex ranking algorithms, taking into account additional factors that were more difficult for webmasters to manipulate. In 2005, an annual conference, AIRWeb, Adversarial Information Retrieval on the Web was created to bring together practitioners and researchers concerned with search engine optimization and related topics.[14]

All sites have a home or "root" page, which is usually the most frequented page on the site and the starting place of navigation for many visitors. Unless your site has only a handful of pages, you should think about how visitors will go from a general page (your root page) to a page containing more specific content. Do you have enough pages around a specific topic area that it would make sense to create a page describing these related pages (for example, root page -> related topic listing -> specific topic)? Do you have hundreds of different products that need to be classified under multiple category and subcategory pages?
Any definition of internet marketing needs to come along with a definition of things associated with it such as affiliate marketing, network marketing, multi-level marketing and so on and so forth. Some of these are less legitimate than others. For example, affiliate marketing is a tough nut to crack unless you have a massive following or you understand how to build excellent squeeze pages and effective sales funnels. 

A great number of people who deal with SEO confuse backlink building and backlink earning. These notions are different. What is backlink building? It means to create conditions for SEO backlink referring to your site. To earn a backlink means to deserve it. Is that really possible? Yes! If you want your site to be worth earning backlinks, you must do everything possible and impossible to please your guests and users.

Black hat SEO attempts to improve rankings in ways that are disapproved of by the search engines, or involve deception. One black hat technique uses text that is hidden, either as text colored similar to the background, in an invisible div, or positioned off screen. Another method gives a different page depending on whether the page is being requested by a human visitor or a search engine, a technique known as cloaking. Another category sometimes used is grey hat SEO. This is in between black hat and white hat approaches, where the methods employed avoid the site being penalized, but do not act in producing the best content for users. Grey hat SEO is entirely focused on improving search engine rankings.
That doesn't mean you won't make any money at the outset. No, as long as you configure the right free offer to capture those all-important email addresses on your squeeze pages, and you build a great value chain with excellent sales funnels, you'll succeed. If all that sounds confusing to you, don't worry, you'll learn over time. That's what internet marketing is all about. It's a constant and never-ending education into an oftentimes-convoluted field filled with less-than-scrupulous individuals.
5. Link building. In some respects, guest posting – one popular tactic to build links, among many other benefits – is just content marketing applied to external publishers. The goal is to create content on external websites, building your personal brand and company brand at the same time, and creating opportunities to link back to your site. There are only a handful of strategies to build quality links, which you should learn and understand as well.
We begin by gaining a sound understanding of your industry, business goals, and target audience. We follow a very formal marketing process for each social media strategy which includes in-depth discovery, market research, project planning, exceptional project management, training, consulting, and reporting. We also incorporate social media ads such as Facebook advertising into many marketing campaigns. As a top digital marketing agency we make social media recommendations that will be best for your business and offer the most engaging experience for your audience.
Quality content is more likely to get shared. By staying away from creating "thin" content and focusing more on content that cites sources, is lengthy and it reaches unique insights, you'll be able to gain Google's trust over time. Remember, this happens as a component of time. Google knows you can't just go out there and create massive amounts of content in a few days. If you try to spin content or duplicate it in any fashion, you'll suffer a Google penalty and your visibility will be stifled.
The criteria and metrics can be classified according to its type and time span. Regarding the type, we can either evaluate these campaigns "Quantitatively" or "Qualitatively". Quantitative metrics may include "Sales Volume" and "Revenue Increase/Decrease". While qualitative metrics may include the enhanced "Brand awareness, image and health" as well as the "relationship with the customers".
Google can’t like this. Although its great for them to have spammers out of the Wikipedias, they’re also losing a lot of very authorative input for their PR algorithm. Think about it – if every site in the world put nofollow on every link Google’s algorithm would be worthless overnight. There has been ongoing speculation as to whether or not Google ignores nofollows from certain sites like Wikipedia, something Mr Cutts has outrightly denied (but also admitted that it would be very useful to have more granular control over nofollow so that it was not an all-or-nothing situation.)

The green ratings bars are a measure of the importance Google’s assessment of the importance of a web page, as determined by Google’s patented PageRank technology and other factors. These PageRank bars tell you at a glance whether other people on the web consider Google considers a page to be a high-quality site worth checking out. Google itself does not evaluate or endorse websites. Rather, we measure what others on the web feel is important enough to deserve a link. And because Google does not accept payment for placement within our results, the information you see when you conduct a search is based on totally objective criteria.
where N is the total number of all pages on the web. The second version of the algorithm, indeed, does not differ fundamentally from the first one. Regarding the Random Surfer Model, the second version's PageRank of a page is the actual probability for a surfer reaching that page after clicking on many links. The PageRanks then form a probability distribution over web pages, so the sum of all pages' PageRanks will be one.
If the assumption here is that webmasters will remove the nofollow attributes in response to this change, then why did take “more than a year” for someone from Google to present this information to the public? It seems that if this logic had anything at all to do with the decision to change the nofollow policy, Google would have announced it immediately in order to “encourage” webmasters to change their linking policies and allow access to their pages with “high-quality information.”

A generalization of PageRank for the case of ranking two interacting groups of objects was described in [32] In applications it may be necessary to model systems having objects of two kinds where a weighted relation is defined on object pairs. This leads to considering bipartite graphs. For such graphs two related positive or nonnegative irreducible matrices corresponding to vertex partition sets can be defined. One can compute rankings of objects in both groups as eigenvectors corresponding to the maximal positive eigenvalues of these matrices. Normed eigenvectors exist and are unique by the Perron or Perron-Frobenius theorem. Example: consumers and products. The relation weight is the product consumption rate.
This pagerank theme is getting understood in simplistic ways, people are still concerning about pagerank all the time (talking about SEOs). I just use common sense, if I were the designer of a search engine, besides of using the regular structure of analysis, I would use artificial intelligence to determine many factors of the analysis. I think this is not just a matter of dividing by 10, is far more complex. I might be wrong, but I believe the use of the nofollow attribute is not a final decision of the website owner any more is more like an option given to the bot, either to accept or reject the link as valid vote. Perhaps regular links are not final decision of the webmaster too. I think Google is seeing websites human would do, the pages are not analyzed like a parser will do, I believe is more like a neural network, bit more complex. I believe this change make a little difference. People should stop worrying about pagerank and start building good content, the algorithm is far more complex to determine what is next step to reach top ten at Google. However nothing is impossible. 

For the purpose of their second paper, Brin, Page, and their coauthors took PageRank for a spin by incorporating it into an experimental search engine, and then compared its performance to AltaVista, one of the most popular search engines on the Web at that time. Their paper included a screenshot comparing the two engines’ results for the word “university.”


As of 2009, there are only a few large markets where Google is not the leading search engine. In most cases, when Google is not leading in a given market, it is lagging behind a local player. The most notable example markets are China, Japan, South Korea, Russia and the Czech Republic where respectively Baidu, Yahoo! Japan, Naver, Yandex and Seznam are market leaders.
Another reason is that if you're using an image as a link, the alt text for that image will be treated similarly to the anchor text of a text link. However, we don't recommend using too many images for links in your site's navigation when text links could serve the same purpose. Lastly, optimizing your image filenames and alt text makes it easier for image search projects like Google Image Search to better understand your images.
As for the use of nofollow as a way to keep pages that shouldn’t be indexed out of Google (as with your feed example) is terrible advice. Your use of it on your feed link does nothing. If anyone links to your feed without nofollow, then it’s going to get indexed. Things that shouldn’t be indexed need to use either robots.txt or meta robots blocking. Nofollow on links to those items isn’t a solution.
This is also about expectations. Anyone that tries to sell you a get-rich-quick scheme is selling you short. There is no such thing. You have to put in the time and do the work, adding enormous amounts of value along the way. That's the truth of the matter and that's precisely what it takes. Once you understand that it's all about delivering sincere value, you need to understand where the money comes from.
While there are several platforms for doing this, clearly YouTube is the most popular for doing this. However, video marketing is also a great form of both content marketing and SEO on its own. It can help to provide visibility for several different ventures, and if the video is valuable enough in its message and content, it will be shared and liked by droves, pushing up the authority of that video through the roof.
Thanks for the post Chelsea! I think Google is starting to move further away from PageRank but I do agree that a higher amoount of links doesn’t necessarily mean a higher rank. I’ve seen many try to shortcut the system and end up spending weeks undoing these “shortcuts.” I wonder how much weight PageRank still holds today, considering the algorithms Google continues to put out there to provide more relevant search results.
But if you do it properly, it can be worth your money. Also, press releases can be much more than just a block of text. In December 2018, we ran a press release through Business Wire that had multiple backlinks, stylized call outs, and even a video! If you put effort into them, press releases can be not just a source of backlinks, but also serve as a great marketing piece as well.
TrustRank takes into consideration website foundational backlinks. Searching engines find quicker sites which are reliable and trustworthy and place them on the top of SERP. All doubtful websites you can find somewhere at the end of the rank if you decide to look what is there. As a rule, people take the information from the first links and stop searching, in case they have found nothing on first 20 top sites. Surely, your website may have that required information, service or goods but because of lack of authority, Internet users will not find them unless you have good foundational backlinks. What are backlinks which we call foundational? These are all branded and non-optimized backlinks on authority websites.
“Google itself solely decides how much PageRank will flow to each and every link on a particular page. In general, the more links on a page, the less PageRank each link gets. Google might decide some links don’t deserve credit and give them no PageRank. The use of nofollow doesn’t ‘conserve’ PageRank for other links; it simply prevents those links from getting any PageRank that Google otherwise might have given them.”

The Truth? You don't often come across genuine individuals in this space. I could likely count on one hand who those genuine-minded marketers might be. Someone like Russel Brunson who's developed a career out of providing true value in the field and helping to educate the uneducated is one such name. However, while Brunson has built a colossal business, the story of David Sharpe and his journey to becoming an 8-figure earner really hits home for most people.
As I was telling Norman above, these days what we’ve come to call content marketing is really a big part of “link building.” You can’t buy links, and “you link to me I’ll link to you” requests often land on deaf ears. Its really all about creating high quality content (videos, images, written blog posts) that appeals to the needs/wants of your target market, and then naturally earning inbound links from sources that truly find what you have to offer worth referencing.
3) Some people don’t believe things have changed. In fact, if things really changed substantially a year ago, you’d think a few of the advanced SEOs out there would have noticed this and talked about it. But nada. There are lots of reasons why the change could have happened and not been spotted. Sculpting might really have been a second or third order factor, as Matt calls it — not helping things as much as some have assumed. SEOs that spotted it might have stayed quiet. Or, it didn’t change — and still hasn’t changed — and sculpting does work even better than Google thought, so it wants to put out a message that it doesn’t, in hopes of putting the genie back in the bottle. That’s probably the major conspiracy theory out there.
Just because some people have been turning their page, way to, pink (with the Firefox ‘nofollow’ indicator plug in installed) that is not a reason to devalue something that is OK to do. It would not of been that hard to plug in a change that would pick that up as spam and therefore put a ‘trust’ question mark against sites that have been ‘nofollowing’ everything.

After finding websites that have good metrics, you have to make sure the website is related to your site. For each competitor backlink, try to understand how your competitor got that link. If it was a guest article, send a request to become a contributor as well. If it was a product review by a blogger, contact the writer and offer them a good deal in exchange for a similar review.

What i have learnt with comments only allow them if they give value to your blog i have used this for one of my main blogs bpd and me and it worked i have let comments threw witch were spamee and it just got a google page rank of 2 after a year learning by mistakes google page rank is always going to be a mystery and people will try to beat it they might for a short period after that they get caught out but the people who write good quality content will be the winners and keep writing quality content a question might be does google count how many no follows there are i wounder
PageRank is one of many, many factors used to produce search rankings. Highlighting PageRank in search results doesn’t help the searcher. That’s because Google uses another system to show the most important pages for a particular search you do. It lists them in order of importance for what you searched on. Adding PageRank scores to search results would just confuse people. They’d wonder why pages with lower scores were outranking higher scored pages.
In December 2009, Google announced it would be using the web search history of all its users in order to populate search results.[32] On June 8, 2010 a new web indexing system called Google Caffeine was announced. Designed to allow users to find news results, forum posts and other content much sooner after publishing than before, Google caffeine was a change to the way Google updated its index in order to make things show up quicker on Google than before. According to Carrie Grimes, the software engineer who announced Caffeine for Google, "Caffeine provides 50 percent fresher results for web searches than our last index..."[33] Google Instant, real-time-search, was introduced in late 2010 in an attempt to make search results more timely and relevant. Historically site administrators have spent months or even years optimizing a website to increase search rankings. With the growth in popularity of social media sites and blogs the leading engines made changes to their algorithms to allow fresh content to rank quickly within the search results.[34]
Search engines are a great way to find business online. They offer “passive” marketing approaches for those who don’t want to get into “active marketing”. SEO can be incredibly powerful, but it’s often too slow for someone who needs clients today (rather than in six months’ time) to be a good marketing strategy when you launch your business. It’s cheap (though it’s not free – your time is worth money too), and it can be very effective in the medium to long term.
What are backlinks doing for your SEO strategy? Well, Google considers over 200 SEO ranking factors when calculating where a page should rank, but we know that backlinks are one of the top three (the other two are content and RankBrain, Google’s AI). So while you should always focus on creating high-quality content, link-building is also an important factor in ranking your pages well on Google.
So, for example, a short-tail keyphrase might be “Logo design”. Putting that into Google will get you an awful lot of hits. There’s a lot of competition for that phrase, and it’s not particularly useful for your business, either. There are no buying signals in the phrase – so many people will use this phrase to learn about logo design or to examine other aspects of logo design work.
One final note is that if the links are not directly related to the subject, or you have no control over them, such as commentors’ website links, maybe you should consider putting them on another page, which links to your main content. That way you don’t leak page rank, and still gain hits from search results from the content of the comments. I may be missing something but this seems to mean that you can have your cake and eat it, and I don’t even think it is gaming the system or against the spirit of it. You might even gain a small sprinkling of page rank if the comment page accumulates any of it’s own.
Search queries—the words that users type into the search box—carry extraordinary value. Experience has shown that search engine traffic can make (or break) an organization's success. Targeted traffic to a website can provide publicity, revenue, and exposure like no other channel of marketing. Investing in SEO can have an exceptional rate of return compared to other types of marketing and promotion.
Regarding nofollow on content that you don’t want indexed, you’re absolutely right that nofollow doesn’t prevent that, e.g. if someone else links to that content. In the case of the site that excluded user forums, quite a few high-quality pages on the site happened not to have links from other sites. In the case of my feed, it doesn’t matter much either way, but I chose not to throw any extra PageRank onto my feed url. The services that want to fetch my feed url (e.g. Google Reader or Bloglines) know how to find it just fine.
Some backlinks are inherently more valuable than others. Followed backlinks from trustworthy, popular, high-authority sites are considered the most desirable backlinks to earn, while backlinks from low-authority, potentially spammy sites are typically at the other end of the spectrum. Whether or not a link is followed (i.e. whether a site owner specifically instructs search engines to pass, or not pass, link equity) is certainly relevant, but don't entirely discount the value of nofollow links. Even just being mentioned on high-quality websites can give your brand a boost.

Backlinks are important for a number of reasons. The quality and quantity of pages backlinking to your website are some of the criteria used by search engines like Google to determine your ranking on their search engine results pages (SERP). The higher you rank on a SERP, the better for your business as people tend to click on the first few search results Google, Bing or other search engines return for them.

As for the use of nofollow as a way to keep pages that shouldn’t be indexed out of Google (as with your feed example) is terrible advice. Your use of it on your feed link does nothing. If anyone links to your feed without nofollow, then it’s going to get indexed. Things that shouldn’t be indexed need to use either robots.txt or meta robots blocking. Nofollow on links to those items isn’t a solution. 

Matt, my biggest complaint with Google and this “page Rank” nofollow nightmare is it seems we need to have a certain type of site to get ranked well or to make your crawler happy, you say you want a quality site, but what my users deem as quality (3000 links to the best academic information on the planet for business development) is actually looked at by Google as a bad thing and I do not get any rank because of it, makes it hard for my site to be found, and people that can really use the information can not find it when you yourself would look at the info and think it was fantastic to find it all in one place.
While most search engine companies try to keep their processes a secret, their criteria for high spots on SERPs isn't a complete mystery. Search engines are successful only if they provide a user links to the best Web sites related to the user's search terms. If your site is the best skydiving resource on the Web, it benefits search engines to list the site high up on their SERPs. You just have to find a way to show search engines that your site belongs at the top of the heap. That's where search engine optimization (SEO) comes in -- it's a collection of techniques a webmaster can use to improve his or her site's SERP position.
Thanks Matt for the informative post. However I do have some questions regarding blog comments. Let say a blog post of mine have PR 10, the page has 10 links, 3 of them are my internal link to my other related post, the other 7 links are external links from blog comment. Based on your explanation, even the 7 external links are nofollow, my 3 internal link will only get 1 PR each which is still the same if the 7 external link is dofollow. Therefore there is no point of adding nofollow for the sake of keeping the PR flow within your own links. Is this correct?
If you’re Matt Cutts and a billion people link to you because you’re the Spam guy at Google, writing great content is enough. For the rest of us in hypercompetitive markets, good content alone is not enough. There was nothing wrong with sculpting page rank to pages on your site that make you money as a means of boosting traffic to those pages. It’s not manipulating Google, there’s more than enough of that going on in the first page of results for most competitive keywords. Geez Matt, give the little guy a break!
SEO is an acronym for "search engine optimization" or "search engine optimizer." Deciding to hire an SEO is a big decision that can potentially improve your site and save time, but you can also risk damage to your site and reputation. Make sure to research the potential advantages as well as the damage that an irresponsible SEO can do to your site. Many SEOs and other agencies and consultants provide useful services for website owners, including:
PageRank sculpting came out of the idea that virtually any page will have links that are important for users but not necessarily that meaningful to receive any PageRank that a page can flow. Navigational links are a primary example of this. Go to a place like the LA Times, and you’ve got tons of navigational links on every page. Nofollow those, and you (supposedly in the past) ensure that the remaining links (say your major stories) get more of a boost.
In a number of recent articles, where I've interviewed some of social media's rising stars such as Jason Stone from Millionaire Mentor, Sean Perelstein, who built StingHD into a global brand and Nathan Chan from Foundr Magazine, amongst several others, it's quite clear that multi-million-dollar businesses can be built on the backs of wildly-popular social media channels and platforms.

Internet marketing, or online marketing, refers to advertising and marketing efforts that use the Web and email to drive direct sales via electronic commerce, in addition to sales leads from websites or emails. Internet marketing and online advertising efforts are typically used in conjunction with traditional types of advertising such as radio, television, newspapers and magazines.
Despite this many people seem to get it wrong! In particular “Chris Ridings of www.searchenginesystems.net” has written a paper entitled “PageRank Explained: Everything you’ve always wanted to know about PageRank”, pointed to by many people, that contains a fundamental mistake early on in the explanation! Unfortunately this means some of the recommendations in the paper are not quite accurate. 

In early 2005, Google implemented a new value, "nofollow",[64] for the rel attribute of HTML link and anchor elements, so that website developers and bloggers can make links that Google will not consider for the purposes of PageRank—they are links that no longer constitute a "vote" in the PageRank system. The nofollow relationship was added in an attempt to help combat spamdexing.
As I was telling Norman above, these days what we’ve come to call content marketing is really a big part of “link building.” You can’t buy links, and “you link to me I’ll link to you” requests often land on deaf ears. Its really all about creating high quality content (videos, images, written blog posts) that appeals to the needs/wants of your target market, and then naturally earning inbound links from sources that truly find what you have to offer worth referencing.
×