Tuesday, 17 December 2013

How to Give Access to Search Engines to a Restricted Content with FCF?

If you offer subscription-based access to your website content, or if users must register to access your content, then search engines cannot access some of your site's most relevant, valuable content.
Implementing Google's First Click Free (FCF) for your content allows you to include your restricted content in Google's main search index. Our intention is to protect your content while allowing for its inclusion in Google's search index. First Click Free has two main goals:
  • To include high-quality content in Google's search index, providing a better experience for Google users who may not have known that content existed.
  • To provide a promotion and discovery opportunity for webmasters of sites with restricted content.
To implement First Click Free, you need to allow all users who find a document on your site via Google search to see the full text of that document, even if they have not registered or subscribed to see that content. The user's first click to your content area is free. However, once that user clicks a link on the original page, you can require them to sign in or register to read further. The user must be able to see the full content of a multi-page article. You can allow this by displaying all content on a single page to both Googlebot and users. Alternatively, you can use cookies to make sure that a user can visit each page of a multi-page article before being asked for registration or payment.
In order to successfully crawl your site, Google needs to be able to crawl your content without filling out a registration form. The easiest way to do this is to configure your webservers not to serve the registration page to google crawlers (when the user-agent is "Googlebot") so that Googlebot can crawl these pages successfully. You can choose to allow Googlebot access to some restricted pages but not others.