WiscWeb - Using the UW No Index / Remove Pages from Search Crawlers plugin

• Important considerations (it is highly recommended that you review these before getting started)
  • Recommended use
  • Previously published pages
  • Interior page links
  • 'noindex' vs 'nofollow'
  • Temporary page blocks for Google
• Plugin activation
• Steps

Important considerations

Recommended use

It is strongly recommended that this option only be used on 1-2 pages of your content. It is not tested for large-scale use across all pages of a website.

For previously published pages where you've recently added the 'noindex' meta tag:

• If a page was created and already indexed by Google, it won’t become un-indexed until Google re-crawls and finds the ‘noindex’ meta tag for that page.
  
  
  • For these instances, consider running the URL Inspection Tool to let Google know to recrawl your content. To complete this step, you’ll need to have a Google Search Console account setup and linked to your site: WiscWeb - Adding Google Search Console to Your Site.
    
    
  • Tip: If you know you have a page that should not be indexed, consider adding the meta tag upon first page publish.

Interior page links

A page with ‘noindex’ on won't show up in search results. However, the page will still be crawled and links found there will be followed and possibly indexed (unless those pages also have ‘noindex’ tags).

'noindex' versus 'nofollow':

• Where 'noindex' is telling Google not to index the page, 'nofollow' is asking Google to ignore hyperlinks. For utilizing ‘nofollow’, use the instructions on the WiscWeb - Sharing pages to social media and search engines doc under Custom Meta Tag Settings but use ‘robots’ as the property and ‘nofollow’ as the content.
  
  
• ‘nofollow’ may be treated differently by Google. Google will only see this as a strong recommendation. In other words, Google may ignore 'nofollow' tags for hyperlinks. 
  
  
• If you want to dive super deep, here's an article that breaks down all of the differences.

Temporarily blocking a page from appearing in Google search results:

• If you are looking to only temporarily block Google from displaying a page in Google search results (for a period of up to 6 months), there is a process you can follow. This involves setting up a Google Search Console account: WiscWeb - Adding Google Search Console to Your Site

Plugin activation

The UW No Index / Remove Pages from Search Crawlers plugin can be activated by Administrators using the instructions in WiscWeb - Self service plugin activation / deactivation.

Steps

1. Once the plugin is activated in the project, navigate to the page you wish to restrict from being crawled
   
   
2. In the right Publish box, check the box that says “Discourage search engines from indexing this page”
   
   
   
   
3. Publish/update the page (Reminder: If the page has already been published before you add this setting, there is a chance it has already been indexed by Google. You’ll have to request the site to be re-crawled to ensure that this setting is honored by Google).