Search Engine Indexing Control

Control how search engines like Google and Bing index your changelog. Choose between block, allow, or optimize modes for better SEO.

All Articles

Search Engine Indexing Control

Control how search engines like Google, Bing, and others index your changelog. Choose from three modes: Block, Allow, or Optimize for maximum SEO benefits.

Understanding Search Engine Indexing

Search engine indexing determines whether and how your changelog appears in search results. ChangeCrab gives you three powerful modes to control this:

Block Mode

Prevent search engines from indexing your changelog.

  • Adds noindex, nofollow meta tags
  • Blocks crawlers via robots.txt
  • Keeps your changelog private from search engines
  • Perfect for internal or sensitive changelogs

Default for free users: Free accounts default to Block mode to protect your privacy.

Allow Mode

Normal indexing - the standard approach.

  • Standard search engine behavior
  • No special directives - search engines index normally
  • Market average approach used by most websites
  • Good balance between visibility and control

This is the default for paid users and represents standard SEO practice.

Optimize Mode

Enhanced indexing with professional SEO features.

  • XML Sitemap: Automatically generated at /sitemap.xml to help search engines discover all your entries
  • Structured Data: Schema.org markup (JSON-LD) for better search engine understanding
  • Canonical URLs: Prevents duplicate content issues
  • Optimized Meta Tags: Proper indexing directives and descriptions
  • Open Graph Tags: Enhanced social media sharing
  • Twitter Cards: Rich previews when shared on Twitter

Premium feature: Optimize mode is available for paid users and provides professional-grade SEO optimization.

How It Works

Meta Tags

ChangeCrab automatically adds the appropriate meta tags based on your setting:

  • Block: <meta name="robots" content="noindex, nofollow">
  • Allow: No meta tag (default search engine behavior)
  • Optimize: <meta name="robots" content="index, follow"> plus canonical URLs and structured data

Robots.txt

Your changelog automatically generates a robots.txt file that search engines check before crawling:

  • Block: Disallows all search engine crawlers
  • Allow: No restrictions (default allow)
  • Optimize: Explicitly allows crawlers and includes sitemap reference

Access your robots.txt at: https://your-changelog.changecrab.com/robots.txt

Sitemap Generation

When Optimize mode is enabled, ChangeCrab automatically generates an XML sitemap that includes:

  • Your main changelog page
  • All published changelog entries
  • Last-modified dates
  • Priority and change frequency hints

Access your sitemap at: https://your-changelog.changecrab.com/sitemap.xml

Configuring Search Engine Indexing

  1. Navigate to your changelog Settings
  2. Go to the Privacy & Visibility section
  3. Find Search Engine Indexing
  4. Select your preferred mode:
    • Block - Prevent indexing
    • Allow - Normal indexing
    • Optimize - Enhanced SEO (Premium)
  5. Click Save

Note: Free users default to Block mode. To access Allow or Optimize modes, upgrade to Premium.

Best Practices

When to Use Block

  • Internal company changelogs
  • Sensitive product updates
  • Beta or pre-release information
  • When you want complete privacy

When to Use Allow

  • Public product changelogs
  • Standard visibility needs
  • When you want normal search engine behavior

When to Use Optimize

  • Public-facing product changelogs
  • When SEO is important
  • When you want maximum discoverability
  • For competitive advantage in search results

SEO Benefits of Optimize Mode

Optimize mode provides several professional SEO benefits:

  • Faster Indexing: Sitemap helps search engines discover new content quickly
  • Better Understanding: Structured data helps search engines understand your content
  • Rich Results: Potential for enhanced search result displays
  • Social Sharing: Better previews when shared on social media
  • Duplicate Prevention: Canonical URLs prevent SEO penalties

Related Features

FAQ

How long does it take for changes to take effect?

Changes take effect immediately. However, search engines may take time to re-crawl your site and recognize the new directives. This can take anywhere from a few hours to several weeks depending on how frequently search engines crawl your site.

Can I use Optimize mode on a free plan?

Optimize mode is a premium feature available to paid users. Free users can use Block or Allow modes, or upgrade to Premium to access Optimize mode.

Will Block mode prevent all search engines?

Block mode uses standard robots.txt and meta tag directives that reputable search engines respect. However, compliance is voluntary, and some crawlers may ignore these directives. For maximum protection, combine with password protection or make your changelog private.

What's the difference between Block and making my changelog Private?

Block mode prevents search engine indexing but your changelog is still publicly accessible via URL. Private changelogs require login and are completely inaccessible to the public, including search engines.