Skip to main content
Site Builder
Indiana University
Configure Your Site

Hide Pages from Search

Manage search engine access to specific paths on your site

Overview

Use the fields in settings under Robots Configuration to control which parts of your site search engines should not index.

You can list specific paths or file types (such as folders, thank-you pages, or certain file extensions) that should be blocked in your site's robots.txt file.

This is useful for preventing search engines from indexing test content, duplicate pages, or files that aren't meant for public discovery.

Republish required
If you change the value of any of the fields listed below, be sure to republish settings.

Robots configuration

Element name Required Multiple
Disallowed path or extension

Path or file extension that should be blocked from search engine indexing. Paths must include the file extension and begin with /.

Examples: /path-to-exclude.html, /folder-name/path-to-exclude.html, /folder-to-exclude.pdf.

No Yes