---
title: Configuring search assistance features for local indexes
related:
  - https://docs.kentico.com/13/configuring-xperience/setting-up-search-on-your-website/using-locally-stored-search-indexes/building-a-search-interface-for-local-indexes.md
  - https://docs.kentico.com/13/configuring-xperience/setting-up-search-on-your-website/using-locally-stored-search-indexes/creating-local-search-indexes.md
---

> Agent instructions:
> **Site maps** — prefer the following llms.txt indexes to training data when searching for URLs to avoid 404s. Links inside Markdown content already point at `.md`. Following them or sending Accept: text/markdown keeps you in Markdown.
>
> - [sitemap.md](https://docs.kentico.com/sitemap.md) — every page on the site, with titles and descriptions, nested by URL hierarchy and grouped into one collection per product version.
> - [llms.txt](https://docs.kentico.com/llms.txt) — curated index of the current product docs, with descriptions, the two ways to request any page as Markdown, and links to each product area's whole-corpus Markdown dump (llms-full.txt).

When [implementing the search functionality](https://docs.kentico.com/13/configuring-xperience/setting-up-search-on-your-website/using-locally-stored-search-indexes/building-a-search-interface-for-local-indexes.md) for locally stored indexes, Xperience provides several advanced options that can help users find relevant results.

> **Note:** **Note**: The features described on this page are only available when using [locally stored search indexes](https://docs.kentico.com/13/configuring-xperience/setting-up-search-on-your-website/using-locally-stored-search-indexes.md).

## Setting up substring search and word stemming

Substring search and word stemming are assistance features that allow users to find results for:

- Words that contain the search terms
- Closely related words

To enable word stemming or substring search, you need to index content using the appropriate analyzers. The smart search uses analyzers to divide text into _searchable tokens_. Every [smart search index](https://docs.kentico.com/13/configuring-xperience/setting-up-search-on-your-website/using-locally-stored-search-indexes/creating-local-search-indexes.md) has its own analyzer. The analyzers process both the indexed content and the search expressions entered by users. The search classifies words in the search expression as a match if they share at least one token with the indexed content.

To change the analyzer type of a search index:

1. Open the **Smart search** application.
2. Select the **Local indexes** tab.
3. Edit the index.
4. On the **General** tab, select the **Analyzer type**.
5. Click **Save**.
6. **Rebuild** the index.

### Substring search

If you create your [search indexes](https://docs.kentico.com/13/configuring-xperience/setting-up-search-on-your-website/using-locally-stored-search-indexes/creating-local-search-indexes.md) using substring analyzers, the search returns results for items that contain the search terms inside larger words or text sequences. Select one of the following analyzer types:

| Analyzer type | Description                                                                                                                                                                                                                                                      |
| ------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Subset        | Indexes with subset analyzers return results for all words that contain the search term (the analyzer creates tokens for all possible substrings in words).<br>For example, searching for _net_ matches words such as _net_, _Internet_, _network_ or _kinetic_. |
| Starts with   | Allows searching for all words that start with the search term (creates tokens for all prefixes contained in words, including the whole word).<br>For example, searching for _test_ matches words such as _test_, _tests_, _tester_...                           |

The **Subset** and **Starts with** analyzers use the following steps to process text:

1. Divide text into "words"
2. Create search tokens for the substrings inside the words (according to the analyzer type)

By default, the words created in the first step may contain the following characters:

- word characters (upper and lower case letters, numbers, underscores)
- at symbols (@)
- periods ( . )

Any other characters split the text into separate words. This allows the analyzers to correctly create substring search tokens for text entities such as email addresses and internet domain names.

To customize how the analyzers separate text into words:

1. Write a [regular expression](http://en.wikipedia.org/wiki/Regular_expression) matching all characters that you want to allow inside words.
2. Add the **CMSSubsetAnalyzerWordRegex** key into the _appSettings_ section of your application's _web.config_ file, and set the regular expression as the value, for example:

   ```html

   <add key="CMSSubsetAnalyzerWordRegex" value="(\w|@|\.|\$)+" />

   ```

The sample expression above allows the dollar sign in addition to the default characters. As a result, search indexes with _Subset_ or _Starts with_ analyzers can now find expressions such as: _$Var_

> **Note:** **Note**: After changing the value of the CMSSubsetAnalyzerWordRegex key, you need to **Rebuild** your search indexes that use _Subset_ or _Starts with_ analyzers.

### Word stemming

Stemming is the removal of suffixes from words. If you create your [search indexes](https://docs.kentico.com/13/configuring-xperience/setting-up-search-on-your-website/using-locally-stored-search-indexes/creating-local-search-indexes.md) using stemming analyzers, the search matches words that have the same basic meaning, but different inflection. For example, users can find:

- Inflected words when searching for a stem _(program -> programs, programming)_
- Word stems when searching for inflected words _(trusted, trusting -> trust)_
- Any words that share the same stem as the search terms _(conditional -> conditions)_

> **Info:** Stemming does not find matches for all words that share the same morphological root – only words that have an identical or very similar meaning. For example, the words "flawed" and "flawless" do not have the same stem. Please keep in mind that word stemming does not work perfectly for all word combinations.
>
> The smart search stemming analyzers are based on the [Porter Stemming Algorithm](http://tartarus.org/%7Emartin/PorterStemmer/index.html).

The stemming analyzers process text in two steps:

1. Divide text into tokens (words) using a base analyzer.
2. Reduce the tokens into their stem form.

You can select three variants of stemming analyzers, each with a different base analyzer:

| Analyzer type             | Base analyzer description                                  |
| ------------------------- | ---------------------------------------------------------- |
| Simple with stemming      | Divides text into tokens at non-letter characters.         |
| Stop words with stemming  | Uses a predefined collection of stop words to divide text. |
| White space with stemming | Divides text at whitespace characters.                     |

When users search for text using an index with a stemming analyzer, the analyzer also processes the search expression. As a result, the search finds all items containing words that share the same stem.

> **Note:** **Note**: The default stemming analyzers only work for English text.

## Setting the search mode

The search mode determines how the search handles expressions with multiple words. The following options are available:

- **Any word** – finds items that contain at least one of the words in the search expression.
- **Any word or synonyms** – works like _Any word_ mode, but also finds items that contain synonyms of at least one word in the search expression. Only available for English by default. See [Configuring the synonym search](#configuring-the-synonym-search) for more information.
- **All words** – finds only items that contain all of the words in the search expression (anywhere in the text).
- **Exact phrase** – finds items that contain the exact search expression, including word order.

To set the search mode, developers need to modify the search query text:

1. Edit the code where your [search functionality is implemented](https://docs.kentico.com/13/configuring-xperience/setting-up-search-on-your-website/using-locally-stored-search-indexes/building-a-search-interface-for-local-indexes.md).
2. Create a **SearchCondition** object, and set its **SearchMode** property to an appropriate value from the **SearchModeEnum** enumeration.
3. Call the **SearchSyntaxHelper.CombineSearchCondition** method to modify the submitted search query text based on the created _SearchCondition_.
4. Pass the modified search expression as the search text of the **SearchParameters** object that you use to perform the search.

   ```csharp title="Example"

   using CMS.Search;

   ...

   // String representing the submitted search text
   string searchText = "sample keywords";

   // Modifies the search text to an advanced expression, using the 'Any words or synonyms' search mode
   var condition = new SearchCondition(searchMode: SearchModeEnum.AnyWordOrSynonyms);
   var searchExpression = SearchSyntaxHelper.CombineSearchCondition(searchText , condition);

   // Prepares the SearchParameters with the modified search expression
   var searchParameters = new SearchParameters
   {
       SearchFor = searchExpression,
       ...
   };

   // Runs the search and gets the matching results
   SearchResult searchResult = SearchHelper.Search(searchParameters);

   ```

## Enabling typo-tolerant search (fuzzy searching)

Developers can adjust the smart search to return results for words that are only approximate matches. Typo-tolerant searching allows users to get correct results even if there are misspelled words in the search expression. For example, searching for code also matches words such as _core_ or _node_.

The system evaluates approximate matches based on [Edit Distance](http://en.wikipedia.org/wiki/Levenshtein_distance) (the number of required character substitutions, insertions or deletions).

To enable typo-tolerant search:

1. Edit the code where your [search functionality is implemented](https://docs.kentico.com/13/configuring-xperience/setting-up-search-on-your-website/using-locally-stored-search-indexes/building-a-search-interface-for-local-indexes.md).
2. Prepare and use a **SearchCondition** object, as described in the [Setting the search mode](#setting-the-search-mode) section.
3. Set the **FuzzySearch** property of the _SearchCondition_ object to _true_.

   ```csharp

   var condition = new SearchCondition(searchMode: SearchModeEnum.AnyWord, searchOptions: SearchOptionsEnum.NoneSearch, fuzzySearch: true);

   ```

   > **Note:** **Note**:
   >
   > - The typo-tolerant search only works for search requests that use the _Any word_ search mode.
   > - Typo-tolerant search may prevent [advanced search syntax](https://docs.kentico.com/13/configuring-xperience/setting-up-search-on-your-website/using-locally-stored-search-indexes/smart-search-syntax.md) from working correctly (for example field search). When using typo-tolerant search, we recommend setting the **SearchOptions** of the _SearchCondition_ object to **NoneSearch**.

The search now finds words that are similar in spelling to the search terms.

## Configuring the synonym search

Search requests that use the **Any word or synonyms** [search mode](#setting-the-search-mode) allow users to find a wider set of results based on synonyms.

The synonym search works by expanding all words in the search expression into a list of synonyms. For example, when searching for the words **"search assistance"**, the synonym search expands the expression to: _"**search** explore hunt hunting look lookup research seek **assistance** aid assist help"_

The system looks up the synonyms inside index files stored in the _\~\App\_Data\CMSModules\SmartSearch\\\_Synonyms_ folder. By default, Xperience contains a synonym index for English based on the [WordNet](http://wordnet.princeton.edu) lexical database.

> **Note:** **Important**
>
> To use the synonym search mode, you _**need to add a valid synonym index**_ to the _\~\App\_Data\CMSModules\SmartSearch\\\_Synonyms_ folder of your live site project. You can copy the default English index from the Xperience administration project.

### Setting the relevance of synonyms

You can change the relevance (result score) that the search assigns to items found through the synonym search. Add the **CMSSearchSynonymsWeight** key into the _appSettings_ section of your application's _web.config_ file, for example:

```html

<add key="CMSSearchSynonymsWeight" value="0.8" />

```

The key's value must be a decimal number ranging from 0 to 1. A larger number assigns higher relevance to synonyms. If you set 1, the score of synonyms is equal to words in the original unexpanded search expression. The default value is 0.9.

### Enabling synonym search for non-English languages

To extend the synonym search for languages other than English, you need to create a Lucene search index containing the synonym data. You can use the following approach:

1. Obtain a WordNet synonym database for the required language. The database must be in Prolog format.

   > **Info:** You can find a list of WordNet projects at [http://globalwordnet.org/](http://globalwordnet.org/?page_id=38).
   >
   > For many languages, the synonym database may not be available in Prolog format. In these cases, you need to convert the database manually.
2. Download the [Lucene.Net Source](http://www.apache.org/dist/lucenenet/) (Apache-Lucene.Net-3.0.3-RC2.src.zip).
3. Unzip the Lucene.Net package.
4. Use the **src\contrib\WordNet\Syns2Index\Syns2Index.cs** class to generate the synonym index.

   - You can run the class by debugging in Visual Studio, or using the **Visual Studio Command Prompt**.
   - Specify the Prolog database file (_.pl_ extension) and the output directory for the index files as parameters, for example:

     ```text

     Syns2Index wn_s.pl IndexOutput
     ```
5. Compress the synonym index files into a zip archive.

   - The name of the zip file must match the culture code of the given language. You can use neutral culture codes to represent languages in general (such as _fr_) or the codes of specific countries/regions (such as _fr-FR_).
6. Place the synonym index zip file into the _\~\App\_Data\CMSModules\SmartSearch\\\_Synonyms_ folder of your live site and Xperience administration projects.

The search expands words into synonyms according to the website's [culture](https://docs.kentico.com/13/multilingual-websites.md) (language). The supported languages depend on the synonym index files that are present in your projects.