Bots (SEO & Performance tools)
In most cases, bots that visit your website for indexing it (search engines like Google, Bing, etc.) or for performance evaluation (Google Page Insights, GTmetrix, etc.) do not need to see the consent collection UI. It might even be detrimental to your SEO ranking or performance score to display a consent notice that bots cannot interact with and that they might end up indexing as being part of your website.
The Didomi Web SDK comes fully equipped with an option to control its behavior when a bot is visiting your website. You can decide to completely bypass the consent collection and act "as if" consent had been given (load all the third-party vendors, for instance) as bots are not humans and do not need to provide consent.

Bypass consent collection for bots

To indicate that consent should not be collected for bots, set the user.bots.consentRequired property to false in your SDK configuration:
1
<script type="text/javascript">
2
window.didomiConfig = {
3
user: {
4
bots: {
5
/**
6
* Indicate whether consent is required for bots
7
* Defaults to true
8
*/
9
consentRequired: false,
10
11
/**
12
* Predefined types of bots to identify
13
* Defaults to all types supported by the SDK
14
* (Optional)
15
*/
16
types: ['crawlers', 'performance'],
17
18
/**
19
* List of additional regular expressions to match
20
* against the User Agent of the visitor.
21
* When one of the regular expressions matches, the user
22
* is considered to be a bot.
23
* This allows you to identify extra bots that the SDK does not
24
* know about.
25
* Regular expressions must be specified as strings and correctly
26
* escaped.
27
* (Optional)
28
*/
29
extraUserAgents: [],
30
}
31
}
32
};
33
</script>
Copied!
The user.bots.types and user.bots.extraUserAgents properties give you extra control on what user agents are identified as bots. The Didomi SDK can automatically identify all the most common search engine bots and performance tools.

Bots categories

By default and if you configure the SDK to not collect consent from bots, all bots are impacted. If you want to control what categories of bots require consent more specifically, the Didomi SDK categorizes bots in the following categories and allows you to enable only some of them:
ID
Category
Description
crawlers
Crawlers
Bots that index your websites for Search Engines (Google, Bing, etc.)
performance
Performance Tools
Bots that visit your websites for performance reports (Google Page Insights, GTmetrix, etc.)
Last modified 2yr ago