Skip to content

Does user-agent selection agree with documentation? #3

@benjaminestes

Description

@benjaminestes

If there's more than one group for a specific user-agent, all the rules from the groups applicable to a specific user-agent are combined.

https://developers.google.com/search/reference/robots_txt#examples-of-valid-robots.txt-urls

Metadata

Metadata

Assignees

Labels

questionFurther information is requested

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions