# searchpro/4.0.21/inc/crawler

BerqWP – All-In-One Optimization for Core Web Vitals, Cache, CDN, Images, CSS &amp; JavaScript, version 4.0.21. 3 entries.

- Page: https://pluginprobe.com/plugins/searchpro/4.0.21/code/inc/crawler
- Release archive: https://downloads.wordpress.org/plugin/searchpro.4.0.21.zip

- file [berqDetectCrawler.php](https://pluginprobe.com/plugins/searchpro/4.0.21/code/inc/crawler/berqDetectCrawler.php)
- file [crawler-user-agents.json](https://pluginprobe.com/plugins/searchpro/4.0.21/code/inc/crawler/crawler-user-agents.json)
- file [index.php](https://pluginprobe.com/plugins/searchpro/4.0.21/code/inc/crawler/index.php)

Append `?format=md` to any of these, or send `Accept: text/markdown`, to read them as
Markdown. Add `/raw/` in place of `/code/` for the file with no wrapper at all.
