Set up a new crawl campaign for hbku.edu.qa
The base URL for crawling
Limit the number of pages per crawl
Time between page requests
Entire Website
Crawl all pages across the entire domain
By Entity
Crawl specific colleges, institutes, or centers
By Section
Crawl specific sections like News, Events, etc.
Skip these sections during crawling (applies to all modes)
Add custom URL patterns to exclude (e.g., /archive, /legacy)
Run crawls manually when needed
Run every day at midnight
Run every Monday at midnight
Run on the 1st of each month