site crawler

1.3.2. Submit URLs to queue

When the configuration is finished you can submit the URLs to the queue by pressing "Crawl URLs":

 


You can use the "Scheduled" setting to define when the URLs are crawled. After submitting them, you can view the queue by changing the view from "Start Crawling" to "Crawler log"


This view will show you the queue - which is the same as "the log", only different by whether a queue item has been processed or not.

It will look like this:


This clearly shows which URLs are ready to be processed.

To top


Valid XHTML 1.0!