There are two types of rules: Basic Rules and Advanced Rules:īasic Rules determine the positions of the links the program should follow on a page.Īdvanced Rules determine the patterns of the links the program should or should not follow.īasic Rules allow you to specify the positions of the necessary links on a page. For level 0, the wizard sets the initial value of the URL equal to the URL of the start page. You can type the URL manually or you can click the button and open the necessary page using the built-in browser. The 'Page URL' field contains the URL of the page that will be used to create rules. You can delete the level by selecting it and and clicking the 'Delete' button (you can delete only the last level). A click on the 'Duplicate' button adds a new level and copies all rules from the current level to the new one.

A click on the 'Add' button just adds a new level that contains no rules. There are two ways to add a level: by clicking the 'Add' button or by clicking the 'Duplicate' button.

The level of all pages that can be opened from a page with level 2 is 3 and so on. The level of all pages that can be opened from the start page is 2. The page level is the number of links the program has to follow to move from the start page to the current one. Crawling Rules are rules that determine links the program should follow.įirst, you should select the level of pages the rules will be applied to.

Javascript url extractor