

Tip: You can also use this method to identify domains that link to competitors and identify how they were used. csv files into Screaming Frog you must choose the “CSV” format type accordingly, otherwise the program will crash. Or you can go to Response Codes and use the “Redirection” position to filter the results to see all domains that have been redirected to a commercial site or elsewhere.

When Spider finishes its work, you will see the corresponding status in the “Internal” tab. Next, you can download this list to Spider and run a scan. From the Word document, you can then save the list as a. Next, click “Scrape” and after “Export to Google Docs”. In the pop-up window, you will need to change the XPath request to the following: Next, using the extension for Google Chrome called Scraper, you can find a list of all the links with the anchor "visit the site." If Scraper is already installed, then you can start it by clicking anywhere on the page and selecting “Scrape similar”. If you need to scan the list of domains that your client has just redirected to his commercial site.Īdd the URL of this site to, then click the link in the top table to find sites using the same IP address, DNS server, or GA code. That is, you exclude these options from the Spider, which will provide you with a list of all pages of the selected folder. In addition to “Check Images,” “Check CSS,” “Check JavaScript,” and “Check SWF,” you will need to select “Check Links Outside Folder” in the “Spider Configuration” menu.
