Key settings to consider include when adding a new project:

  • Login to your Creeper account.
  • Click on ‘+ Add Project’
  • Enter your Project Name: 
  • Enter your website URL. (It should include http or https)
  • Choose CRAWL FREQUENCY – Indicate how frequently you want Creeper to crawl your website.
  • Set the crawl agent: Specify the agent to mimic how search engines view your site. Choose “Googlebot” for a more accurate representation.
  • Click on Add Project at the bottom

Once the project has been successfully added. It would show up on your dashboard with the status ‘QUEUE‘ or ‘CRAWLING‘.

A screen shot of a website with a purple background showcasing a new project.

For any inquiries, don’t hesitate to reach out via email or contact form. We’re here to help.