🐍 Snake Crawl

Advanced web crawler · Control Panel

About Snake Crawl

Snake Crawl is an open-source web crawler for discovering and collecting web pages, links, metadata, and readable content. It includes a normal seed-based crawler and an advanced discovery mode, with crawl results that can be saved to DATA.CSV.

View Snake Crawl on GitHub

Control Panel

Enter the secret code to open the crawler. The code protects the crawler control panel so unauthorized visitors cannot start crawls or trigger requests through the service.

0
Visited
0
Saved
0
Queued
0
Errors

Ready

Activity
DATA.CSV fields

url, final_url, status, content_type, title, description, text, links, depth, crawled_at