gosint-sitecrawl/internal
Colin 1cc705c5c7
Enhance crawler with safety features and site-specific report directories
2025-09-22 17:31:13 -04:00
..
crawler Enhance crawler with safety features and site-specific report directories 2025-09-22 17:31:13 -04:00
crawlersafe Add safer crawler with timeouts and site-specific report directories 2025-09-22 17:25:47 -04:00
htmlx feat(report): pages map (title/rt/len/depth), depth distribution, robots summary; docs: schema; chore: check off TODO 2025-08-31 10:01:53 -04:00
linkcheck feat: initial import with progress UI; docs: REPORT_SCHEMA, TODO; v0.0.1 2025-08-31 09:19:34 -04:00
report feat(report): pages map (title/rt/len/depth), depth distribution, robots summary; docs: schema; chore: check off TODO 2025-08-31 10:01:53 -04:00
sitemap feat: initial import with progress UI; docs: REPORT_SCHEMA, TODO; v0.0.1 2025-08-31 09:19:34 -04:00
urlutil feat: initial import with progress UI; docs: REPORT_SCHEMA, TODO; v0.0.1 2025-08-31 09:19:34 -04:00