Archive Team:
github.com/ArchiveTeam/grab-site
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
https://github.com/ArchiveTeam/grab-site
Project activity
New Projects: 0
New Releases: 0
New Issues: 0
New Pull Requests: 0
Closed Issues: 0
Merged Pull Requests: 0
Closed Pull Requests: 0
Issue Authors: 0
Pull Request Authors: 0
Active Maintainers: 0
Time to close issues:
N/A
Time to merge pull requests:
N/A
Time to close pull requests:
N/A
Commit Stats
Commits: 0
Commit Authors: 0
Commit Committers: 0
Additions: 0
Deletions: 0
archiving crawl crawler spider warc
Last synced: 9 days ago
JSON representation
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
- Host: GitHub
- URL: https://github.com/ArchiveTeam/grab-site
- Owner: ArchiveTeam
- License: other
- Created: 2015-02-05T05:01:19.000Z (over 11 years ago)
- Default Branch: master
- Last Pushed: 2025-05-23T09:57:06.000Z (about 1 year ago)
- Last Synced: 2025-09-06T07:06:03.666Z (11 months ago)
- Topics: archiving, crawl, crawler, spider, warc
- Language: Python
- Homepage:
- Size: 1.2 MB
- Stars: 1,513
- Watchers: 42
- Forks: 150
- Open Issues: 98
-
Metadata Files:
- Readme: README.md
- License: LICENSE