Issues

all sites
cybercongress/crawler#25 · opened on Feb 25, 2020
Crawler for all kind of blockchain naming services
cybercongress/crawler#24 · opened on Jan 13, 2020
A-Parser integration
cybercongress/crawler#23 · opened on Nov 2, 2019
FOAM integration
cybercongress/crawler#22 · opened on Nov 2, 2019
OpenBazaar Integration
cybercongress/crawler#21 · opened on Oct 23, 2019
3
Add DURa to IPFS upload status output
cybercongress/crawler#20 · opened on Jul 25, 2019
Chaingear indexation
cybercongress/crawler#17 · opened on Jun 22, 2019
Google crawler based on pastukhov.com base
cybercongress/crawler#16 · opened on Jun 22, 2019
Science is behind paywall
cybercongress/crawler#15 · opened on Jun 22, 2019
Pornhub support!
cybercongress/crawler#14 · opened on Jun 22, 2019
Add github crawler
cybercongress/crawler#13 · opened on Jun 22, 2019
Add support for ethereum blocks, tx and contracts parsing
cybercongress/crawler#12 · opened on Jun 22, 2019
Add support for bitcoin blocks, tx and contract parsing
cybercongress/crawler#11 · opened on Jun 22, 2019
Setup indexers
cybercongress/crawler#18 · opened on May 4, 2019
2
Submit links: get ipfs hashes for whole chuch by one request
cybercongress/crawler#10 · opened on Feb 15, 2019
Add wiki titles interlinks (link page with all containing links)
cybercongress/crawler#9 · opened on Feb 14, 2019
Upload to ipfs after restart should proceed from stop point.
cybercongress/crawler#8 · opened on Feb 14, 2019
Wiki index duras scheme
cybercongress/crawler#19 · opened on Feb 8, 2019