ArchiveTeam Warrior

[PhireSide]

ArchiveTeam Warrior

tracker.archiveteam.org

Is there anyone here also contributing to this project? I started a few Docker containers, doing my part for the 'greater good' of things.

It is essentially distributed computing (think BOINC or Folding@home) but instead of compute resources, it uses your internet bandwidth to archive and reupload links, documents and so on to the Internet Archive. It seems to be mostly focused on resources that have time constraints, and there are many projects that you can choose from.

You can run their Docker image, or download a VM that has everything setup - all you need to give it is a username and an IP address to work from.

 

[Rickster]

ArchiveTeam Warrior

tracker.archiveteam.org

Is there anyone here also contributing to this project? I started a few Docker containers, doing my part for the 'greater good' of things.

It is essentially distributed computing (think BOINC or Folding@home) but instead of compute resources, it uses your internet bandwidth to archive and reupload links, documents and so on to the Internet Archive. It seems to be mostly focused on resources that have time constraints, and there are many projects that you can choose from.

You can run their Docker image, or download a VM that has everything setup - all you need to give it is a username and an IP address to work from.

Sounds like it would hurt your SSD? I assume it writes the files to your PC so you can upload them?

 

[PhireSide]

Sounds like it would hurt your SSD? I assume it writes the files to your PC so you can upload them?

Yes, constant, but not large reads and writes. There is a pull request for support of tmpfs and changing the work directory on their Github page so it is probably coming soon (tm). @Mzezman has also joined the cause and I think I saw @VegOtter's name on the leaderboard as well.

 

[VegOtter]

Yes, constant, but not large reads and writes. There is a pull request for support of tmpfs and changing the work directory on their Github page so it is probably coming soon (tm). @Mzezman has also joined the cause and I think I saw @VegOtter's name on the leaderboard as well.

View attachment 1835395

I have recently joined the cause too. It is on a media server that sits idle most of the day anyway and I have been monitoring all the various resource usage and it is barely noticeable. On the Archiveteam Warrior dashboard on your local instance it also shows you current and accumulated bandwidth usage and over a week period it has used 20GB down and about 1GB up, which is a fraction of what my family consumes in just one evening of streaming.

 

[Mzezman]

Yes, constant, but not large reads and writes. There is a pull request for support of tmpfs and changing the work directory on their Github page so it is probably coming soon (tm). @Mzezman has also joined the cause and I think I saw @VegOtter's name on the leaderboard as well.

View attachment 1835395

Present and accounted for - 4 VMs on the go at the moment and about 100GB downloaded / approx 67GB uploaded so far

 

[PhireSide]

Getting there. I scheduled my LXC's to only run at night. Was causing some latency issues during the day with my work stuff will all 5 of them chugging away.

 

[Mzezman]

These warrior nodes have contributed 4.4TB to my overall internet usage this month alone (so far) and 7.5TB since i installed them

 

[PhireSide]

These warrior nodes have contributed 4.4TB to my overall internet usage this month alone (so far) and 7.5TB since i installed them

View attachment 1842457

Crazy! I think mine have been a consistent 30GB per day, for the 5x VM's combined.