Message boards : Puzzles and science : MNEMOSYNE
Message board moderation
| Author | Message |
|---|---|
|
25 years old Send message Joined: 27 Sep 26 Posts: 349 Credit: 5,210,013 RAC: 137,017 |
🏛️ Mnemosyne: help the Archive Team save the web, one four-hour session at a time 🏛️ Mnemosyne is the newest project on bitboinc, and it is a little different from the others. It does not search for planets or compute anything about the sky. It uses your computer and your internet connection to rescue websites that are about to disappear. Here is what that means, how it works, and what it asks of you. 📚 Why the web needs a memory The web feels permanent, but it is not. Companies close services, forums lose their hosting, video sites delete old uploads, and a link that worked for twenty years suddenly leads nowhere. Often there is only a few weeks' notice, and sometimes none. When a site goes, so do the posts, photos, tutorials and small histories of the people who used it. The Archive Team is a loose group of volunteers, founded in 2009, who race against these shutdowns. Their first big rescue was GeoCities, which was closed in 2009 and took millions of personal home pages with it, and they have been copying dying sites ever since. What they save ends up in the Internet Archive, the same library that runs the Wayback Machine, where anyone can read it. The sites currently in danger are listed on their "Deathwatch" page. 🛰️ How the Archive Team works Saving a large site is far too much work for one person or one server, so the Archive Team splits it up. For every site there is a project: a script that knows how to download that particular site properly. A central tracker cuts the site into small pieces called items (a user's pages, a range of numbered files, one forum thread) and hands them out. A volunteer's program, the Warrior, asks the tracker for an item, downloads everything that belongs to it, packs the result in the standard WARC web-archive format, uploads it to the Archive Team's servers, and asks for the next item. From there the files travel on to the Internet Archive. The Warrior can also let the Archive Team choose the project for you ("ArchiveTeam's Choice"): the tracker then points every Warrior at whatever is most urgent that day. Many hundreds of Warriors working in parallel is what makes it possible to copy a service in the few weeks before it is turned off. 🏛️ What Mnemosyne is Mnemosyne, named after the Greek goddess of memory, runs the official Archive Team Warrior for you through BOINC. You do not install or configure the Warrior yourself and you do not have to start it: you tick Mnemosyne in your preferences and BOINC does the rest, like with every other project. The Warrior runs inside a container (Docker or Podman), so it is separated from the rest of your system and nothing is installed on it. Why through BOINC? Because bitboinc already has what such an effort needs: a way to start and stop work on many computers, fair credit for the time you give, statistics, teams and a community. Your work counts for the Archive Team under one nickname, BitBoinc; your own name is never sent to them. ⚙️ What happens during a session
Mnemosyne is a BOINC project that runs the Archive Team's Warrior, which saves websites that are about to disappear and uploads them to the Internet Archive. It needs one CPU core and your internet connection, in four-hour sessions, and Docker or Podman. Join: https://bitboinc.athena.org.tr Statistics: https://bitboinc.athena.org.tr/mnemosyne.php Questions, ideas, or something that does not work on your system? Reply here. Thank you for helping keep the web's memory alive!
|
VatoSend message Joined: 28 Sep 26 Posts: 10 Credit: 22,583,642 RAC: 412,951 |
I get a errors on a host that has successfully run BUDA/podman for LHC@Home and BOINC Central e.g. https://bitboinc.athena.org.tr/result.php?resultid=8345656 |
|
25 years old Send message Joined: 27 Sep 26 Posts: 349 Credit: 5,210,013 RAC: 137,017 |
In reply to Vato's message of 24 Oct 2026: I get a errors on a host that has successfully run BUDA/podman for LHC@Home and BOINC Central Yes, I made some mistakes in the settings. Thank you for testing and reporting this; I have now tested the settings on macOS. The new version will be live by tomorrow morning.
|
VatoSend message Joined: 28 Sep 26 Posts: 10 Credit: 22,583,642 RAC: 412,951 |
thank you also, that host downloaded a lot of tasks... you might want to put some sort of limit on how many can be run per host not necessarily just a single task, but probably not unlimited |
|
Send message Joined: 6 Oct 26 Posts: 3 Credit: 57,567,658 RAC: 1,561,453 |
I second Vato's suggestion. Considering each task runs its own Warrior instance, they will all be competing for the same network bandwidth. Secondly, as they all use the default settings for archival (i.e., downloading from the same website), it would likely result in client IPs getting rate-limited or banned by the site being archived. |
Tamagoch47 years old Send message Joined: 29 Sep 26 Posts: 68 Credit: 14,373,389 RAC: 423,227 |
As an old crucher for DIMES and Majestic-12, I would gladly use my bandwidth for this project. Only the one thing to concern here - what happens if container shuts down accidentally? Power outages are still the issue for crunching hosts in Ukraine. This week twice a day, later - who knows... Just want to be sure the Warrior inside is also using checkpoints.
|
Henk Haneveld72 years old Send message Joined: 28 Sep 26 Posts: 31 Credit: 3,560,476 RAC: 84,073 |
In reply to Tamagoch's message of 25 Oct 2026: As an old crucher for DIMES and Majestic-12, I would gladly use my bandwidth for this project. That is mentionend in the "What happens during a session" part of the first post. It does not look that there is a checkpoint. |
|
Send message Joined: 28 Sep 26 Posts: 14 Credit: 20,245,102 RAC: 1,212,197 |
Computation error after 4hr. |
|
Send message Joined: 28 Sep 26 Posts: 14 Credit: 65,648,448 RAC: 1,069,712 |
Can someone please post instructions for install docker on windows? I tried downloading and running the windows installer, but BOINC is giving me the following, in the event log: Docker detection in docker-desktop: - cmd: podman --version - output: /bin/sh: podman: not found Docker detection in docker-desktop: - cmd: docker --version - output: It looks like you have tried to invoke the docker CLI from the docker-desktop WSL2 distribution. This is not supported.Please invoke the docker CLI from the Windows Command Prompt, PowerShell, or other compatible terminals.If you wish to interact with Docker Desktop from a third-party WSL2 distribution, such as Ubuntu, please enable the Docker Desktop WSL2 integration for it. See: https://docs.docker.com/desktop/wsl/#enabling-docker-support-in-wsl-2-distros FWIW, I have not installed any third-party WSL2 distributions. Also, I installed the "per-user installation", and not the "all-users installation", if that makes any difference. |
|
25 years old Send message Joined: 27 Sep 26 Posts: 349 Credit: 5,210,013 RAC: 137,017 |
In reply to zombie67 [MM]'s message of 25 Oct 2026: Can someone please post instructions for install docker on windows? I tried downloading and running the windows installer, but BOINC is giving me the following, in the event log: Try this https://github.com/BOINC/boinc-buda-runner-wsl
|
Henk Haneveld72 years old Send message Joined: 28 Sep 26 Posts: 31 Credit: 3,560,476 RAC: 84,073 |
May I suggest that to the project information is added the warning that Docker/Podman is NOT compatible with VirtualBox. That running Docker/Podman makes it impossible to run VirtualBox applications on Boinc. |
|
Send message Joined: 1 Oct 26 Posts: 35 Credit: 86,317,024 RAC: 555,648 |
Is this sub-project paused at the moment? |
VatoSend message Joined: 28 Sep 26 Posts: 10 Credit: 22,583,642 RAC: 412,951 |
In reply to Henk Haneveld's message of 25 Oct 2026: That running Docker/Podman makes it impossible to run VirtualBox applications on Boinc. Not the case, per se, but you can't run the both at the same time. Docker/podman uses WSL2, which looks like it is incompatible with VirtualBox, but... WSL2 uses Hyper-V which is incompatibale with VirtualBox, but you can switch between them when necessary. Something like the below works for me, and the reverse to go back to the previous setup: Press Win + R, type appwiz.cpl, and press Enter to open Programs and Features. Click Turn Windows features on or off on the left. Uncheck Hyper-V, including the sub-items “Hyper-V Management Tools” and “Hyper-V Platform.” Also uncheck Windows Hypervisor Platform, Virtual Machine Platform, and Windows Sandbox if you do not need them. Click OK and restart when prompted. |
Henk Haneveld72 years old Send message Joined: 28 Sep 26 Posts: 31 Credit: 3,560,476 RAC: 84,073 |
In reply to Vato's message of 25 Oct 2026: In reply to Henk Haneveld's message of 25 Oct 2026: Boinc does not agree with what you are telling. In the Boinc client setttings file client_state.xml there is the following line: <virtualbox_version>7.2.8 (unusable - Podman/Docker present)</virtualbox_version> Changing Windows settings does not change Boinc settings |
|
Send message Joined: 28 Sep 26 Posts: 14 Credit: 65,648,448 RAC: 1,069,712 |
In reply to Alperen Yavuz's message of 25 Oct 2026: In reply to zombie67 [MM]'s message of 25 Oct 2026: Thanks! That seems to have worked. No more error message in the BOINC event log. Although I am not sure how BOINC users are supposed to know about this solution. I guess that is a BOINC problem, and not a project problem. In any case, now I am just waiting for tasks to be available. |
VatoSend message Joined: 28 Sep 26 Posts: 10 Credit: 22,583,642 RAC: 412,951 |
In reply to Henk Haneveld's message of 25 Oct 2026: Boinc does not agree with what you are telling. In the Boinc client setttings file client_state.xml there is the following line: <virtualbox_version>7.2.8 (unusable - Podman/Docker present)</virtualbox_version> Changing Windows settings does not change Boinc settings[/quote] oh - that was not present in earlier boinc-client versions. looks like the developers took a simple way out of a confusing situation. a shame, since having this as a forced choice is somewhat ahead of reality. |
|
25 years old Send message Joined: 27 Sep 26 Posts: 349 Credit: 5,210,013 RAC: 137,017 |
The new version should work correctly for everyone.
|
Henk Haneveld72 years old Send message Joined: 28 Sep 26 Posts: 31 Credit: 3,560,476 RAC: 84,073 |
I have one running now but I am not sure it is working correctly. Your project info says it will download a Warrior file of 1,5 GB. I don't have that.The largest file I have is about 8 MB for a docker.exe |
|
Send message Joined: 1 Oct 26 Posts: 35 Credit: 86,317,024 RAC: 555,648 |
Is the download happening inside the container? |
|
25 years old Send message Joined: 27 Sep 26 Posts: 349 Credit: 5,210,013 RAC: 137,017 |
yes
|