The Speedcube.de forum used to be a German Speedcubing forum based on the MyBB forum software.
It was archived in September of 2024 and replaced by

Search code, repositories, users, issues, pull requests...

submited by

Style Pass

2024-10-04 08:30:04

The Speedcube.de forum used to be a German Speedcubing forum based on the MyBB forum software. It was archived in September of 2024 and replaced by a static read-only version.

The command took 1 week to traverse the entire forum and download all files, and 1 more week to convert all links. The majority of the slowdown was caused by wget having to parse posts in threaded mode, which are not only many in number, but also each very large. See for example Thread #7728.

Because the produced mirror is around 260GB large, and buying a server with that much disk space just for serving it would be expensive, the final mirror was compressed into a SquashFS file instead:

SquashFS not only supports good compression (I used zstd in this case) but also efficient random access. The resulting file only measures ~12GB can then be mounted, allowing access to the individual files again. This requires ad-hoc decompression of each accessed file, which is well worth it.

Additionally, speedcubers.de used to be a redirect to forum.speedcubers.de. For that, see github.com/SpeedcubeDE/speedcubers-redirect.