3

RedditArchive reddit.com

Submitted by sevengali moderator in sevengali (edited )

Hi,

Here is a list of all the subreddits I have archived. I may or may not be updating these, I will keep this thread up to date. You may request some, and I may fulfill it. Or I wont. You can skip all this text if you want, but I'm not answering questions if it's answered here.

This is mirrored over at raddle.me


#Using this data

To search through the files, you will have to use some SQL on the .db file included. Upload it to here or use this software to open the .db file. Then run the query ("execute SQL"):

SELECT * FROM 'submission' WHERE title LIKE "%<SEARCH TERM>%"

Where <SEARCH TERM> is what you're searching for, for example:

SELECT * FROM 'submission' WHERE title LIKE "%Blade Runner%"

As noted by /u/alnettt, you can string SQL together, like so:

SELECT * FROM 'submission' WHERE title LIKE "%Blade Runner%" AND title LIKE "%x265%" AND title LIKE "%2160p%"

To get all Blade Runner x265 2160p results.

This will give you information about the submission, including it's ID. You can go dig out the .HTML file that corresponds with that ID.

In a future update, the .HTML files will be human readable and searchable through normal means, I wanted these links to get out there ASAP just in case. I'm away over Easter, but they will be here by next Friday. /r/MegaLinks is my top priority, though takes a lengthy time to process.


#About the data

Each upload with have a few files. First is the "css" folder. Don't touch this. Next, a load of HTML files, one for each post. One of these for each post in the sub. They open in your browser, because it's a webpage. It has all the comments, it looks a lot like a reddit thread.

The last two are more for people who want to do something with the archives. First is a CSV file, this opens in spreadsheet software like Excel. Is just a big ol' list of thread IDs. The other is a .db file. This is an sqlite database. You could do a lot with this, or delete it. Up to you really.

The CSV and sqlite database files might be a little bit apart, so there might be some differences. I don't remember what order I did them in - I didn't care enough to take note. The CSV file and all the HTML files are done from the same time. Also, the dates listed below are rounded down to the day before, because adding the time to the table made it even longer and I felt sorry for mobile viewers. The random number at the end of the CSV file is the date+time I ripped all the thread IDs in UNIX Epoch, convert it here. The one at the end of each of the HTML files is the date I archived that particular thread, so the comments will be up to date to the point of that date, not the CSVs date. Hope you got that, probably not reading back myself.

These do not include any wiki posts, content in the sidebar, etc. Just actual, submitted posts and their comments. This tool does not recover deleted (by the user or mods) posts or comments. Deleted posts will still be archived with their comments, just no contents for the OP.

If you would like to archive your own subreddit (or find out how I did this), you can use this tool. If you get stuck, feel free to PM me and I might help.

Date is YYYY-MM-DD.


#Contents

Subreddit Date Size (unzipped) Number of posts Mega link (Base64) Mega key
/r/MEGA 2018-03-28 4.82MB 1,293 aHR0cHM6Ly9tZWdhLm56LyMhWEM0UjJSZ2I= !fJNrVPlK5zFkXKvAnO8LRde29-PwRq_OP3ApQ7DFanU
/r/MegaAnime 2018-03-28 1.28MB 293 aHR0cHM6Ly9tZWdhLm56LyMhTFRZbXhBalQ= !hjdu62wU95lR0l2wfLfDrST39g5N3M3xXulO-h2Bibs
/r/MegaGames 2018-03-28 869KB 308 aHR0cHM6Ly9tZWdhLm56LyMhakNwV2xBZ0k= !MQbIDPhKUbXvou6Wo5J8AJad0R6mnZB23585HXt0p2U
/r/MegaLinks 2018-03-28 211MB 43,953 aHR0cHM6Ly9tZWdhLm56LyMhSGJRVnlSb0E= !GYiD36IS2CFrz6iB9iTf6EV3eG03KJFUfYz7699-fQw
/r/MegaMusic 2018-03-28 1.09MB 494 aHR0cHM6Ly9tZWdhLm56LyMhWFh4WDFiaEs= !y-S7n1MKeBb0K5ZSNmUHtqT_WYMfWuLq2zD80J8zjTM
/r/MEGAnice 2018-03-28 595KB 363 aHR0cHM6Ly9tZWdhLm56LyMhU2ZvaVREQWE= !EoxlfGFDwiwqU321DEO0Rt4SkYzkLn_gnQpp2bpX7f0
/r/MegaPorn 2018-03-28 5.48MB 1,878 aHR0cHM6Ly9tZWdhLm56LyMhZWFnd2xLamE= !f0agxtMBbU0q5tYeG1TbaCv4hGYWgnQek2jIaZO7i6k
/r/MegaRequests 2018-03-28 10.1MB 4799 aHR0cHM6Ly9tZWdhLm56LyMhemZaV0FiWVk= !8fZIy9KuePKJTkKkUf6fHbNkwxAVJE6aI9K5Y7b-FqI
/r/MegaVideos 2018-03-28 574KB 247 aHR0cHM6Ly9tZWdhLm56LyMhdWV3eVJSNFM= !AGmj36ua2QZldiG1D5N0tg7Mx-CUy0YJEWSxR_ddWQo

The following are just the SQLite Database and the CSV file, I have not processed them into HTML files yet.

#Downloading

Subreddit Date Size (unzipped) Number of posts Mega link (Base64) Mega key
/r/CrackWatch 2018-03-28 97.5MB 11,810 aHR0cHM6Ly9tZWdhLm56LyNGIW1IdzJSYnJD !_Bz9cfBqOqx3h4_4fwK5rg
/r/DataHoarder 2018-03-28 193MB 23,976 aHR0cHM6Ly9tZWdhLm56LyNGIVhTbzNTS0FL !iri59bavxaQMbSGjiuS4sA
/r/DHExchange
/r/Filesharing
/r/OpenDirectories 2018-03-28 22.1MB 8484 aHR0cHM6Ly9tZWdhLm56LyNGIURmeEZUS2ph !UVgBwSfn2HYyzhzo-XW7Zw
/r/Piracy
/r/Seedboxes
/r/Torrents
/r/Trackers
/r/UseNet

#Linux

Subreddit Date Size (unzipped) Number of posts Mega link (Base64) Mega key
/r/Archlinux 2018-03-31
/r/Debian 2018-03-31
/r/DistroHopping
/r/DistroReviews
/r/Fedora
/r/Gentoo
/r/GNU
/r/GnuPG
/r/i3wm
/r/Linux
/r/Linux4Noobs
/r/LinuxAdmin
/r/LinuxDev
/r/LinuxFromScratch
/r/LinuxProjects
/r/LinuxQuestions
/r/Qubes
/r/Tails 2018-03-31
/r/Whonix 2018-03-31
/r/XFCE

#Privacy / Security

Subreddit Date Size (unzipped) Number of posts Mega link (Base64) Mega key
/r/ArchLinux
/r/CanadaPrivacy 2018-03-29 300KB 109 aHR0cHM6Ly9tZWdhLm56LyNGIVRDdzBSUUlK !O6Mz25OcO8B6LhGwZALGrg
/r/Compsec 2018-03-31
/r/Crypto
/r/CryptoAnarcy 2018-03-31
/r/Cryptography 2018-03-31
/r/Encryption
/r/EuroPrivacy 2018-03-29 3.5MB 1,970 aHR0cHM6Ly9tZWdhLm56LyNGIU9hQWhWU0lD !cqgaI0Bg4wA6YpBSixXYJQ
/r/NetSec 2018-03-31
/r/NetSecStudents 2018-03-31
/r/Privacy 2018-03-28 251MB 60,633 aHR0cHM6Ly9tZWdhLm56LyNGIWJESWlGQ2dZ !d1jixeNTMLAvgpy259n_4A
/r/PrivacyToolsIO 2018-03-29 16.3MB 3,470 aHR0cHM6Ly9tZWdhLm56LyNGIUhDSmxSTFlD !llD99opEaOzH7WBr_gP8xA
/r/P2P
/r/Security
/r/Selfhosted
/r/Snowden
/r/StallmanWasRight
/r/Sysadmin
/r/Tor
/r/VPN
/r/Websec
/r/WikiLeaks

#Purchasing

Subreddit Date Size (unzipped) Number of posts Mega link (Base64) Mega key
/r/Bitcoin
/r/CryptoCurrency 2018-03-31
/r/FashionReps 2018-03-28 726MB 259,482 aHR0cHM6Ly9tZWdhLm56LyNGIWJMSlNrQ0xS !kwog_RtjnB36fld_vpDxCg
/r/NameCoin

#Other / Unsorted

Subreddit Date Size (unzipped) Number of posts Mega link (Base64) Mega key
/r/Conspiracy
/r/DarkNetPlan 2018-03-31
/r/DeepWeb 2018-03-31
/r/FireFox
/r/Freenet
/r/Freespeech
/r/i2p 2018-03-31
/r/Intelligence
/r/MeshNet
/r/NSALeaks 2018-03-31
/r/Onions 2018-03-31
/r/VPS

Comments

You must log in or register to comment.