Viewing a single comment thread. View all comments

5

meseeks_programmer wrote (edited )

aHR0cHM6Ly9tZWdhLm56LyMhYm81R1ZLSkohbld3X1hKc0EydEcyUWthbTRZcURJT0Y2RnhweVBDaUlNckZraWJaSGpFYw0K

https://www.base64encode.org/

Here is a backup I made of all the content posted on r/megalinks starting from Jan 1, 2015.

JSON Format:

{
    id,
    title,
    body,
    comments: [] as a list,
    viewcount, 
    utc(time)
}

No reason to lose all these old links :D

2

Mortos3 wrote

Nice! I thought Reddit had a limitation of only being able to look back a certain number of posts though, how did you capture all of it?

2

gurbhedgethehedgehog wrote

I used a special method using PRAW to search between dates, but it is being discontinued I heard at the end of the month by reddits new api rules, which is a bunch of bs. I'm currently doing another bigger grab even further back in time, and even organizing it into smaller files for Movies/TV/.. Will post when I finish doing that as well.