You are viewing a single comment's thread.

view the rest of the comments →

Joseph-Guillotin ago

/u/erktheerk Thank you very much for doing this! We'll never know the extent, but you may have saved many children lives. One question: are you sure you crawled everything? It seems like we would have had a bigger db than 16M altogether. Did you backup all threads/comments that ever appeared on that sub, or only within a specific timestamp interval, or vote counts? Thanks for the info.

erktheerk ago

All of it. It's all essentially just .txt file so 16mb is about right for a little over 2000 posts and comments. About half of them only had 1-3 comments.