[X] My Assistant

How do you download and archive everything from Rule 34 and E-Hentai? Is it possible and how do you archive from your favorite hentai sites? Do you download everything or just from your favorite artists? How many gigs would you have to download to have archived the sites?

How do you download and archive everything from Rule 34 and E-Hentai? Is it possible and how do you archive from your favorite hentai sites? Do you download everything or just from your favorite artists? How many gigs would you have to download to have archived the sites?

you can download galleries as archive, but it costs you Gallery Points to do so.

Please read here: https://ehwiki.org/wiki/Downloading for more info.

How many gigs would you have to download to have archived the sites?

Those are rough, of the back of my head estimates that i unconsciously accumulate over the years; but all EH galleries should take about 50TB. Don't know much about stats from rule34 but my guess would be around 10-20TB

Play HV to get credits and buy gp. Use gp to download archives for galleries. Start with the ones you like, then branch out to favorite artist/character/series/etc.

Alright that's valuable info. So how do I go about it if I already have thousands of favorite artists on both Rule 34 and E-Hentai? Downloading everything manually from Rule 34 isn't possible because it would take way to long. I think downloading everything is important in case Rule 34 and E-Hentai goes down one day in the future for whatever reason. Anyone here who knows how or has already an archive with several TB?

This post has been edited by ForxBase: Jan 25 2022, 20:22

So how do I go about it if I already have thousands of favorite artists on both Rule 34 and E-Hentai?

You have many choices for downloading stuff from these websites, especially from boorus like Rule 34, so it is up to you. Just do some research and try them. I use [github.com] Hydrus Network for Rule 34 and MEMS for EH.

You have many choices for downloading stuff from these websites, especially from boorus like Rule 34, so it is up to you. Just do some research and try them. I use [github.com] Hydrus Network for Rule 34 and MEMS for EH.

Is this a bulk downloader? There are now several million images on Rule 34. Is it still possible to download so many images? Any "data hoarders" here who work on something similar?

but all EH galleries should take about 50TB

More like 100TB if you want all languages + categories.

This post has been edited by Dnkz: Jan 26 2022, 03:53

More like 100TB if you want all languages + categories.

You know any data hoarder on this forum who downloads everything? Or on Rule 34? Would be great to have everything in case the site goes down.

Is this a bulk downloader? There are now several million images on Rule 34. Is it still possible to download so many images? Any "data hoarders" here who work on something similar?

Yes. Of course they are.
Yes. They can download as much as you like because why not.
Yes. There are many data hoarders and I am a minor hoarder myself.

You should really try to be more active and look into things yourself. There are many choices and many things to figure out, and no one is going to tell you exactly how to hoard stuff.

Yes. Of course they are.
Yes. They can download as much as you like because why not.
Yes. There are many data hoarders and I am a minor hoarder myself.

You should really try to be more active and look into things yourself. There are many choices and many things to figure out, and no one is going to tell you exactly how to hoard stuff.

Alright, good to know. One question: Go for quality (own folders for every artist and gallery) or quantity (all images and galleries in one folder)? One is structured but takes a lot more time organizing. One is just download everything in one folder and doesn't require as much time.

One question: Go for quality (own folders for every artist and gallery) or quantity (all images and galleries in one folder)? One is structured but takes a lot more time organizing. One is just download everything in one folder and doesn't require as much time.

Shouldn't that be all up to whatever method you're comfortable with? To paraphrase Mayriad, there are many choices and many things to figure out, and no one is going to tell you exactly how to organize your own stuff.

Having said that, you really should try using the search tool next time. There are a number of posts that discussed this topic already:

https://forums.e-hentai.org/index.php?act=S...ghlite=organize

Ahh, nostalgia. I remember asking this same question years ago because I wanted to do the same thing. Back then EH was probably 20TB, now it's gotta be 50TB, easily.

Don't waste your time, energy, space and bandwidth trying to archive the whole site. You'll never be able to do at the rate new hentai comes out and new galleries pop up. All you can do is download the finite amount of stuff you find that you like and let the nature of the internet handle the rest.

It's ~91 TB, FWIW.

Assuming that you only download original files and only download every unique file once.

It's ~91 TB, FWIW.

Assuming that you only download original files and only download every unique file once.

91 TB, wondering how many unique files are there. (IMG:[invalid] style_emoticons/default/biggrin.gif)

91 TB, wondering how many unique files are there. (IMG:[invalid] style_emoticons/default/biggrin.gif)

103 336 178, as of this post.

If you looked at one image per second, it would take you 3.27 years to view all of them.

103 336 178, as of this post.

If you looked at one image per second, it would take you 3.27 years to view all of them.

I wonder how much the rate of storage growth is accelerating. Even if not accounting for images being larger than they used to be.

Is it a pretty linear rate of acceleration?
If you happen to have that statistic in front of you and are willing to share, that is.

This post has been edited by dragontamer8740: Jan 30 2022, 01:22

I wonder how much the rate of storage growth is accelerating. Even if not accounting for images being larger than they used to be.

Is it a pretty linear rate of acceleration?

I don't really keep those kinds of stats, but it was ~50TB around the middle of 2019, so definitely superlinear.

Ahh, nostalgia. I remember asking this same question years ago because I wanted to do the same thing. Back then EH was probably 20TB, now it's gotta be 50TB, easily.

Don't waste your time, energy, space and bandwidth trying to archive the whole site. You'll never be able to do at the rate new hentai comes out and new galleries pop up. All you can do is download the finite amount of stuff you find that you like and let the nature of the internet handle the rest.

Man, I'm really anxious about stuff getting deleted. Especially my favorite stuff. I want everything to stay forever. I hope every file and gallery is permanent on the net. If every file is permanent I would not need to download everything. Even on Rule 34 there are so many new images just per minute or hour. It's frustrating.