Welcome Guest ( Log In | Register )

 
Reply to this topicStart new topic
> Torrent Creation Process

 
post Mar 1 2025, 12:28
Post #1
peacethroughpower



Newcomer
*
Group: Gold Star Club
Posts: 18
Joined: 12-December 17
Level 357 (Dovahkiin)


I've been making torrents for a while for content I believe deserves archival and I thought I'd share some of my process.

I own a Linux machine of older hardware which I run a lot of things on, but the two which are relevant here are Hentai@Home and a couple [en.wikipedia.org] rtorrent instances. If I see a gallery I think deserves archival, I'll do an archive download at original resolution with the Hentai@Home downloader. Once it's finished, I transfer it over and compress it using [www.7-zip.org] 7-Zip.
[i.imgur.com] 7-Zip Settings On a 5800x3D, most galleries compress within 5-10 minutes at most. Using LZMA, and thus, being limited to two threads, certainly slows things down. I do it since it allegedly has slightly better compression ratios. Unfortunately, I'm limited to 32GB of RAM on this motherboard. If and when I get better hardware, I'll adjust it to use more RAM.

Once that's done, I'll upload the archive to my Linux machine and make a torrent using [github.com] dotTorrent-GUI.

[i.imgur.com] dotTorrent-GUI settings I always use 32MiB piece sizes to break compatibility with ancient closed-source clients people still use for whatever reason. After this, I pop it into the torrent client, enable [en.wikipedia.org] super seeding and away it goes.

My reasoning for doing this is to provide the best release possible, and part of that is the smallest release possible. I can often mog people by uploading smaller archives of the same content. Since some of this is specialized knowledge, I thought I may as well share my process. What can be uploaded as a torrent is very much non-standardized and irregular, as well as barely being incentivized by site mechanics. That might be worth considering changing in the future, modeled on certain other P2P and scene standards and communities.

(There is, of course, the downside that decompressing takes a lot more memory, but it's still insignificant on reasonably modern hardware.)

https://e-hentai.org/g/3257320/67ab4c6bf3/
Statistics on this gallery in particular:

Uncompressed size: 1.77 GiB 100%
Zip Archive Size: 1.68 GiB 94.9%
7-Zip Archive Size: 762.1 MiB 52.92%

Compression ratios obviously depend on content and format. Ancient formats like JPG and GIF tend to be inefficient and thus compress better.
User is offlineProfile CardPM
Go to the top of the page
+Quote Post

 
post Mar 13 2025, 21:10
Post #2
WarpedJ



Casual Poster
***
Group: Members
Posts: 120
Joined: 8-December 20
Level 86 (Master)


Hi,

What does 'mog' mean please?

Thank you.
User is offlineProfile CardPM
Go to the top of the page
+Quote Post

 
post Mar 15 2025, 05:08
Post #3
peacethroughpower



Newcomer
*
Group: Gold Star Club
Posts: 18
Joined: 12-December 17
Level 357 (Dovahkiin)


QUOTE(WarpedJ @ Mar 13 2025, 12:10) *

Hi,

What does 'mog' mean please?

Thank you.


[www.urbandictionary.com] https://www.urbandictionary.com/define.php?term=mog

QUOTE(Urban Dictionary)
mog
a term popularized by modern day aesthetic bodybuilders meaning out sizing or dwarfing somebody in muscle size, fullness, and definition
Watch me man I’m about to fucking mog these rockets over there!
Jesus Christ that guy is about to mog them!


What I meant by it was to sort of brag about how compressed my archives are. So, by showing that off, and showing how other people have larger archives (which is negative in this context), I sort of look better by comparison.
User is offlineProfile CardPM
Go to the top of the page
+Quote Post

 
post Mar 16 2025, 01:34
Post #4
WarpedJ



Casual Poster
***
Group: Members
Posts: 120
Joined: 8-December 20
Level 86 (Master)


Thank you for explaining that!
User is offlineProfile CardPM
Go to the top of the page
+Quote Post

 
post May 5 2025, 04:57
Post #5
ScrewDriver1337



Lurker
Group: Lurkers
Posts: 2
Joined: 10-February 24
Level 32 (Journeyman)


Hello

Thank You for invitation to thread, sorry that late. Better late than never.

My EHentai seeding begun in ~2023 from raspberry pi. Through my path and torrents scale I had to
Upgrade both my compute, storage and network equipment.

I had to learn a lot of network engineering to accomplish what I wanted.

In 2024 I ran torrenting on FreeBSD host on minipc with 2.5" hdd. Now I use Proxmox for virtualization,
ZFS for torrent data and two rtorrent instances. I also switched to Linux.

For torrent creation I used mktorrent, but now I use mkbrr as it slightly faster when hashing large zip archives

My workflow is pretty manual - I review each gallery I download through hath participation, while 'gooning', I launch my script
to grap .zip from hath and create torrent file, which I upload to gallery torrents. This workflow is perfect balance between automatization
and manual labor.

Regarding torrenting, in past I used Transmission in daemon mode, but I noticed that it no longer can keep up with 1000 torrents,
so I made massive migration to rtorrent.
My first rtorrent instance has 1100 torrents and remote rtorrent instance has another 900.

Now I have issue with 2.5" drive not keeping up with iops at 250Mbps torrent seeding demand, with ~100 peers active.
So I plan to upgrade to enterprise server with HBA SAS card / workstation tower server.
My primary 3.5" SATA hard drive has no issue with iops though.

I use ZFS as it has powerful ARC cache, yes it demands RAM, but helps with growing demands.

QUOTE(peacethroughpower @ Mar 1 2025, 13:28) *





rtorrent 0.15.1 + flood.js frontend
User is offlineProfile CardPM
Go to the top of the page
+Quote Post

 
post Jun 6 2025, 19:07
Post #6
Pillpug



Newcomer
*
Group: Members
Posts: 23
Joined: 24-September 24
Level 229 (Godslayer)


QUOTE(peacethroughpower @ Mar 1 2025, 06:28) *

I'm limited to 32GB of RAM on this motherboard. If and when I get better hardware, I'll adjust it to use more RAM.




Why do you think more ram will help your compression ratio when 2x the source already fits in ram ? Does linux not have virtual memory?
User is offlineProfile CardPM
Go to the top of the page
+Quote Post


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 


Lo-Fi Version Time is now: 12th June 2025 - 13:51