[X] My Assistant

We will be migrating various frontend services to a set of shiny new servers* over the next several days. This post will be updated as the various stuff is moved.

If you encounter any new issues after the moves, please post about it here.


2020-11-11

- Thumbnails and static content has been (mostly) migrated.

The primary thumbnail servers now have a lot more capacity and all storage is now local, which means they no longer have to fetch any content from backend servers. This simplifies things a lot, and also improves performance.

Full IPv6 support has also been added for this.


2020-11-12

- Redirected all the remaining thumbnail server dependencies.

- Restored failover functionality for the bits that haven't had it since last summer.


2020-11-16

- The RPC/API frontends and failovers have been swapped over. (These are used for AJAX/inline loading requests.)


2020-11-17

- The main EH frontends and failovers have been swapped over.

This completes the migration from the old frontends, but there are still a couple of other services (archiving and the tracker) that will be moved.


2020-11-19

- The new archive servers have gone live.

The new archivers have both HTTPS and IPv6 support, and also have an order of a magnitude more bandwidth available.

Note that previously generated archives will still be served from the old servers for some time.

(While the available bandwidth is much larger, it is also shared with the rest of the frontend services in the new setup, so we may add a restriction that free downloads are not available around the peak traffic hours (at least during weekends) - this is however not currently active.)


2020-11-23

- The new tracker servers are now live.

The new trackers also add IPv6 support both on the network as well as on the tracker software itself, and should (hopefully) comply with the spec in [bittorrent.org] BEP7.

(Update: There were some issues with stats gathering after the update due to some changes in default behavior in new versions of underlying software, this should be fixed now.)

This completes the deployment of the new frontends, at least for now.


2020-11-29

- The old archiver servers have now been fully phased out.


* For the technically minded, there are four new physical servers that run 12 VMs each, with the following specs:

Dual Xeon Gold 5118
192 GB RAM
6 TB SSD storage
36TB HDD storage
10 Gbps uplinks

I feel this site like a home for me...

thankyou for everything you do (IMG:[invalid] style_emoticons/default/smile.gif)

Wow, didn't expect that many changes in such a short time frame. Thanks, Tenboro!

Nice work!

Great work!

Ooooh, it explains the long DNS waits I'm getting.

In english: expect the site to load a tad slower over the next couple of days as nonauthoritative proxies update themselves.

Great deal of work Tenb!

... For the technically minded, there are four new physical servers which will eventually run 12 VMs each...

Cool! Is that 4x12 VMs for thumbnails/static content alone, or will these servers be shouldering some of the load for other parts of the site too?

And, how much of a capacity increase is this expected to be?

This post has been edited by lestion: Nov 12 2020, 01:08

Cool! Is that 4x12 VMs for thumbnails/static content alone, or will these servers be shouldering some of the load for other parts of the site too?

Static content is just 1 VM per physical server, the rest is for other things.

And, how much of a capacity increase is this expected to be?

Hard to say exactly, since there's different kinds of "capacity" like actual storage space, CPU and bandwidth, but at least twice for all of those. The most important thing is that they can store all the thumbnails locally. Previously, the "combine" thumbnails used for small thumbs were reverse proxied from some other servers.

Nice work!

Just wondering, where the money comes from... (IMG:[invalid] style_emoticons/default/biggrin.gif)

Just wondering, where the money comes from... (IMG:[invalid] style_emoticons/default/biggrin.gif)

[v.redd.it] https://v.redd.it/2z4ol3wfbuy51

Seriously though, the new servers aren't more expensive than the old ones overall, seeing as there are four new ones that'll replace six old ones + offload some tasks from some other servers.

[v.redd.it] https://v.redd.it/2z4ol3wfbuy51

Seriously though, the new servers aren't more expensive than the old ones overall, seeing as there are four new ones that'll replace six old ones + offload some tasks from some other servers.

LMAO

wow

2020-11-17

- The main EH frontends and failovers have been swapped over.

This completes the migration from the old frontends, but there are still a couple of other services (archiving and the tracker) that will be moved.

I was saying this morning how certain pages seem to load faster but I don't even know if it's placebo anymore considering pages normally loaded pretty much instantly for me anyways.

Either way, thanks for the hard work (IMG:[invalid] style_emoticons/default/biggrin.gif)

It's been said before, but thanks Tenboro, for your service to this place. Nice to hear stuff is still ticking along and growing.

[v.redd.it] https://v.redd.it/2z4ol3wfbuy51

Seriously though, the new servers aren't more expensive than the old ones overall, seeing as there are four new ones that'll replace six old ones + offload some tasks from some other servers.

https://www.youtube.com/watch?v=UG7zLhEWanc

(IMG:[invalid] style_emoticons/default/cool.gif)

Thanks for your great work.

This post has been edited by TkzcM: Nov 18 2020, 13:23

thanks for all the work tenboro (IMG:[invalid] style_emoticons/default/smile.gif)

As mentioned in the updated first post, the archivers and trackers have now both been deployed to the new servers.

Seeing as they both run on new major versions of most everything and use a brand new database connector/layer to support doing so, there might still be some remaining subtle issues caused by that. Let me know if you spot any.

IPv6 support for the tracker also required code changes in the tracker itself to support this, so let me know if there are any issues with this as well.

I don't know what happened, but something is wrong right now.
Wanted to load the news page to play a last random encounter today, but it just won't load.
I hope it's not something that went wrong from from this migration.

edit: yeah, it was over https, it was from a bookmark, so the url could not be wrong. It always timed out. It's back to normal this morning of course, but it was really serious back then (IMG:[invalid] style_emoticons/default/sad.gif)

This post has been edited by uareader: Nov 28 2020, 07:49

I don't know what happened, but something is wrong right now.
Wanted to load the news page to play a last random encounter today, but it just won't load.
I hope it's not something that went wrong from from this migration.

Works fine for me, are you loading over https?