[X] My Assistant

I'm getting errors throughout my H@H connection. I seem to have three separate issues.

First off: All new files fail to download. For example when browsing the E-Hentai galleries and I trigger a new file to download (by loading through my H@H client) the image never loads.

2015-04-28T23:02:14Z [info] {}: Initializing proxy request...
2015-04-28T23:02:14Z [info] Gallery File Download Request initializing for eb2b2225d566d45c87d025cab12d1533d46b04d4-255511-1200-845-jpg...
2015-04-28T23:02:14Z [info] {} Code=200 Bytes=664659 GET /h/ef0ef39486933248ec88bc94c150f399fe25291a-664659-1200-1670-jpg/keystamp=1430262600-50aebea7a4/IMG_0010.jpg HTTP/1.1
2015-04-28T23:02:14Z [WARN] Reported contentLength 0 does not match expected length of file eb2b2225d566d45c87d025cab12d1533d46b04d4-255511-1200-845-jpg (sun.net.www.protocol.http.HttpURLConnection:https://e-hentai.org/r/eb2b2225d566d45c87d025cab12d1533d46b04d4-255511-1200-845-jpg/476105-a9d18c92b81fda882ae1aed13d501301362e7244/809718-11/011_012.jpg)




My 2nd issue seems to be this disk io error. I've checked the permissions on the data folder and the client should be able to write to it. Curious if this directly relates to all new files failing to download.

Rotating output logfile...
2015-04-28T22:54:18Z [info] Started logging to data/log_out
java.io.IOException: Stream closed
at sun.nio.cs.StreamEncoder.ensureOpen(StreamEncoder.java:45)
at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:118)
at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:135)
at java.io.OutputStreamWriter.write(OutputStreamWriter.java:220)
at java.io.Writer.write(Writer.java:157)
at org.hath.base.Out.log(Out.java:217)
at org.hath.base.Out.log(Out.java:185)
at org.hath.base.Out.access$300(Out.java:36)
at org.hath.base.Out$OutPrintStream.println(Out.java:301)
at org.hath.base.Out.info(Out.java:172)
at org.hath.base.Out.startLogger(Out.java:146)
at org.hath.base.Out.log(Out.java:190)
at org.hath.base.Out.access$300(Out.java:36)
at org.hath.base.Out$OutPrintStream.println(Out.java:301)
at org.hath.base.Out.debug(Out.java:168)
at org.hath.base.GalleryFile.attemptDownload(GalleryFile.java:107)
at org.hath.base.Gallery.galleryPass(Gallery.java:76)
at org.hath.base.GalleryDownloadManager.run(GalleryDownloadManager.java:188)
at java.lang.Thread.run(Thread.java:745)
Output logfile rotated.


My third issue happens at client start-up is this a problem?
2015-04-28T22:58:50Z [info] Applying settings...
2015-04-28T22:58:50Z [info] Finished applying settings
2015-04-28T22:58:50Z [info] CacheHandler: Initializing database engine...
2015-04-28T22:58:50Z [info] CacheHandler: Loading database from data/hath.db
2015-04-28T22:58:50Z [ERR] {org.sqlite.SQLiteJDBCLoader.loadNativeLibrary(SQLiteJDBCLoader.java:182)} java.lang.UnsatisfiedLinkError: /tmp/sqlite-3.7.2-libsqlitejdbc.so: /tmp/sqlite-3.7.2-libsqlitejdbc.so: failed to map segment from shared object: Operation not permitted
2015-04-28T22:58:51Z [info] CacheHandler: Using SQLite 3.6.23.1 over SQLiteJDBC 2.1 running in pure mode
2015-04-28T22:58:51Z [info] CacheHandler: Initializing database tables...
2015-04-28T22:58:51Z [info] CacheHandler: Checking future lasthits on non-static files...




Now, all that said it looks like some parts of the client are still working. As I see this throughout the logs.
2015-04-28T23:15:16Z [info] {2066/219.108.165.7} Code=200 Bytes=956260 GET /h/57a1987c7d68d07636f8c6b1cd1f8fba0840fba1-956260-1280-960-jpg/keystamp=1430263500-e997cd81c8/h06.jpg HTTP/1.1
2015-04-28T23:15:16Z [info] {} Code=200 Bytes=711892 Finished processing request in 2.50 seconds (284.30 KB/s)

Also my trust/quality seem to be fine.

This post has been edited by G Just G: Apr 29 2015, 01:19

#2 is weird but shouldn't be a problem, and #3 isn't a problem (it just means it'll be running in pure Java mode).

As for #1, your connection to the cluster appears to be blocked somehow. If you PM me the IP address of your client, I can check if the range is blocked on our end.

I have sent a PM with the IP information.

Also my trust/quality has crashed. My guess is because I'm not downloading any new files into the cache and can only serve what's been previously downloaded. Do you think I'll need to clear my static ranges and rebuild the hath.db files or should the H@H client download any missing files once the IP address is unblocked?


I was able to resolve issue #2 by stopping the H@H client, deleting the old log files and then letting the client rebuild the logs after starting. Seems to have actually been a write permission issue for some reason.

This post has been edited by G Just G: Apr 30 2015, 01:15

It's not blocked on our end, so it would have to be your ISP or something else blocking the connections.

You don't need to clear static ranges, it will grab them on-demand the next time they are requested.

I have attempted to load one of the links that the H@H client is attempting to load through LYNX and I've received the following message.


Attempting to open:
https://e-hentai.org/r/a6438bbd081c43a06d...810148-2/02.jpg

message received:
Your IP address has been temporarily banned for excessive pageloads which indicates that you are using automated mirroring/harvesting software. The ban expires in 1 days and 23 hours


I can open this just fine from my home PC.

This post has been edited by G Just G: Apr 30 2015, 17:28

Your IP address has been temporarily banned for excessive pageloads which indicates that you are using automated mirroring/harvesting software. The ban expires in 1 days and 23 hours

Hmm. I thought I fixed that shit, I guess I'll need to take another look at it. Should be unblocked now.

Thanks, it's working now.

Tenboro, this issue has reoccurred on my H@H proxy.

By the way, this is a headless dedicated server so I don't even browse through it. I use the machine for grabbing things via the H@H down loader.

Your IP address has been temporarily banned for excessive pageloads which indicates that you are using automated mirroring/harvesting software. The ban expires in 5 days and 15 hours

Yeah, I haven't found the root cause yet (not that I've had a lot of time to look), but it should be unblocked again now.

This just happened again.

I'm pretty sure it's the H@H downloader causing the issue as I had a few hundred hathdl files in the hathdl folder.

Unblocked again. It seems to happen very rarely, but I swear I'll get around to it soon.

I think I caught a proxy issue too now. Client runs completely fine (trust and quality are almost at cap) but any time I use it as a proxy it gives me this when I try to get a picture to load:

CODE

2015-08-18T13:50:26Z [info] {22/127.0.0.1}      : Initializing proxy request...
2015-08-18T13:50:26Z [info] Gallery File Download Request initializing for d642ee62e885282803c4aac144821689a38977a5-728963-720-1093-jpg...
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)} java.net.ConnectException: Connection refused: connect
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at java.net.PlainSocketImpl.connect(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at java.net.SocksSocketImpl.connect(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at java.net.Socket.connect(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at sun.net.NetworkClient.doConnect(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at sun.net.www.http.HttpClient.openServer(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at sun.net.www.http.HttpClient.openServer(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at sun.net.www.http.HttpClient.<init>(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at sun.net.www.http.HttpClient.New(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at sun.net.www.http.HttpClient.New(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at sun.net.www.protocol.http.HttpURLConnection.plainConnect(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at sun.net.www.protocol.http.HttpURLConnection.connect(Unknown Source)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at org.hath.base.GalleryFileDownloader.initialize(GalleryFileDownloader.java:96)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at org.hath.base.HTTPResponseProcessorProxy.initialize(HTTPResponseProcessorProxy.java:41)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at org.hath.base.HTTPResponse.getHTTPResponseProcessor(HTTPResponse.java:367)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at org.hath.base.HTTPSession.run(HTTPSession.java:115)
2015-08-18T13:50:28Z [ERR] {java.lang.Throwable$WrappedPrintStream.println(Unknown Source)}     at java.lang.Thread.run(Unknown Source)

So far my client hasn't downloaded any new files at all (files in cache hasn't moved in a while). Got the latest JRE and deleted my hath.db yesterday but no improvement. Will report back if something changes.

Side note: My only hath.db.bak was all the way back from December; normal?

Update: Seems to no longer be an issue. The only thing I changed was disabling EFF's Privacy Badger on Firefox. Think that was the cause?

Update: Seems to no longer be an issue. The only thing I changed was disabling EFF's Privacy Badger on Firefox. Think that was the cause?

Likely, that thing prevents you from sending cookies to "Refer" IPs of advertisers. Which kind off looks like the H@H cluster. (although i haven't done a proper test before posting this, it is a theoretical digression)

There must be some clever workaround but i cannot think of something right now.

Tenboro it's happened again.

Tenboro it's happened again.

I believe I've fixed the core issue, let me know if you see it again.

Update: Seems to no longer be an issue. The only thing I changed was disabling EFF's Privacy Badger on Firefox. Think that was the cause?

Update: Issue came right back; EFF's PB is not the culprit. I suspect this is on the server end.

This post has been edited by Maximum_Joe: Aug 22 2015, 19:23

Update: Issue came right back; EFF's PB is not the culprit. I suspect this is on the server end.

You haven't hardcoded any IPs, have you? Because it seems like it's just outright failing to connect, and that's about the error I'd expect if you were trying an outdated frontend. The timing is rather suspect, since your original post was about a day after I shut down some old ones.

Nothing should be hardcoded on my end. Restarting the client now and testing on my own galleries.

Edit1:
>nope.avi
Both FF and Chrome have the same issue. Gonna poke my router next.

Edit2:
Today everything is working fine...

This post has been edited by Maximum_Joe: Aug 23 2015, 17:48

Tenboro, wanted to let you know that it seems to be fixed.

Thanks for that.