Welcome Guest ( Log In | Register )

 
Reply to this topicStart new topic
> Some searching and API requests

 
post Dec 2 2016, 07:39
Post #1
Superlatanium



Dreaming of optimizing the system
**********
Group: Gold Star Club
Posts: 7,593
Joined: 27-November 13
Level 500 (Godslayer)


(*) Would it be possible to have an explicit misc: namespace while searching? For instance, we can get exact tag matches by searching for f:group$ or m:group$, but if you search for misc:group$, the search function appears to completely drop the misc: and searches for group$ in any namespace. Sure, we can use exclusions, such as misc:"body swap$" -female:"body swap$" -male:"body swap$", but that's messy. It's also (currently) impossible to exclude a misc: tag without also excluding all m: f: etc tags with the same name. I think all that would be needed would be for a search string of misc:"tagname$" to search or exclude tagname in misc namespace only.

(*) Something else that would be helpful for the cleanup crew would be to have a psuedo-namespace for gallery title that can be used in search.
For instance, back when Dragon Quest and Final Fantasy and Fire Emblem galleries were getting fixed up, it would've gone so much faster if we could've (for instance) searched for p:"dragon quest iii$" without Dragon Quest III in the title so the title and straggler tags could be put in line with standards. (and we definitely haven't seen the last major title/tag cleanup effort yet)
This could also help when we're trying to search for important information that's been tagged but has yet to be added to the title: artist name, group name, parody name, Rewrite, Decensored, Incomplete, etc.
So t would be nice to be able to search with title:"galleryTitleSubstring" or -title:"galleryTitleSubstring" or something of the sort.

(*) From the API, currently there's no way to see if a gallery is visible or not, unless it's been expunged. If it's expunged, it'll return expunged: true, but there's no way to figure out when something's been internally replaced, which means that links generated via the API are sometimes out of date. (so, eg., maybe someone makes a list of tags from API results and posts it in a thread for people to vote on, but some of the galleries have been updated, and it looks silly trying to fix up galleries no one will see) Maybe it could return visible: true or visible: false as well? (If not, that's fine, it's not important)
User is offlineProfile CardPM
Go to the top of the page
+Quote Post

 
post Dec 2 2016, 20:23
Post #2
blue penguin



in umbra, igitur, pugnabimus
***********
Group: Gold Star Club
Posts: 10,046
Joined: 24-March 12
Level 500 (Godslayer)


QUOTE(Superlatanium @ Dec 2 2016, 05:39) *
(*) Would it be possible to have an explicit misc: namespace while searching?
I'm 100% in support of this. It shouldn't be too hard to do, maybe a hack: Create a new namespace "misc:" and assign all tags that are added to the gallery to that namespace. Only after that search for tag groupings to move the tag into a different namespace.

QUOTE
For instance, back when Dragon Quest and Final Fantasy and Fire Emblem galleries were getting fixed up, it would've gone so much faster if we could've (for instance) searched for p:"dragon quest iii$" without Dragon Quest III in the title so the title and straggler tags could be put in line with standards.
But we already have "Search Gallery Title" in the Advanced search menu. So you really only need advsearch=1&f_stags=on.

That said allow me to add a shameless marketing for my search mode script. It allows you to edit the search string before searching, so you can select all tags you want and then copy and paste part of the title into the search. It is what I wrote after being annoyed at the difficulty in copying and pasting tags into the search bar when searching for the same gallery in different languages.

QUOTE
From the API, currently there's no way to see if a gallery is visible or not, unless it's been expunged. If it's expunged, it'll return expunged: true, but there's no way to figure out when something's been internally replaced, which means that links generated via the API are sometimes out of date. (so, eg., maybe someone makes a list of tags from API results and posts it in a thread for people to vote on, but some of the galleries have been updated, and it looks silly trying to fix up galleries no one will see) Maybe it could return visible: true or visible: false as well? (If not, that's fine, it's not important)
Eyup, noticed that in the tagging and abuse thread. On one hand it seems silly, on the other sometimes a gallery is wrongly replaced (and is De-xed after some time) so it makes sense to fix it.

On the third hand, having "visible : t/f" would be a nice plus to the API. And the script could account for reverted galleries easily.
User is offlineProfile CardPM
Go to the top of the page
+Quote Post

 
post Dec 2 2016, 23:39
Post #3
Superlatanium



Dreaming of optimizing the system
**********
Group: Gold Star Club
Posts: 7,593
Joined: 27-November 13
Level 500 (Godslayer)


QUOTE(blue penguin @ Dec 2 2016, 18:23) *
But we already have "Search Gallery Title" in the Advanced search menu. So you really only need advsearch=1&f_stags=on.
I was under the impression that "Search Gallery Title" is a boolean operator on the whole search string; if checked, any words/phrases in the search string that aren't exact tags$ will be searched for in gallery titles (as well as in gallery tags). But that doesn't allow for searching with specific words included or excluded from the title in addition to including/excluding tags: right now it's either all inexact search operators can match the title or gallery tags or all inexact search operators can only match the gallery tags. (or some other requirement over all words put in the search box)

Eg. we currently can't search for something like l:rewrite$ -title:rewrite to find galleries that have the tag but don't have "rewrite" in title. And any search for decensored will almost always give only galleries with the uncensored tag (because decensored is slaved to uncensored) - even if the user searching might be most interested in fixing gallery titles, and wants to include/exclude the tag uncensored$ and separately include/exclude decensored in the gallery title (or another word in a title that might be a tag as well).

Given a narrow enough search scope, I know it's possible to search for (string) uncensored$ (tags included) and then do another search for (string) decensored (gallery titles only), and then manually filter the results to figure out what's different, but that's so tedious.

(do note that this sort of thing is primarily only of interest to those in vigilante; most normal users won't have a desire to specifically include/exclude certain strings from the title or from gallery tags without also including/excluding those same strings from gallery tags. the normal users would benefit from having a title that matches the tags, among other things, but it's the vigilante who make that happen)
QUOTE(blue penguin @ Dec 2 2016, 18:23) *
That said allow me to add a shameless marketing for my search mode script. It allows you to edit the search string before searching, so you can select all tags you want and then copy and paste part of the title into the search. It is what I wrote after being annoyed at the difficulty in copying and pasting tags into the search bar when searching for the same gallery in different languages.
This is what I use, similar to gelbooru tag options

Attached Image

I'll probably post it in a thread soon once it seems fit enough for public use
User is offlineProfile CardPM
Go to the top of the page
+Quote Post

 
post Dec 3 2016, 07:05
Post #4
blue penguin



in umbra, igitur, pugnabimus
***********
Group: Gold Star Club
Posts: 10,046
Joined: 24-March 12
Level 500 (Godslayer)


QUOTE(Superlatanium @ Dec 2 2016, 21:39) *
I was under the impression that "Search Gallery Title" is a boolean operator on the whole search string; if checked, any words/phrases in the search string that aren't exact tags$ will be searched for in gallery titles (as well as in gallery tags). But that doesn't allow for searching with specific words included or excluded from the title in addition to including/excluding tags: right now it's either all inexact search operators can match the title or gallery tags or all inexact search operators can only match the gallery tags. (or some other requirement over all words put in the search box)

Eg. we currently can't search for something like l:rewrite$ -title:rewrite to find galleries that have the tag but don't have "rewrite" in title. And any search for decensored will almost always give only galleries with the uncensored tag (because decensored is slaved to uncensored) - even if the user searching might be most interested in fixing gallery titles, and wants to include/exclude the tag uncensored$ and separately include/exclude decensored in the gallery title (or another word in a title that might be a tag as well).

Given a narrow enough search scope, I know it's possible to search for (string) uncensored$ (tags included) and then do another search for (string) decensored (gallery titles only), and then manually filter the results to figure out what's different, but that's so tedious.

(do note that this sort of thing is primarily only of interest to those in vigilante; most normal users won't have a desire to specifically include/exclude certain strings from the title or from gallery tags without also including/excluding those same strings from gallery tags. the normal users would benefit from having a title that matches the tags, among other things, but it's the vigilante who make that happen)
Well, the search function is full of quirks for completely different reasons (e.g. forbidden artists, words that may be problematic, and tags that should not be searched anyway). On one side I'd like to get more GET url parameters to modify the search, and a couple more operators alright. On the other side, we have several quirks already present thanks to all operators we have. For example nemu nemu$ gives different results from "nemu nemu$", moreover a":nemu nemu$" gives different results from a:"nemu nemu$" ("nemu nemu" is the wrong tag, but people leave it like that in gallery titles).

Therefore i'd like to see a search operator syntax overhaul before adding even more operators.

QUOTE
This is what I use, similar to gelbooru tag options

Attached Image

I'll probably post it in a thread soon once it seems fit enough for public use
Where do you get the list of tags? API call far all galleries and then make the list at the top based on all tags in currently seen galleries, then search when a + or - is clicked and API call again?

That looks like a pretty useful thing. Just release it and someone may find the bugs for you.

(btw, I'm thinking of making github organisation for EH userscript people. But I need to hold a discussion about that first.)
User is offlineProfile CardPM
Go to the top of the page
+Quote Post

 
post Dec 3 2016, 12:39
Post #5
Superlatanium



Dreaming of optimizing the system
**********
Group: Gold Star Club
Posts: 7,593
Joined: 27-November 13
Level 500 (Godslayer)


QUOTE(blue penguin @ Dec 3 2016, 05:05) *
Well, the search function is full of quirks for completely different reasons (e.g. forbidden artists, words that may be problematic, and tags that should not be searched anyway). On one side I'd like to get more GET url parameters to modify the search, and a couple more operators alright. On the other side, we have several quirks already present thanks to all operators we have. For example nemu nemu$ gives different results from "nemu nemu$", moreover a":nemu nemu$" gives different results from a:"nemu nemu$" ("nemu nemu" is the wrong tag, but people leave it like that in gallery titles).

Therefore i'd like to see a search operator syntax overhaul before adding even more operators.
That search behavior is just fine with me at least, each of those makes sense. If users don't use the search syntax correctly and encounter unexpected results, they should (hopefully) be able to double check what they typed, or glance at the wiki or something and be able to do it right. (every word put in the search box is a separate term, unless there are quotes around it, in which case the quoted phrase is a single term, and $ of course means exact tag match. And a letter a user intends to use as a namespace needs to be immediately followed by a ":". The examples sound like only pebcak issues IMO, and we'll have those no matter the software)

I have seen quite a few confusing search-related issues, but they're not directly relevant here. (a while ago I tried variations on the examples on the wiki, many of them seemed broken. I don't know if there was a big update to search a long time ago that broke some things, or if the wiki just hasn't been updated or what. Or is this PEBCAK again? (IMG:[invalid] style_emoticons/default/tongue.gif))
QUOTE(blue penguin @ Dec 3 2016, 05:05) *
Where do you get the list of tags? API call far all galleries and then make the list at the top based on all tags in currently seen galleries, then search when a + or - is clicked and API call again?
Exactly. (Paging Enlargement 1 at least really helps to get a better sample of tags. there are also a bunch of other tweaks that make the UI easier to sift through)
User is offlineProfile CardPM
Go to the top of the page
+Quote Post


Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 


Lo-Fi Version Time is now: 2nd April 2025 - 13:06