[X] My Assistant

Hi all. I'm looking for a few (5-10) members who might be interested in helping me beta test a script I'm in the process of writing.

As we all know, (or at least those of us who use HV Stat know), HV Stat has a built in scan data recorder with options to import and output the contents of the database. I have my "timeout" set to 2 weeks, but with the sheer number of monsters you can encounter I find I'km having to scan an average of 2-3 times each round by the end of an arean/grindfest.

I'm in the process of developing a script that will allow anybody to submit their current hvstat_monster_scan.tsv file, have it merged with a database that contains all the entries sumbitted and then redownload a tzv of the completed database. The same for monster skills although that one is just for fun.

As I only have two PCs I play the hentaiverse on I don't have much in the way of differing data to test the script with so I'm hoping I could get 5-10 HVStat users to kindly agree to help me by submitting their .tzv files and in turn importing the generated tsv files back into HVStat.

As a thanks to those who help out I'll send 10 hath their way (IMG:[invalid] style_emoticons/default/wink.gif) Once the script is finished I'll open it to the public if I don't have any objections - it should really help the wiki beastiary page out too.

PM me or message here if you're interested. If I get more than 10 applicants I'll draw names out of a hat (or come up with more hath if there aren't many more)

To clarify:

1. You need to be running the HV Stat script and recording monster scans
2. You don't need to install any new scripts
3. You need to be willing to download your monster scan database and upload it to my script manually
4. You need to then download the merged databases and re-import into HV Stat

I expect the script to be finished and ready to test within 24 hours. Hath payments will be made one week from today to all testers as a thanks for helping me out

How to uplaod and download you HVStats database:
1. Go to the hentaiverse and click on the HVStats settiongs button (NOTE: You must have already installed HVStat)
2. Go to "Database" and click "export on "Monster Scan Resuilts" and "Monster Skills"
3. Save these two files to your PC
4. Go to [hvscripts.co.uk] http://hvscripts.co.uk/import_export.php and upload the two files you just downloaded
5. It can take up to 30 seconds to upload, import, filter and insert updated only data into the database
5. Click on the download buttons for both (or just one if you only want scan data) and import this back into HVStat in the same place you downloaded it.
6. Report any errors in the thread or by PM!


This post has been edited by animeai: Jun 25 2013, 02:28

sure i'll help (IMG:[invalid] style_emoticons/default/biggrin.gif)

Count me in. Thanks for Inate Arcana.

Many thanks for your offer to help, I'll PM you details once I finish the script (should be by the end of today if I have enough time!)

Still looking for more helpers!

ill help (IMG:[invalid] style_emoticons/default/smile.gif)

Private messages sent out, if anybody else is interested in helping (and claiming that 10 hath reward) please let me know by PM or by posting here!

deliberately tried to upload the monster scan data into the monster skill database and the monster skill data into the monster scan database and got the follow error:

Column count doesn't match value count at row 1Skill Data Updated to the database successfully
Duplicates from Skill data removed
You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '), ("20","Timotei","MANA","MAGICAL","SOUL","2013-03-31T07:09:38.423Z",), ("21","' at line 2Monster Scan Database updated successfullyOld, duplicate scans removed from Monster Scan database

not familiar with mysql so not sure if the error messages were designed by you or are system default error messages but if the files aren't right then the db should not be updated. likewise nothing should be removed.


uploaded skill data to skill db, scan data to scan db:

Skill Data tsv imported successfully.
Skill Data Updated to the database successfully
Duplicates from Skill data removed
Monster Scan Data tsv file imported successfully.
Monster Scan Database updated successfullyOld, duplicate scans removed from Monster Scan database

nothing wrong i guess.


will try to download and import after more people have made changes to the central database.

This post has been edited by hentai_fusion: Jun 19 2013, 22:17

Many thanks for your help - it already has my database in there, yours took the monster total from 2302 to 2529. It's a little hard for me to analyse how many updates it made though, I'm guessing quite a few.

The mysql error means that the file was not imported into the database, it seems the merge and scan for duplicates still runs after an unsuccessful upload but that won't make any changes. I'll look into it to see if I can kill the script at that point if a mysql error is generated

This post has been edited by animeai: Jun 19 2013, 23:15

Hi.
Both scan and skill export use the same name can be a little confusing. Maybe skill_export.tsv and scan_export.tsv, or timestamp ?

Many thanks for your help - it already has my database in there, yours took the monster total from 2302 to 2529. It's a little hard for me to analyse how many updates it made though, I'm guessing quite a few.

The mysql error means that the file was not imported into the database, it seems the merge and scan for duplicates still runs after an unsuccessful upload but that won't make any changes. I'll look into it to see if I can kill the script at that point if a mysql error is generated

from a performance and data integrity point of view, none of the scripts should run when any error is generated.

from a performance and data integrity point of view, none of the scripts should run when any error is generated.

Agreed.

I found the issue, I added an echo for debugging instead of a die error message. That's now been fixed (IMG:[invalid] style_emoticons/default/wink.gif)

deliberately upload the wrong tsv files again and got this:

Fatal error with your MONSTER SKILL file - did you select the correct file?
Column count doesn't match value count at row 1

on a blank page.

this is what i see after uploading the wrong files:


now i need to press "back" in order to re-upload. not very user friendly. previously any messages will appear in the same page.


the file name for the export files need changing as well to differentiate between the monster scan and monster skill files.


deliberately uploaded some old data and got this:

Skill Data tsv imported successfully.
Skill Data Updated to the database successfully
Duplicates from Skill data removed
Monster Scan Data tsv file imported successfully.
Monster Scan Database updated successfully
Old, duplicate scans removed from Monster Scan database

personally i would prefer it to say nothing updated if nothing is really updated. likewise for the removal part.

also for the sake of debugging, i prefer system generated messages to user customised/generalised messages. easier for users to report any problems... no need to describe what they did, just copying and pasting the message log will be sufficient.

Bare in mind it's still a beta script so those "imported successfully" etc messages are there simply for error checking purposes - IE letting me know which query the script failed. Once I'm confident everything is OK that will all change.

The error message "column count doesn't match value count at row 1" is the actual system generated error. The line above is the custom error message based on the most likely issue.

The way I've had to write the code to allow for the weird timestamp style means it's not possible for the script to easily determine if it made any database updates. Remember it's only a simple little thing I threw together in a few hours of playing, not a full blown professional script lol!

When I have time I'll set the download button to name files suitably, but don't expect any updates this side of the weekend (IMG:[invalid] style_emoticons/default/wink.gif)

As before, more beta testers are more than welcome! Send me a PM if you want to earn 10 hath for helping out

Thanks for different export file names. Import successfully.
I hardly had new monster to scan, only found <5 new monsters a day.

You're welcome. I think we've almost got all the issue sorted out now. I'll give it a couple more days before I work on making it look pretty and showing data outputs that will help the wiki XD

For those interested, you can see details of the current data stored in the database (ordered by Monster Power Level) here [hvscripts.co.uk] http://hvscripts.co.uk/view.php

If you want to help with the beta testing please send me a PM or reply here (IMG:[invalid] style_emoticons/default/wink.gif) You can still earn 10 hath!

@animeai

Hi, I have read your PM. It is interesting.

Currently, there is a problem that the online database has the rows which have a value of DEBUFFED_AFFECTED field. The resistances of monsters scanned will be changed by certain debuffs, so I think the online database which should be the baseline should not have the data which were scanned with debuffs.

If the problem is solved, I'll try to integrate into HV STAT.

This post has been edited by greentea039: Jun 22 2013, 16:25

That's pretty simple to fix, I can simply edit the script to not import any rows that have an entry in "DEBUFFED_AFFECTED" and remove any current rows that have this value

Public beta now open!

[hvscripts.co.uk] http://hvscripts.co.uk/import_export.php

NOTE: Still has values in the database with "debuffs affected" so there may be one or two weaknesses that are off, but feel free to upload your hvstats scan database

10 Hath each will be going out as a thankyou to my volunteer beta testers in a couple of days (IMG:[invalid] style_emoticons/default/wink.gif)

This post has been edited by animeai: Jun 25 2013, 02:28

Details on the public beta added to the first post