Thread: [PROJECT] Resource Gathering Log

Welcome All,

As outlined in my Tx5 (Truvy's Totally Terrific Task Tally) post found HERE, This will be the project page for all Gatherers who wish to partake in logging their results so that we can eventually provide the site with pages in our Atlas section (coming soon) that will break down by Zone the Nodes, Available Resources, and % of getting said resources.

This is a great chance for everyone to help contribute to the success of this site and create a meaningful and extensive database.

The scope of this project is currently wide open as we need results from everywhere.

THE FORM: Please download and use the form found here: [RESEARCH] Gathering Resource Log - Downloads - FFXIV Origin Forums This spreadsheet has been outfitted with 3 tabs at the bottom for Fishing, Mining, and logging. Your results are easy to input as each field uses a click-pull down menu pre-populated with the available options.

(Should you encounter a result in a given gathering profession that is not on the list, please PM me and I will update the form)

A little bit about the form so there is no confusion. Please check the zone you are in and the Coordinates you are at. This is done by accessing the in game map and reading the coordinates as Horizontal then Vertical. (Across the Top, then Down the side). Please log your results as: ( XX , YY ) in the column labeled Coordinates.

Also, a note field has been given to make note of anything unique about your location, or the results you were getting. (IE: "Lots of Argo mobs at this spot", "<item> was very difficult to fish up at my rank #", etc)

A Word on Fishing: Please make sure that you are NOT in a school when you are logging your results. The results from schools will always produce the same results and will skew the %'s when we tabulate.

A Word on Leve's: Please make sure that you are NOT undergoing a leve while gathering. Certain leve's produce different results and we want a 'normal' based set of results.



ALSO: I maintain a group called "Gathers R Us" which can be found here: http://www.ffxivorigin.com/groups/gather-s-r-us.html It is a moderated group for the sole purpose of discussing all things gathering and this project related that doesn't need to waste space on the regular forums. Those members who wish partake in this project officially i have outlined the following to officially take part:

1. Be a registered Member of this Forum
2. Register for the Group listed above
3. Download the Form listed above
4. Send me a PM indicating in the Subject: Project - Gathering request
5. Begin logging your results on the form and saving them often (don't want to loose data to crashes etc)
6. Email your form (do a Save As and at the beginning of the file name Insert your Forum name like this (Forum Name)) to me weekly by Monday 4am PST (Will begin the compiling and exporting of your individual data to the overall database)

For your help in all of this I will offer something fun for everyone: Forum Titles! It will work like this, once you have completed steps 1-4 you will obtain the intro Rank. As you progress your rank will increase. The progression will be based on the number of results you provide (NO copy/paste as I will spot check your results for patterns as well as cross reference the number of results versus your current skill rank on the Lodestone to see if you are at the right level for the number of results you've submitted....so just no cheating ok...bad for the results anyways >.>) The ranks are as follows:

Code:

 
 (starter)          Level 1  - Data Probie 
 (250 results)      Level 2  - Field Assistant
 (500 results)      Level 3  - Field Analyst
 (1000 results)     Level 4  - Data Researcher
 (2500 results)     Level 5  - Gatherer Ultimates

Also, failure to submit a form to me each week with at least 50 new results will drop you a level (by 50 results per week, so you can get it back pretty easy). Once Level 5 is achieved it will always be there as proof of your achievement and contribution to this site.

Throughout this, there will be instructions handed down as we narrow in on our field of research (specific locations and noded to gather data from.) These "Special Assignemnts" will contribute to your results total and will be given in game Gil compensation for your help. (Think of it as a Site Leve )

I look forward to all those who wish to help contribute to this and getting our hands dirty!

I did some voice to text recording for Beta but found it to be a little problematic...still had to make it the active window so i was there anyways...and when i switched to a different box, I had to correct spelling a ton...several of the names in the game don't translate well with talk to text

Hence, I created lists to use for the pull down boxes in the forms.

Yeah higher level tools are being researched right now to see how to craft them. However, leve's still offer a good chance to give you gear you need for your level...just don't record the data while in the leve

I'd suggest adding another digit to the grid references. There are usually multiple nodes in a 100 yalm radius. So, by going (304,255) you bring it down to a 10 yalm radius.

Personally I print off a map and mark down each node so its easier to come back to it.

Im not a programmer.. but If anyone is, could they perhaps build a data parser for DoL results? I've seen one for battles, but DoL and crafting usually get overlooked. Then collecting data would be as easy as hitting a macro(time of day, which can be converted to game time), typing in your current coordinates(not as accurate for fishing), and harvesting!

Then at the end of the day, you run a little program that creates a spreadsheet that you can post online for everyone.

the grid as its will work since we'll have the nodes mapped out on the actual Atlas pages so people can see where they are inside the grid locations.

A parser would be handy, but i've not the time to put one together. As it is, the spreedsheet works well since it will all import into the SQL DB I have going for logging the results to then display on the atlas pages when we get those up

I would love to write a parser, where are the logs stored or how do you save the log to the hard drive (I need this to write the parser). What language do we need it in? PHP? Or should I make it a .NET application to create a CSV or XLS file for import into SQL (can go directly to SQL as well if need be )

Log files are at:

C:\Users\Nicholi\Documents\My Games\FINAL FANTASY XIV\user\01E30499\log

SE stores the logs in a bunch of different files.. so that might make it a bit harder... I wish you the best of luck!
and if we're going with a 4 digit grid reference I really hope SE implements the <pos> function.

*note: your computer probably isnt called Nicholi. If it is.. well then that's just weird.

Yeah, I went looking for them on Saturday and couldn't find any log directories! I was wondering if that was just Beta or if there was something I had to turn on for logging. I also couldn't find the Registry Entries for FFXIV (though I didn't look extremely hard!). I will check again tonight for the logs and let you know.

---------- Post added at 05:25 PM ---------- Previous post was at 12:06 PM ----------

yay found them! iwill start a parser a little later on tonight! I just started my Character on Melmond and learning my way around. Yay!!!! Though someone stole my name so I had to use Elaison instead

Ummm Well, I just started the parser, that part is easy, the log is simple. The problem being is that there is no evident location information in the log files!!!! I haven't decrypted the header yet, but it could be in there. I have no clue. If anyone beats me to that part, please let me know so I can get it out of there!

I was thinking that we'd have to type in the grid location ourselves.

So, before mining a node we'd type in:

/echo mining at 123,456

have it standardized for the data collectors so that you can pull it up through the parser. Could you incorporate time as well? so that we'd type:

/echo mining at 123,456
/time

that way with enough data, we might be able to make corralations with moon phases and days and such.

Nicholi...I know you really really want to use your version of a 3 digit grid refrence. However, as it pertains to the Atlas maps, they will be refrenced with the in game map grids, using the displayed 2 digit refrence.

As far as your theory that given nodes within a grid location offer different items, this has yet to be proven (its very possible dont get me wrong, i _do_ notice a trend that way), but once we have the points "plotted" on the map, they will assigned an index number (meaning that you can then refrence the very specific node as it is on the map)

For example below:

mini1.jpg Lets pretend this is one standard grid box with 3 mining nodes in it. The log sheet would be updated to allow you to enter which node you are gathering your data from. That part of it just isn't there yet as 1) Its not proven beyond doubt that there is a difference in nodes of a given rank in the same zone. and 2) We don't have them all plotted yet (not officially catalog and indexed that is).

It actually wouldn't be hard to add a .? to the end of a coord. Going to the 10th column is reasonable considering there are 100 pixels between the grid lines. (well, 99)

Nodes do actively give different items. I've gotten rock salt continuously out of one and alumen out of another. R2 nodes at drybone were the same for zinc/tin. I'd get tin out of only one node there. I found 2 nodes that would give zinc. Both of those are rares though. I honestly don't think you need a parser or exact % of items. Just go to any node when there are 4+ people there and watch the log. You get a pretty good idea what drops there and what is rare and you get it fast.

Ah yes, I do like the bit about making a macro to echo code for the parser to pick up

/echo ##data long## mining
/echo location:

Then you would just say the number of the node you were working on before starting. Be good stuff. End it with a closing macro

/echo ##stop log##

Is there a form to submit the quarry/spearfishing nodes and what we get from them?

if the data is in the log I can get it, that isn't a problem it is just getting it there. I think the macro is a great idea.

Originally Posted by truvy

As far as your theory that given nodes within a grid location offer different items, this has yet to be proven (its very possible dont get me wrong, i _do_ notice a trend that way), but once we have the points "plotted" on the map, they will assigned an index number (meaning that you can then refrence the very specific node as it is on the map)

This is a great idea. I'll start up a thread so that we can start logging the different harvesting nodes. That way, when someone makes the map, they have a slew of points to get it started.

I'll do that after work today.

and I know (without any scientific evicence) that not all lv2 points near Ul'Dulh are the same. The ones on border mountains are differnet from the one's on boulders, which are different from the ones in desert cliffs. I plan on doing some mining tonight, I'll come up with an example that has drop rates attached to it.

Excellent all, I'm glad that we've got a few of us willing to put in the leg work on this.

@Ruwyn: I will update the spreedsheet to include the sub-gathering crafts...I will include the regular gathering item tables but if you get a result that is not on the list, please PM me and I will make an update to it. I'll get this up within the hour.

@Kyrie: I will setup a macro to test this and see what my logs look like and shoot a copy of em your way to see what sort of magic you can work with it. Ideally, the parser would simply look for all entries of the given code in the macro and ignore the rest. I'll have to see how the logs split up...i get the feeling SE broke up the log files on purpose...so...perhaps we add a Time Stamp (manually) after the start log macro for refrence to make it easier.

@Nicholi: La Nosca is pretty well mapped out, so Uldah and Grid will be helpful to have. I have the map files I'm using for my own tracking until the Atlas gets implimented. I'll ask Zissling today when they think we might have access to it. Then you guys can feed me your node maps, I can plot it on the official grid and assign nodes a index number, and we can log em better on the spreedsheet that way.

Festive

---------- Post added at 01:14 PM ---------- Previous post was at 12:56 PM ----------

UPDATE: a revised spreedsheet is now in the DL section, you can follow the same link as in the OP. If you encounter any items not on the list for the sub-gathering lists let me know and i update it.

Truvy,
It looks like they have setup a log file for each time you start an encounter or start building something. I hope the macro works out and we can get really good data from everyone! Having hundreds of people logging stuff would be AWESOME! Oh, whne can I see if I can get in the LS on Mel? heheh

Ky

If they start a new file for every encounter, could you just pull the time stamp off the file?

(Im not a programmer and have no idea how much work this would involve, I just know that every file has a time of creation associated with it)

Send me a tell in game Kyre and We'll get yas in.

As far as the stamp goes, i'll have to look again, not sure it was logged

Truvy,
I will send a tell in game as soon as I have the time to be running around the world again (rl sux to high heaven and I am building a new PC over the next 2 weeks!!!! Whee!!!)

Nicholi,
Yes, if the location and time are in each file then we are golden!!! I am just hoping that it works that way!!!

Ky!