Processing the JSON from EventStore

[BenStephenson]

Has anyone got any experience or advice on parsing the JSON objects from EventStore?

I need to find the events that correspond to particular Adobe Analytics calls on a certain date in amongst the 14Gig of data. I've spent some time looking at JSON > DB parsers but haven't had much luck in getting them to accept the data format as it comes.

Ideally I want something to loop through the files and extract rows if they have a particular propery in them, and then save that data into something else (a CSV would be OK at this point).

[BenStephenson]

I reckon a PowerShell script is the way forward on this... Must be easier than doing something in JS and processing millions of lines of data.

Anyone?

[mark_reddin · Accepted solution]

Hi @BenStephenson 

I'd recommend you look into jq.  It has a learning curve (although not too bad).  Any other tools I tried didn't scale up to large files very well.  jq can search and transform JSON data, and can transform it into CSV as output.

https://stedolan.github.io/jq/

And here is the best tutorial I found (although there are a few and you may prefer a different one)

https://programminghistorian.org/en/lessons/json-and-jq

[BenStephenson]

Thanks @mark_reddin 
That's exactly what I'm looking for!

[GavinAttard]

HI Folks

I see this is already answered, however if anyone is doing more data work of this nature, i highly recommend Alteryx. It's a real enabler and we have been setting up all sorts of extracts and smart integrations. 

kr

Gavin