Highlighted

Processing the JSON from EventStore

BenStephenson
Contributor
BenStephenson Contributor

Has anyone got any experience or advice on parsing the JSON objects from EventStore?

I need to find the events that correspond to particular Adobe Analytics calls on a certain date in amongst the 14Gig of data. I've spent some time looking at JSON > DB parsers but haven't had much luck in getting them to accept the data format as it comes.

Ideally I want something to loop through the files and extract rows if they have a particular propery in them, and then save that data into something else (a CSV would be OK at this point).

 

4 REPLIES 4

Processing the JSON from EventStore

BenStephenson
Contributor
BenStephenson Contributor

I reckon a PowerShell script is the way forward on this... Must be easier than doing something in JS and processing millions of lines of data.

Anyone?

Processing the JSON from EventStore

Tealium Employee

Hi @BenStephenson 

I'd recommend you look into jq.  It has a learning curve (although not too bad).  Any other tools I tried didn't scale up to large files very well.  jq can search and transform JSON data, and can transform it into CSV as output.

https://stedolan.github.io/jq/

And here is the best tutorial I found (although there are a few and you may prefer a different one)

https://programminghistorian.org/en/lessons/json-and-jq

 

Processing the JSON from EventStore

BenStephenson
Contributor
BenStephenson Contributor

Thanks @mark_reddin 
That's exactly what I'm looking for!

Processing the JSON from EventStore

GavinAttard
Occasional Contributor
GavinAttard Occasional Contributor

HI Folks

 

I see this is already answered, however if anyone is doing more data work of this nature, i highly recommend Alteryx. It's a real enabler and we have been setting up all sorts of extracts and smart integrations. 

kr

 

Gavin

Research your Experience | Improve and Evolve | Leave no one behind