The JSON-Driven Schema*
Learn how to use Postgres to explore a JSON data set.
Over the last few releases, Postgres has added and expanded support
for storing and querying JSON documents. While the simplicity and
flexibility of storing free-form data can be appealing, frequently
what’s stored is actually fairly structured. In this talk, we’ll
explore how to incrementally discover the schema of the data you have.
Using data from the GitHub Archive, Jason will show how easy it is to
load JSON data into Postgres, demonstrate some of the tools Postgres
has to work with JSON data, and then use those tools to perform some
fairly mechanical schema refactorings to extract structure from JSON
data and create normalized tables.
PostgreSQL, json, github
I've given this talk at the Portland Postgres User Group (PDXPUG), at work, and will be giving it again at LinuxFest Northwest (https://www.linuxfestnorthwest.org/2016/sessions/json-driven-schema). Slides at https://github.com/jasonaowen/postgres-incremental-schema .
Other speaking experience includes lecturing at the CAT at Portland State University, a volunteer organization doing IT support for the college of engineering and computer science (https://cat.pdx.edu/).
Jason is a developer at Tripwire and an alumnus of Portland State University.