DataOps and the Operations-Centric Data Architecture
  Eric Estabrooks   Eric Estabrooks
Founder, VP of Cloud and Data Services
DataKitchen
www.datakitchen.io
 


 

Tuesday, October 15, 2019
08:30 AM - 11:45 AM

Level:  Intermediate


How do you build an architecture to support a diverse set of teams, roles, and data in a modern organization? Data analysts, data scientists, and data engineers are already working in teams delivering insight and analysis, but how do you get the team to support experimentation and insight delivery without ending up failing? Eric Estabrooks presents the seven steps to get these people and their architecture moving. These seven steps are practical, doable steps that can help you achieve DataOps. DataOps is a collaborative Data Management practice put in mid-2018 on the Gartner 2018 Hype Cycle and is emerging as an area of interest with other analyst groups who recognize the upcoming shift in the industry.

In order to dive into DataOps, Eric outlines the steps to apply DevOps techniques from software development to create an Agile analytics operations environment, including how to add tests, modularize and containerize, do branching and merging, use multiple environments, parameterize your process, use simple storage, and use multiple workflows to deploy to production with W. Edwards Deming efficiency. They explain why “don’t be a hero” should be the motto of analytic teams – emphasizing that while being a hero can feel good, it is not the path to success for individuals in analytic teams.

Eric's goal is to teach analytic teams how to deliver business value quickly and with high quality. They illustrate how to apply Agile processes to your department. However, a process is not enough. Walking through the seven shocking steps will demonstrate how to create a technical environment that truly enables speed and quality by supporting DataOps.


Eric Estabrooks is a Founder and head of Customer Success at DataKitchen, where he is focusing on client delivery and the DataOps operations. Prior to DataKitchen, Eric was the VP of Cloud and Data Services at LeapFrogRx, acquired in 2013 by Model N (MODN), where he built a high-performing data services team that had quality and process improvement baked into its DNA. LeapFrogRx provided a SaaS for analyzing sales and marketing data for its pharma customers. Before coming to Boston, Eric was a lead developer and software architect at Premisys Corporation, acquired by J.D. Edwards, where he helped develop a Configure, Price, Quote (CPQ) platform for manufacturers of highly customizable products in a variety of industries. Eric holds a B.S. in Mechanical Engineering from Penn State University.