Drill to Detail Ep.81 'Meltano, Singer Taps and Open-Source Data Pipelines' with Special Guest Douwe Maan

Mark Rittman is joined in this episode by GitLab.com Lead Developer Douwe Maan to discuss the history of the open-source Meltano project and its recent refocus on becoming the "glue" that creates open-source data pipelines, using plugin technologies such as Singer Taps and dbt transformations.

• Meltano homepage and quickstart demo

• Hey, data teams - We're working on a tool just for you

• Revisiting the Meltano strategy: a return to our roots

• Why we are building an open source platform for ELT pipelines

• Singer - Simple, Composable, Open Source ETL

• dbt Models - Everything is a select

• Meltano Slack Community

Ep.81 'Meltano, Singer Taps and Open-Source Data Pipelines' with Special Guest Douwe Maan

Mark Rittman

Download

Drill to Detail Ep.80 'Data Architecture and Data Teams at Hubspot' with Special Guest James Densmore

Mark Rittman is joined in this episode by Hubspot's Director of Data Infrastructure James Densmore to talk about distributed and remote-friendly data teams, DevOps with dbt and Apache Airflow and career path options for data engineers.

• How should I structure my data team? A look inside HubSpot, Away, M.M. LaFleur, and more (dbt Blog)

• Software Engineers do not Need to Become Managers to Thrive (Data Liftoff Blog)

• The Misunderstood Data Engineer (Data Liftoff Blog)

• Modular ELT (Data Liftoff Blog)

• Test SQL Pipelines against Production Clones using DBT and Snowflake (Dan Gooden)

• HubSpot Data Actions, Harvest Analytical Workflows and Looker Data Platform (Rittman Analytics Blog)

Ep.80 'Data Architecture and Data Teams at Hubspot' with Special Guest James Densmore

Mark Rittman

Download