This session explores the evolution of infrastructure strategy, focusing on the shift from traditional YAML configurations to pipelines-as-code. We explore how workflows defined in modern CI/CD systems like Github Actions, Gitlab, and CircleCI often start simple, but eventually transform into a labyrinth of unmanageable YAML code. Using Airbyte (an open source ETL sync tool)’s journey as a case study, we introduce Dagger, a tool that allows defining pipelines in your preferred language, simplifying CI/CD management. This session highlights the benefits of pipelines-as-code over traditional methods, providing practical strategies to enhance developer experience and build agile, reliable, and scalable CI/CD processes.
Speaker
Conor Barber
Senior Software Engineer, Infrastructure @Airbyte, Over a Decade of Experience in Data and Infrastructure Engineering, Previously @Apple
Conor Barber is a software engineer at Airbyte, bringing over a decade of experience in data and infrastructure engineering from leading tech companies. Previously at Apple, Conor develops scalable solutions for complex CI/CD processes involved in managing hundreds of connectors and the ELT platform that the connectors run on at Airbyte.
Find Conor Barber at:
Date
Monday Oct 2 / 03:55PM PDT ( 50 minutes )
Location
Pacific DEKJ
