API Design for ETL: CodeMash
CodeMash 2020 | API Design for ETL - Lessons from Nearly 100 Data Integrations in the Wild | Dan Mosora
What you'll learn
In the API Economy, users increasingly want to analyze and connect more of their business data, from small startup shops to multinational corporations. Are you thinking about making data available through an API? There are innumerable ways to slice the problem. How do you implement pagination? What data model makes sense? What level of authentication is correct to be secure but usable? At Stitch, the teams have built and reviewed almost 100 data integrations in Python for the Singer project, most of which interact with APIs, and have had good experiences and not-so-good experiences. In this conference talk, Dan Mosora will explore these lessons through APIs in the wild, cover the challenges that Stitch has faced when integrating with an API for ETL purposes, and highlight the qualities that make an API a joy to interact with.