Data Ingestion How to Ingest and Reconstruct Multiple Unrelated CSV Exports or a PostgreSQL Dump from an Acquired Legacy System You ingest and reconstruct multiple unrelated CSV exports or a PostgreSQL dump from an acquired legacy system by first mapping the dump's underlying schema and relationships, then building a staged... Donal Tobin Read More
Data Ingestion How to Replace Custom Python or PowerShell Scripts for Client Data Ingestion The fastest way to replace custom Python or PowerShell scripts for client data ingestion is to move each script's logic into a reusable, config-driven pipeline that stores connection details, field... Donal Tobin Read More
Data Ingestion Best Alternative to Maintaining Custom Python Scripts for Pulling Data From APIs The best alternative to maintaining custom Python scripts for API data pulls is a low-code ETL platform with a universal REST API connector, which handles authentication, pagination, rate limiting, and... Donal Tobin Read More
Data Ingestion How to Ingest Addepar API Data Into Snowflake on a Scheduled Basis: Step-by-Step To ingest Addepar API data into Snowflake on a scheduled basis, configure an ETL pipeline that authenticates to the Addepar API, triggers an async report job, polls the job status... Donal Tobin Read More