In a recent past life, one of the things we did a whole lot of was taking in data from our clients in the form of csv or other flat files via sftp and then staging them in a database or data lake for further processing & analysis. There were a few too many movingContinue reading “The Time I Wanted to Try Serverless File Ingestion”
Tag Archives: S3
Loading Twitter Data into Snowflake the Easy Way
There I was, all proud of myself for finding a GitHub repository with a set of Snowflake processors so I could ingest all that Twitter data via Apache Nifi. It was good work, and it solved a problem. But something about it didn’t feel right. There were a lot of steps, and it seemed likeContinue reading “Loading Twitter Data into Snowflake the Easy Way”
Electric Boogaloo 