Replace Kafka with Redpanda and build a Change Data Capture pipeline.
Category Archives: docker
Loading Twitter Data into Snowflake the Easy Way
There I was, all proud of myself for finding a GitHub repository with a set of Snowflake processors so I could ingest all that Twitter data via Apache Nifi. It was good work, and it solved a problem. But something about it didn’t feel right. There were a lot of steps, and it seemed likeContinue reading “Loading Twitter Data into Snowflake the Easy Way”
The Time I Wanted to Send Twitter Data into a Database Part 4: Snowflake
UPDATE: Turns out this the hard way. It’s sort of like long division– You’ll learn lots along the way that makes the easy way make more sense, and you can tell your kids when you were young you had to load data uphill. Both ways. In the snow(flake). But if you just want to doContinue reading “The Time I Wanted to Send Twitter Data into a Database Part 4: Snowflake”
The Time I Wanted to Send Twitter Data into a NoSQL Database Part 3: CosmosDB
E.B. White once famously said that “Everything in life is somewhere else, and you get there in the cloud.” Or something like that. Up to this point in our NoSQL adventure we’ve used containerized databases on our local machine but in the year twenty-and-twenty, we have to increasingly gaze skyward as the cloud becomes moreContinue reading “The Time I Wanted to Send Twitter Data into a NoSQL Database Part 3: CosmosDB”
Electric Boogaloo 