Last night I was surfing Reddit, and came across a post in r/learningpython where the poster was asking for tips on making his Python program more efficient. The program itself was a Rock/Paper/Scissors implementation, and he used a ton of code to do it. The truth is it was probably a homework assignment and theyContinue reading “The Time I Used Quantum Mechanics to solve Rock/Paper/Scissors”
Author Archives: craignelson7007
Postgres CDC with Redpanda in Six Easy Pieces, Part 1.0
Replace Kafka with Redpanda and build a Change Data Capture pipeline.
The Time I Accidentally my Entire NiFi
Obligatory “this didn’t happen yesterday but let’s pretend it did because the faux recency gives my thoughts on the topic more gravity.” So I was working on a project/presentation for a job interview that included building out a decently complex flow in my favorite tool, Apache NiFi (sidebar: can the branding police please impose theirContinue reading “The Time I Accidentally my Entire NiFi”
The Time I Wanted to Rekognize Your Face
It’s no big secret that facial recognition is totally a thing these days, and it’s probably also not a big secret that cloud vendors like AWS have services that can make facial recognition amazingly easy to implement. So let’s go ahead and see just how easy it is, ok? There are plenty of tutorials outContinue reading “The Time I Wanted to Rekognize Your Face”
The Time I Wanted to Try Serverless File Ingestion
In a recent past life, one of the things we did a whole lot of was taking in data from our clients in the form of csv or other flat files via sftp and then staging them in a database or data lake for further processing & analysis. There were a few too many movingContinue reading “The Time I Wanted to Try Serverless File Ingestion”
Loading Twitter Data into Snowflake the Easy Way
There I was, all proud of myself for finding a GitHub repository with a set of Snowflake processors so I could ingest all that Twitter data via Apache Nifi. It was good work, and it solved a problem. But something about it didn’t feel right. There were a lot of steps, and it seemed likeContinue reading “Loading Twitter Data into Snowflake the Easy Way”
The Time I Wanted to Send Twitter Data into a Database Part 4: Snowflake
UPDATE: Turns out this the hard way. It’s sort of like long division– You’ll learn lots along the way that makes the easy way make more sense, and you can tell your kids when you were young you had to load data uphill. Both ways. In the snow(flake). But if you just want to doContinue reading “The Time I Wanted to Send Twitter Data into a Database Part 4: Snowflake”
The Time I Wanted to Send Twitter Data into a NoSQL Database Part 3: CosmosDB
E.B. White once famously said that “Everything in life is somewhere else, and you get there in the cloud.” Or something like that. Up to this point in our NoSQL adventure we’ve used containerized databases on our local machine but in the year twenty-and-twenty, we have to increasingly gaze skyward as the cloud becomes moreContinue reading “The Time I Wanted to Send Twitter Data into a NoSQL Database Part 3: CosmosDB”
The Time I Wanted to Send Twitter Data into a NoSQL Database Part 2: Couchbase
It is happening to everyone across the globe– Coronavirus got you down and you’re stuck at home with all this Twitter data and you don’t know where to put it. Couchbase to the rescue! They claim to be NoSQL with NoEQUAL, so let’s see what that’s all about as we continue our NoSQL exploration. InContinue reading “The Time I Wanted to Send Twitter Data into a NoSQL Database Part 2: Couchbase”
The Time I Wanted to Send Twitter Data into a NoSQL Database Part 1: MongoDB
You can’t swing a dead cat without finding a thousand articles on the internet about how NoSQL databases are the greatest thing since whatever the previous greatest thing was, and how they’re great for unstructured & semi-structured data. The problem is there is a lot of hype and buzzspeak out there, and with so manyContinue reading “The Time I Wanted to Send Twitter Data into a NoSQL Database Part 1: MongoDB”
Electric Boogaloo 