About

I'm an independent developer, and I write about data engineering.

The notes here come from the plain, repeated problems of moving data around: a job that ran twice, a partition that arrived late, a Parquet directory with forty thousand tiny files. I write them down so that I can find them later, and in case they save someone an afternoon.

The site has no author photo, no newsletter and no analytics. Each note stands on its own, uses small examples, and says where the trade-offs are. If something is wrong, I would like to hear about it.

Get in touch

Source, transform, sinkfilesnightly jobtable