| | This free 140+ page eBook, written for Airflow users by an Airflow expert, walks through everything from “what’s a Dag?” to advanced testing, scaling, and debugging. Download to write Dags you can trust.
*Message from this week's sponsor, Astronomer |
| | |
| | 🔗 Note: if you don’t see links in this email, it’s also available on the web: dataelixir.com/archive/issue-573.html |
| | |
| | Embedding compression usually means accepting some retrieval-quality loss. This post explores a clever middle ground: keep PCA as the encoder, then add a closed-form quadratic decoder to recover some of the nonlinear structure that PCA loses. This is technical, but it leads to smaller vectors and nearly full-size retrieval quality.
Ivan Pleshkov |
| | |
| | A lot of data projects fail before the technical work even starts. This post lays out a lightweight process for turning vague stakeholder requests into shipped work, and makes a strong case that the real skill isn’t starting faster. It’s reducing ambiguity before momentum turns into waste.
Yordan Ivanov |
| | |
| | Quarto makes it easy to create polished reports, docs, and websites, but deployment still depends on your workflow. This post shows how GitLab Pages can publish Quarto projects as reproducible artifacts, with CI/CD handling the rendering and deployment from the same repo.
Nicola Rennie |
| | |
| | | | Radar charts look compact and intuitive, but their most memorable feature is often a visual artifact. This post uses football analytics to show why radar charts can mislead, then replaces them with cleaner comparisons built around linear scales and peer distributions.
PyMC Labs | Chris Fonnesbeck |
| | |
| | | The modern data stack depends on standards that are often invisible until something breaks. This interactive map covers the open standards behind schemas, table formats, lineage, catalogs, quality, observability, policies, and more, with opinionated guidance on what to adopt, assess, or avoid.
Entropy Data | Dr. Simon Harrer |
| | |
| | Satellite data is rich but working with it requires knowing your way around specialized geospatial tools. Earth Index is an open-access resource that uses foundation-model embeddings to simplify the process and make environmental mapping more searchable, interactive, and accessible.
Earth Genome | Ben Strong |
| | |
| | | A modern data center is a lot more than racks of servers. It’s liquid cooling, breaker panels, buffer tanks, fiber runs, leak sensors, power balancing, and a lot of careful engineering. This tour is a fun, nerdy look at the physical infrastructure behind serious compute.
YouTube | Jane Street - 16 minutes |
| | |
| | | This week's issue sponsored by: | | |
|
