Updated @ Dec 30, 2024 10:19 pm
Modular YAML released: yaml-extras
on PyPI
30 Dec 2024
I’m proud to announce that I’ve made my first official contribution to the Python Package Index
(PyPI) with the release of a package called yaml-extras
. This package is the culmination of what
I’ve discussed in the previous three blog posts dedicated to loading the contents of YAML files
into one another in a modular way. See the other three articles linked below:
What happens when we want PyYAML to dynamically load an entire directory of YAML files into the contents of a single YAML document?
At the moment, this is painfully manual, where importing all the contents of a directory require separate !import
nodes for each
document:
Modular YAML II: merging imports
25 Nov 2024
Where we last left off, I was just able to import a whole YAML file’s contents into another YAML file using a custom
Loader and Constructor in PyYAML for the !import
tag. But there’s a missing piece. What happens if I want to merge
multiple YAML files during import? First, let’s talk about the YAML merge key, “<<”, and how it works.
Modular YAML I: a custom "import" tag
22 Nov 2024
Since I’ve started working at Intuitive full-time, I’ve been interacting with YAML files in some capacity pretty much every day. Some of that is because I do a lot of dbt development as a data engineer, and dbt uses YAML files to define models, tests and other properties about the data model. And there’s pre-commit, Gitlab CI, as well as other custom Intuitive tools that use YAML files to define configurations.
Linear Regression in Rust with AutoGrad
05 May 2022
I’ve spent the past two weeks just starting to get a handle on how to use the popular low-level, memory-safe programming language Rust. In general, it gives me C++ vibes when I’m programming in it. That said, I think that it could have good potential as a machine learning development environment, so long as it is supplied with the appropriate external libraries (or “crates,” to use Rust’s terminology.)