Alex Lovell-Troy

OpenCHAMI Core Team Member.

GitHub: alexlovelltroy

Code Deep Dive: Dynamic Data Persistence for our Control Plane

This blog post dives into the 'In-Memory Working Set with Periodic Snapshots' pattern implemented in the node-orchestrator project. Learn how this approach leverages DuckDB and Parquet to efficiently manage control plane data, offering speed and reliability. Discover the advantages for HPC sysadmins, including reduced management overhead and simplified recovery, as well as comparisons to other data storage methods.

July 1, 2024 in Development, LANL by Alex Lovell-Troy6 minutes