Open Source Project

Argo OS Build Swarm

Distributed binary package compilation for Argo OS

-- Worker Drones
-- Total Cores
257+ Packages Built

Live Swarm Status

๐ŸŒ

Gateway

Checking...

API endpoint & job dispatch

๐Ÿš€

Orchestrators

Checking...

Queue management & failover

๐Ÿค–

Build Drones

Checking...

Parallel compilation workers

๐Ÿ”จ

Currently Building

Checking...

What is the Build Swarm?

The Argo OS Build Swarm is a distributed compilation system that transforms how Argo OS packages are built. Instead of compiling everything on a single machine (which can take hours or days), the swarm distributes builds across multiple worker nodes simultaneously.

This project was born from the practical need to maintain multiple Gentoo systems without spending endless hours waiting for compilations. By centralizing builds and distributing binary packages, systems can be updated in minutes instead of hours.

Gateway
โ†“
Orchestrator
โ†“
Drone
Drone
Drone
โ†“
Binary Package Host

Key Features

โšก

Parallel Compilation

Distribute builds across 5+ worker nodes with 60+ CPU cores for massive parallelization.

๐Ÿ”„

Automatic Failover

Primary/standby orchestrator architecture ensures builds continue even if a node fails.

๐Ÿ“ฆ

Binary Packages

Compiled packages are stored on a binhost for instant deployment to client systems.

๐Ÿงน

Sweeper Drones

Specialized workers handle long-running builds (LLVM, Rust, Firefox) without blocking the queue.

๐ŸŒ

Cross-Network

Works across multiple sites via Tailscale mesh VPN for geographically distributed builds.

๐Ÿ“Š

Real-time Monitoring

Live dashboards show build progress, drone status, and queue depth.

Technology Stack

Python Core orchestration logic
Docker Containerized drone workers
Gentoo Portage Package management & ebuilds
REST API Gateway & orchestrator communication
Tailscale Secure mesh networking
OpenRC Service management (no systemd)

Related Pages