TASK: Replace integration lane with post-build backend runtime black-box tests #72

Merged

darkhelm merged 23 commits from feature/issue-61-runtime-blackbox-integration into main 2026-07-05 22:49:09 -04:00

Conversation 0 Commits 23 Files Changed 11 +1079 -77

darkhelm commented 2026-07-02 08:48:54 -04:00

Owner

Copy Link

Summary

Replace the existing source-context integration lane with backend runtime black-box integration checks that run against started deployable containers.

This change wires deployable backend image references (both commit tag and immutable digest) from the build workflow into the tests workflow, then validates runtime behavior over network endpoints.

Why

Integration confidence should come from testing running service artifacts, not only source-mounted or in-process execution.

What Changed

• Build workflow now:

  • Publishes deployable backend image tag reference and digest reference
  • Exposes both as job outputs
  • Passes both references into CICD Tests dispatch inputs

• CICD Tests workflow now:

  • Accepts deployable backend tag and digest inputs
  • Propagates these through setup outputs
  • Replaces previous integration lane behavior with runtime black-box execution:
    • Starts isolated Docker network
    • Starts Postgres container
    • Starts backend container from digest-pinned deployable image
    • Enforces tag-to-digest consistency before running checks
    • Runs endpoint checks against live container:
      • GET /
      • GET /compatibility
      • GET /health
    • Captures backend/db logs and container state on failure
    • Cleans up containers and network via trap

• Documentation updated:

  • Runtime contract enforcement section now includes runtime black-box integration checks
  • CI success summary now reflects runtime integration lane behavior

Scope

Included:

• Backend runtime black-box integration replacement for the existing integration lane
• Digest + tag identity enforcement
• Failure diagnostics for triage

Out of scope:

• Frontend runtime smoke checks
• E2E lane redesign

Acceptance Criteria Mapping

• Integration tests execute against runtime container endpoints: ✅
• Integration lane consumes built image references (not source-mounted execution): ✅
• Failures surface service logs and test logs for triage: ✅

Verification

• Workflow files pass local validation checks
• Pre-commit hooks pass on committed changes
• Branch pushed and ready for PR review

Related

• Issue: TASK: Add post-build black-box integration tests against runtime containers (#61)
• Dependency context: #66

## Summary Replace the existing source-context integration lane with backend runtime black-box integration checks that run against started deployable containers. This change wires deployable backend image references (both commit tag and immutable digest) from the build workflow into the tests workflow, then validates runtime behavior over network endpoints. ## Why Integration confidence should come from testing running service artifacts, not only source-mounted or in-process execution. ## What Changed - Build workflow now: - Publishes deployable backend image tag reference and digest reference - Exposes both as job outputs - Passes both references into CICD Tests dispatch inputs - CICD Tests workflow now: - Accepts deployable backend tag and digest inputs - Propagates these through setup outputs - Replaces previous integration lane behavior with runtime black-box execution: - Starts isolated Docker network - Starts Postgres container - Starts backend container from digest-pinned deployable image - Enforces tag-to-digest consistency before running checks - Runs endpoint checks against live container: - GET / - GET /compatibility - GET /health - Captures backend/db logs and container state on failure - Cleans up containers and network via trap - Documentation updated: - Runtime contract enforcement section now includes runtime black-box integration checks - CI success summary now reflects runtime integration lane behavior ## Scope Included: - Backend runtime black-box integration replacement for the existing integration lane - Digest + tag identity enforcement - Failure diagnostics for triage Out of scope: - Frontend runtime smoke checks - E2E lane redesign ## Acceptance Criteria Mapping - Integration tests execute against runtime container endpoints: ✅ - Integration lane consumes built image references (not source-mounted execution): ✅ - Failures surface service logs and test logs for triage: ✅ ## Verification - Workflow files pass local validation checks - Pre-commit hooks pass on committed changes - Branch pushed and ready for PR review ## Related - Issue: #61 - Dependency context: #66

darkhelm added 1 commit 2026-07-02 08:49:01 -04:00

feat(ci): replace integration lane with runtime black-box tests c996d92406

darkhelm added 1 commit 2026-07-02 09:47:59 -04:00

fix(ci): lock backend deps in cicd build and harden renovate auth 1295ffb330

darkhelm added 1 commit 2026-07-02 10:29:18 -04:00

fix(renovate): normalize gitea endpoint and align auth preflight b1607ff6c7

darkhelm added 1 commit 2026-07-02 11:10:21 -04:00

fix(ci): harden runtime integration env and renovate auth checks 3a47f3f154

darkhelm added 1 commit 2026-07-03 21:59:06 -04:00

fix(ci): correct backend ASGI path for runtime black-box lane 6da60e6beb

darkhelm added 1 commit 2026-07-04 09:15:56 -04:00

fix(backend): set uvicorn app-dir for src layout runtime 98058475cb

darkhelm added 1 commit 2026-07-04 10:58:03 -04:00

fix(ci): reduce yarn install memory in source checks 818c3d43db

darkhelm added 1 commit 2026-07-04 11:27:11 -04:00

fix(ci): use env-based yarn concurrency tuning 07f048f57a

darkhelm added 1 commit 2026-07-04 15:43:06 -04:00

fix(ci): split source checks by toolchain 32d5e7d4e7

darkhelm added 1 commit 2026-07-04 23:06:57 -04:00

fix(ci): correct split source-check commands 38741c580c

darkhelm added 1 commit 2026-07-05 09:54:11 -04:00

fix(ci): add npm fallback for frontend install OOM ad919e6c11

darkhelm added 1 commit 2026-07-05 10:59:45 -04:00

style(frontend): apply prettier to index.html 6611c20bbf

darkhelm added 1 commit 2026-07-05 11:40:49 -04:00

feat(runners): cap runner memory by host fraction 6e2b2f5e3a

darkhelm added 1 commit 2026-07-05 11:42:18 -04:00

fix(runners): scale mem cap from current runner limit 8f07c3ff86

darkhelm added 1 commit 2026-07-05 12:31:11 -04:00

fix(runners): update deploy memory without mem_limit conflict 0a29464d42

darkhelm added 1 commit 2026-07-05 12:38:37 -04:00

feat(runners): set job container memory below runner 9ae4d6eafb

darkhelm added 1 commit 2026-07-05 13:24:11 -04:00

fix(runners): size limits from host memory share 2eb94d18f3

darkhelm added 1 commit 2026-07-05 13:42:06 -04:00

feat(runners): add host-share CPU limits 92549b8edd

darkhelm added 1 commit 2026-07-05 13:51:20 -04:00

feat(runners): add configurable stability resource limits f98b4d6857

darkhelm added 1 commit 2026-07-05 13:56:21 -04:00

fix(runners): correct deploy limits memory variable eb440bc10f

darkhelm added 1 commit 2026-07-05 14:19:52 -04:00

fix(runners): avoid pids_limit and deploy pids conflict f2b79792e2

darkhelm added 1 commit 2026-07-05 15:51:33 -04:00

fix(runners): canonicalize deploy limits block generation ac0bd9d9d8

darkhelm added 1 commit 2026-07-05 21:50:32 -04:00

fix(ci): probe runtime backend from inside container 3deeee0dcb

darkhelm merged commit 1f6cafa1bc into main 2026-07-05 22:49:09 -04:00

darkhelm referenced this issue from a commit 2026-07-05 22:49:14 -04:00

TASK: Replace integration lane with post-build backend runtime black-box tests (#72)

darkhelm deleted branch feature/issue-61-runtime-blackbox-integration 2026-07-05 22:49:15 -04:00

Sign in to join this conversation.

Reviewers

No Reviewers

Labels

Clear labels

afk

Autonomous-friendly issue

algorithm

Selection logic

api

API contract

backend

Backend related

database

Database related

devex

Developer experience

docs

Documentation

epic

Top-level planning item

frontend

Frontend related

hitl

Requires human-in-the-loop decision

ingestion

Ingestion/sync

ops

Operations

performance

Performance

realtime

Realtime/eventing

release

Release readiness

security

Security

task

Implementation ticket

testing

Testing

ui

UI/UX

No Label

Milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

copilotcoder darkhelm renovate-bot repository-bot

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: DarkHelm.org/plex-playlist#72