Files
plex-playlist/scripts/gitea-actions/diagnose_runner_startup.xsh
Cliff Hill d02039a22e
Some checks failed
CICD Start / Sanity and Base Decision (push) Successful in 18s
Runner Canary / Canary Heavy (ubuntu-act-8gb) (push) Has been skipped
Runner Canary / Canary Heavy (ubuntu-act-4gb) (push) Has been skipped
Runner Canary / Canary Burst (ubuntu-act (push) Failing after 11m10s
Runner Canary / Canary (ubuntu-latest) (push) Failing after 12m39s
Runner Canary / Canary (ubuntu-act) (push) Failing after 12m42s
Backend runtime upgraded to Python 3.14 with exact dependency pinning (#57)
Signed-off-by: Cliff Hill <xlorep@darkhelm.org>

## Summary

Upgrades backend runtime baseline and dependency management for issue #10.

### Changes

1. **Python Baseline**: Updated from 3.13 to 3.14
   - Updated `backend/pyproject.toml` requires-python constraint
   - Updated `backend/pyrightconfig.json` pythonVersion
   - Updated all Dockerfile and CI references

2. **Dependency Pinning**: Switched to exact version pins in `backend/pyproject.toml`
   - All dev and runtime dependencies now use `==` instead of `>=`
   - `fastapi==0.120.2`, `uvicorn==0.38.0`
   - ruff, pyright, pytest suite pinned to current resolved versions
   - Regenerated `backend/uv.lock` under Python 3.14

3. **Startup Compatibility Guard** (TDD via RED→GREEN)
   - New `compatibility_status()` function evaluates runtime and pinned deps
   - Startup raises `RuntimeError` if policy fails
   - Implemented via FastAPI lifespan (non-deprecated) handler

4. **Compatibility Status Endpoint**
   - New `GET /compatibility` returns policy status, runtime version, and package checks
   - Shares single source of truth with startup validation

5. **Integration Tests**
   - Added failing-then-passing tests for startup guard and endpoint behavior
   - 100% coverage maintained

6. **Direnv Configuration**
   - Added `UV_PYTHON="3.14"` pin to repo `.envrc`
   - Ensures direnv creates/recreates venv with correct Python version

### Validation

-  ruff format/check
-  pyright strict (0 errors)
-  pytest: 8 passed, 100% coverage (>=95 gate)
-  pydoclint: pass
-  xdoctest: pass

### Notes

- SQLAlchemy/SQLModel introduction deferred to next pass per scope
- Compatibility logic currently validates fastapi/uvicorn pins (runtime deps)
- Ready for container build validation and Renovate bot testing

Co-authored-by: copilotcoder <copilotcoder@darkhelm.org>
Reviewed-on: #57
Co-authored-by: Cliff Hill <xlorep@darkhelm.org>
Co-committed-by: Cliff Hill <xlorep@darkhelm.org>
2026-06-18 11:19:24 -04:00

84 lines
2.9 KiB
Plaintext
Executable File

#!/usr/bin/env xonsh
import sys
hosts = {
'kankali.darkhelm.lan': '/home/darkhelm/Projects/DarkHelm.org/gitea',
'zhokq.darkhelm.lan': '/home/darkhelm/Projects/DarkHelm.org/gitea-runner',
'urtzul.darkhelm.lan': '/home/darkhelm/Projects/DarkHelm.org/gitea-runner',
'pi-desktop.darkhelm.lan': '/home/darkhelm/Projects/DarkHelm.org/gitea-runner',
}
mirror_image = 'kankali.darkhelm.lan:3001/darkhelm.org/act-ubuntu:act-latest'
do_fix = '--fix' in sys.argv[1:]
remote_diag = f"""
print('pwd=' + $(pwd).strip())
print('[runner_containers]')
r = !(docker ps -a --filter name=gitea-act-runner --format '{{{{.Names}}}} {{{{.Status}}}}')
print(str(r.out).strip())
print('[registry_config]')
r = !(docker info 2> /dev/null | grep -qi 'kankali.darkhelm.lan:3001')
print('REGISTRY_CONFIG:ok' if r.returncode == 0 else 'REGISTRY_CONFIG:missing')
print('[image_state]')
r = !(docker image inspect {mirror_image} > /dev/null 2> /dev/null)
print('MIRROR_LOCAL:present' if r.returncode == 0 else 'MIRROR_LOCAL:missing')
r = !(docker pull {mirror_image} > /tmp/runner-mirror-pull.log 2>&1)
if r.returncode == 0:
print('MIRROR_REMOTE:pull-ok')
else:
mismatch = !(grep -qi 'http response to https client' /tmp/runner-mirror-pull.log)
print('MIRROR_REMOTE:https-mismatch' if mismatch.returncode == 0 else 'MIRROR_REMOTE:pull-failed')
tail_out = !(tail -n 20 /tmp/runner-mirror-pull.log)
print(str(tail_out.out).strip())
print('[recent_logs_runner1]')
log1 = !(docker logs --tail 60 gitea-act-runner-1 2>&1)
log1_lines = [
line for line in str(log1.out).splitlines()
if any(tok in line.lower() for tok in ['error', 'failed', 'timeout', 'panic', 'unregister', 'forbidden', 'unauthorized', 'connection refused', 'context deadline'])
]
print('\\n'.join(log1_lines[-60:]))
print('[recent_logs_runner2]')
log2 = !(docker logs --tail 60 gitea-act-runner-2 2>&1)
log2_lines = [
line for line in str(log2.out).splitlines()
if any(tok in line.lower() for tok in ['error', 'failed', 'timeout', 'panic', 'unregister', 'forbidden', 'unauthorized', 'connection refused', 'context deadline'])
]
print('\\n'.join(log2_lines[-60:]))
"""
remote_fix = """
print('[fix] restarting runners')
$(docker compose up -d --force-recreate runner1 runner2)
$(sleep 3)
r = !(docker ps --filter name=gitea-act-runner --format '{{{{.Names}}}} {{{{.Status}}}}')
print(str(r.out).strip())
"""
for host, path in hosts.items():
print(f"\n===== {host} =====")
cmd = f"cd {path}\n{remote_diag}"
r = !(ssh @(host) @(cmd))
if r.returncode != 0:
print('DIAG_FAILED')
print(str(r.out).strip())
continue
print(str(r.out).strip())
if do_fix:
print('[fix] applying restart')
fix_cmd = f"cd {path}\n{remote_fix}"
f = !(ssh @(host) @(fix_cmd))
if f.returncode != 0:
print('FIX_FAILED')
print(str(f.out).strip())
else:
print(str(f.out).strip())