## Summary This PR simplifies the CICD workflow by merging related lanes, reducing duplicated script logic, and keeping the same overall pipeline behavior and gates. It also updates CI documentation to match the new job topology. ## What Changed ### Workflow consolidation - Merged base and complete CICD image publication into one producer job: - Build and Push CICD Images - Merged dependency audits into one informational lane: - Dependency Audits (Informational) - Merged runtime image build lanes into one release producer: - Build Release Images - Merged tester image build lanes into one tester producer: - Build Tester Images ### Dependency/gate rewiring - Updated downstream needs to consume merged producers. - Kept output contracts for deployable and tester image references. - Updated production and postmortem gates to the new job IDs. ### Cleanup/simplification - Removed duplicate helper-function definition(s) in CICD scripts. - Replaced a manual docker login retry loop with existing retry helper usage. - Removed redundant shell option declarations where behavior was unchanged. - Removed one unused E2E environment variable. ### Documentation alignment - Updated CI architecture documentation to reflect merged workflow lanes. - Updated troubleshooting guidance to reference current job sequencing. ## Why - Reduce job startup overhead on self-hosted runners. - Keep behavior consistent while lowering workflow complexity. - Improve maintainability by removing duplicated/unused script fragments. - Keep docs in sync with operational workflow reality. ## Validation - Workflow file checks passed with pre-commit. - Documentation checks passed with pre-commit (including markdownlint/prettier). - No diagnostics/errors reported for updated workflow/docs files. ## Risk and Impact - Low-to-medium operational risk due to job-ID/needs rewiring. - Mitigated by preserving output keys consumed by integration and e2e lanes. - Audit lane remains informational-only (non-blocking), same intent as before. Co-authored-by: copilotcoder <copilotcoder@darkhelm.org> Reviewed-on: #86
9.3 KiB
Renovate Bot Setup Guide
Overview
Renovate is an automated dependency update tool that creates pull requests to keep your project dependencies up to date. This guide covers setting up Renovate for the plex-playlist project with optimal configuration.
Repository Current Mode (2026-07)
This repository runs Renovate through .gitea/workflows/renovate.yml.
Current operational behavior:
- Uses
ubuntu-act-8gbrunner due to npm/registry memory pressure. - Prepares Renovate container image with mirror-first strategy:
- primary:
kankali.darkhelm.lan:3001/darkhelm.org/renovate:41 - fallback:
ghcr.io/renovatebot/renovate:41
- Uses digest-aware freshness checks before deciding whether local cached image is current.
- Selects endpoint dynamically between internal and external candidates based on preflight reachability.
- Selects token via preflight checks (repo access required) with fallback order from configured secrets.
- Uses constrained memory settings (
RENOVATE_NODE_ARGS) and disables OSV alerts in this runner profile.
Treat workflow behavior as source of truth; use this doc as operator guidance.
Setup Options
Option 1: GitHub App (Recommended for GitHub)
-
Install Renovate App:
- Go to Renovate GitHub App
- Click "Install" and select your repository
- Choose repository access (single repo or organization-wide)
-
Configure Repository Access:
- Select the
plex-playlistrepository - Grant necessary permissions (read/write to repository, pull requests, issues)
- Select the
-
Initial Configuration:
- Renovate will automatically detect the
renovate.jsonfile - Creates an onboarding PR to explain the configuration
- Review and merge the onboarding PR to activate
- Renovate will automatically detect the
Option 2: Self-Hosted (For Gitea/Custom Git Servers)
Since your project uses kankali.darkhelm.lan (Gitea), you'll need to run Renovate as a service:
Docker-based Self-Hosted Setup
- Create Renovate Configuration:
# Create renovate directory
mkdir -p ~/.config/renovate
-
Create Renovate Bot Token:
- For Organization Repositories: See detailed guide → Gitea Token Setup
- Required permissions:
repository(Read/Write),issue(Read/Write),organization(Read),user(Read) - Save token securely for next step
-
Create Environment Configuration:
# ~/.config/renovate/config.js
module.exports = {
platform: 'gitea',
endpoint: 'https://kankali.darkhelm.lan/api/v1',
token: process.env.RENOVATE_TOKEN,
gitAuthor: 'Renovate Bot <renovate@darkhelm.org>',
repositories: ['DarkHelm.org/plex-playlist'],
onboarding: false, // Skip onboarding PR
requireConfig: 'required' // Use existing renovate.json
};
- Run with Docker:
# Run Renovate Bot
docker run --rm \
-e RENOVATE_TOKEN="your_gitea_token_here" \
-v ~/.config/renovate/config.js:/usr/src/app/config.js \
renovate/renovate:latest
Scheduled Automation
Create a systemd timer or cron job to run Renovate periodically:
# /etc/cron.d/renovate-bot
# Run Renovate every Monday at 8 AM
0 8 * * 1 root docker run --rm -e RENOVATE_TOKEN="$RENOVATE_TOKEN" -v ~/.config/renovate/config.js:/usr/src/app/config.js renovate/renovate:latest
Option 3: CI/CD Integration
Add Renovate to your existing Gitea Actions workflow:
# .gitea/workflows/renovate.yml
name: Renovate
on:
schedule:
- cron: "0 8 * * 1" # Monday 8 AM
workflow_dispatch: # Manual trigger
jobs:
renovate:
runs-on: ubuntu-act-8gb
steps:
- name: Checkout
uses: actions/checkout@v4
- name: Run Renovate
uses: renovatebot/github-action@v40.3.2
with:
configurationFile: renovate.json
token: ${{ secrets.RENOVATE_TOKEN }}
env:
RENOVATE_PLATFORM: gitea
RENOVATE_ENDPOINT: selected at runtime from internal/external candidates
Configuration Explanation
Key Features of Our Configuration
-
Smart Scheduling:
- Regular updates: Weekday mornings before 9 AM
- Security updates: Any time
- Grouped updates: Monday mornings
-
Automerge Strategy:
- Auto: Minor/patch updates for trusted packages (types, linting tools)
- Manual: Major updates, Docker base images, security fixes
-
Grouping:
- Python dev tools: ruff, pytest, mypy, etc.
- Frontend dev tools: eslint, prettier, typescript, etc.
- Docker base images: ubuntu, python, node versions
-
Custom Managers:
- Detects Python/Node versions in Dockerfiles
- Updates base image versions automatically
Package Manager Support
Our configuration handles:
- Python (uv):
backend/pyproject.toml - Node.js (Yarn):
frontend/package.json+frontend/yarn.lock - Docker: All
Dockerfile.*files - GitHub Actions:
.gitea/workflows/*.yml(if using actions)
Testing the Configuration
1. Validate Configuration
# Install Renovate CLI for testing
npm install -g renovate
# Validate configuration
renovate-config-validator renovate.json
# Dry run (shows what would be updated)
renovate --dry-run --log-level=debug DarkHelm.org/plex-playlist
2. Expected Behavior
Once active, Renovate will:
- Scan Dependencies: Daily check for updates
- Create PRs: Individual PRs for each update group
- Auto-merge: Safe updates (minor/patch) merge automatically
- Security Alerts: Immediate PRs for vulnerability fixes
- Dependency Dashboard: Issue with update status overview
3. Integration with CI/CD
Renovate PRs will trigger your existing CI/CD pipeline:
- Build and test in Docker containers
- Run full quality gates (linting, type checking, tests)
- Only merge if all checks pass
Monitoring and Maintenance
Dashboard
Renovate creates a "Dependency Dashboard" issue showing:
- Pending updates
- Failed PRs
- Ignored dependencies
- Configuration errors
Logs and Debugging
For self-hosted setup:
# Run with debug logging
docker run --rm \
-e LOG_LEVEL=debug \
-e RENOVATE_TOKEN="your_token" \
-v ~/.config/renovate/config.js:/usr/src/app/config.js \
renovate/renovate:latest
Common Issues
-
Node.js Version Compatibility:
- Renovate 41+ requires Node.js 24.10.0+ or 22.13.0+
- Use
renovate@40.3.2for older Node.js versions - Our CI workflow automatically handles this
-
Token Permissions: Ensure Gitea token has repo write access
-
Rate Limiting: Adjust
prHourlyLimitif hitting API limits -
Large Updates: Major version updates may need manual review
-
Docker Registry: Ensure base image updates don't break builds
Current Workflow-Specific Failures
- Renovate image pull failures
- Symptom: both mirror and GHCR candidates fail.
- Check: runner DNS/egress and registry auth token validity.
- Endpoint preflight failures
- Symptom: cannot reach both internal and external API endpoints.
- Check: endpoint host mapping, TLS mode, and runner network route.
- Token access failures
- Symptom: API
/repos/<org>/<repo>check returns non-200. - Check: token scopes and secret ordering.
- OOM or abrupt termination
- Symptom: process exits under memory pressure.
- Check:
RENOVATE_NODE_ARGS, PR concurrency limits, and optional feature toggles.
Operator Notes
For this repository, prefer updating .gitea/workflows/renovate.yml over local one-off Renovate service changes. Keep docs and workflow in sync after changing:
- endpoint selection logic
- token preflight/fallback order
- image source policy (mirror/fallback)
- memory and concurrency guardrails
Quick Validation
For basic JSON validation without installing Renovate:
# Quick syntax check (no Renovate installation needed)
./scripts/quick-renovate-check.sh
# Full validation (requires Renovate installation)
./scripts/validate-renovate.sh
Security Considerations
- Token Security: Store Renovate token in secrets management
- Branch Protection: Ensure main branch requires PR reviews
- Automerge Limits: Only automerge trusted, low-risk updates
- Vulnerability Alerts: Enable immediate security update PRs
Advanced Configuration
Custom Rules Example
{
"packageRules": [
{
"description": "Pin exact versions for critical packages",
"matchPackageNames": ["fastapi", "@types/node"],
"rangeStrategy": "pin"
},
{
"description": "Ignore beta/alpha releases",
"matchPackagePatterns": [".*"],
"ignoreUnstable": true
}
]
}
Notification Integration
{
"notifications": [
{
"platform": "slack",
"endpoint": "https://hooks.slack.com/services/...",
"channels": ["#dev-notifications"]
}
]
}
Next Steps
- Choose Setup Method: GitHub App (if on GitHub) or self-hosted (for Gitea)
- Generate API Token: Create token with appropriate permissions
- Test Configuration: Run dry-run to verify setup
- Monitor First Updates: Review initial PRs to ensure proper operation
- Adjust Settings: Fine-tune automerge rules based on project needs
Related Documentation: