Add IT-One AI agent template, eval gate, and deployment skeleton
Deploy / validate-image (push) Successful in 45s
Eval Gate / evaluate (push) Failing after 1m42s

This commit is contained in:
2026-08-21 12:14:55 +02:00
parent d1a12d7880
commit d406da1312
25 changed files with 243 additions and 2 deletions
+27 -2
View File
@@ -1,3 +1,28 @@
# agent-template
# IT-One AI Agent Template
Canonical public template for autonomous AI agents, prompts, tools, memory, evaluations, deployment, and CI/CD.
A public, reusable starting point for autonomous agents and multi-agent systems. Generate a repository from this template, then rename it using the conventions below.
## Naming
- `agent-<name>` — autonomous agent.
- `swarm-<name>` or `orch-<name>` — orchestrator or multi-agent system.
- `eval-<agent-name>-benchmark` — dataset or quality benchmark.
## Layout
Prompts are versioned separately from implementation. `src/tools` contains integrations, `src/memory` contains retrieval/state adapters, `src/core` contains the agent graph, and `evals` contains deterministic quality checks.
## Quality gate
Every pull request runs `.gitea/workflows/eval-quality.yml`. The evaluator must keep Accuracy and Tool Calling Success at or above **95%**. A failing evaluator blocks the protected `main` branch. The sample evaluator is offline-safe; replace its cases and assertions for a real agent.
## Secrets
Never commit provider or database credentials. Configure organization-level Actions secrets in Gitea and reference them as `${{ secrets.OPENAI_API_KEY }}`, `${{ secrets.TAVILY_API_KEY }}`, `${{ secrets.VECTOR_DB_URL }}`, and `${{ secrets.REGISTRY_TOKEN }}` only when a project actually needs them.
## Local development
```bash
python -m evals.run_evals --threshold 0.95
python -m src.main
```