diff --git a/.agents/STATUS.md b/.agents/STATUS.md deleted file mode 100644 index 1583abba5..000000000 --- a/.agents/STATUS.md +++ /dev/null @@ -1,94 +0,0 @@ -# Agent Infrastructure — Status Dashboard - -Developer-maintained overview of all agent components and their maturity. -Use this to understand what exists, how complete it is, and how much to trust it. - -_Last synced: 2026-03-02_ - -> To resync this dashboard, use the workflow: `.agents/workflows/sync-dashboard.md` - ---- - -## Summary - -| Category | Total | ✅ Ready | 🟡 Draft | 🔴 Stub | Trust | -|----------|-------|---------|---------|---------|-------| -| Skills | 8 | 0 | 8 | 0 | Low — newly created, untested | -| Workflows (SOPs) | 4 | 0 | 4 | 0 | Low — newly created, untested | -| Memory files | 4 | 1 | 3 | 0 | Medium — codebase_map is solid | -| Lessons | 0 | — | — | — | N/A — empty | -| Exploration logs | 0 | — | — | — | N/A — empty | - ---- - -## Skills (`.agents/skills/`) - -| Skill | File | Status | Trust | Tested | Notes | -|-------|------|--------|-------|--------|-------| -| Launch Experiment | `launch-experiment.md` | 🟡 Draft | Low | ❌ | Needs dry-run validation | -| Monitor Experiment | `monitor-experiment.md` | 🟡 Draft | Low | ❌ | Requires W&B API access to test | -| Summarize Run | `summarize-run.md` | 🟡 Draft | Low | ❌ | Pattern from existing test infra | -| Log Experiment | `log-experiment.md` | 🟡 Draft | Low | ❌ | Journal formatting only | -| Evaluate Video Quality | `evaluate-video-quality.md` | 🟡 Draft | Low | ❌ | SSIM section most mature | -| Index Related Work | `index-related-work.md` | 🟡 Draft | Low | ❌ | Schema defined, no entries yet | -| Search Related Work | `search-related-work.md` | 🟡 Draft | Low | ❌ | Depends on indexed entries | -| Skill Template | `SKILL_TEMPLATE.md` | ✅ Ready | High | ✅ | Meta-template, stable | - -### Trust Level Definitions -- **High**: Tested in production, validated against real experiments -- **Medium**: Logic is sound, partially tested or based on existing patterns -- **Low**: Newly written, not yet validated -- **None**: Placeholder only - ---- - -## Workflows / SOPs (`.agents/workflows/`) - -| Workflow | File | Status | Trust | Tested | Notes | -|----------|------|--------|-------|--------|-------| -| Experiment Lifecycle | `experiment-lifecycle.md` | 🟡 Draft | Low | ❌ | End-to-end flow, untested | -| Evaluation Development | `evaluation-development.md` | 🟡 Draft | Low | ❌ | Metric dev process | -| Experiment Journaling | `experiment-journaling.md` | 🟡 Draft | Low | ❌ | Journaling cadence | -| Lesson Capture | `lesson-capture.md` | 🟡 Draft | Low | ❌ | Post-experiment reflection | -| Sync Dashboard | `sync-dashboard.md` | 🟡 Draft | Low | ❌ | This dashboard's updater | - ---- - -## Memory (`.agents/memory/`) - -| File | Status | Trust | Notes | -|------|--------|-------|-------| -| `codebase_map.md` | ✅ Ready | High | Synthesized from full repo research | -| `experiment_journal.md` | 🟡 Draft | Medium | Schema defined, no entries yet | -| `evaluation_registry.md` | 🟡 Draft | Medium | SSIM/loss metrics documented | -| `related_work/README.md` | 🟡 Draft | Medium | Schema defined, no entries yet | - ---- - -## Lessons (`.agents/lessons/`) - -| File | Category | Severity | Notes | -|------|----------|----------|-------| - -_No lessons captured yet._ - ---- - -## Exploration Logs (`.agents/exploration/`) - -| File | Status | Topic | Notes | -|------|--------|-------|-------| - -_No exploration logs yet._ - ---- - -## What to Do Next - -1. **Validate skills**: Run a minimal training experiment using the - `experiment-lifecycle` SOP to test `launch-experiment` → `monitor-experiment` - → `summarize-run` end-to-end. -2. **Index first related work**: Use `index-related-work` to add at least one - paper (e.g., the Self-Forcing paper used in the codebase). -3. **Capture first lesson**: After the validation run, capture any findings. -4. **Promote to Ready**: As each skill/SOP is tested, update its status here. diff --git a/.agents/skills/index-related-work/SKILL.md b/.agents/skills/index-related-work/SKILL.md deleted file mode 100644 index f7af5361d..000000000 --- a/.agents/skills/index-related-work/SKILL.md +++ /dev/null @@ -1,94 +0,0 @@ ---- -name: index-related-work -description: Ingest a paper or repository into the related work index ---- - -# Index Related Work - -## Purpose -Create a structured summary of a related paper, repository, or blog post and -add it to `.agents/memory/related-work/` for future reference. This builds the -agent's knowledge base for making informed decisions about training, evaluation, -and architecture choices. - -## Prerequisites -- Access to the paper/repo (URL, PDF, or local clone). - -## Inputs - -| Parameter | Required | Description | -|-----------|----------|-------------| -| `source` | Yes | URL, citation, or local path | -| `type` | Yes | `paper`, `repo`, or `blog` | -| `tags` | No | List of tags (default: inferred from content) | - -## Steps - -### 1. Extract key information - -For **papers**: Read abstract, method section, experimental setup, and results. -For **repos**: Read README, key source files, and training scripts. -For **blogs**: Read the full post. - -Focus on: -- What problem does it solve? -- What architecture/technique is used? -- How does it relate to FastVideo's approach? - -### 2. Create the index entry - -Write to `.agents/memory/related-work/.md`: - -```markdown ---- -title: -source: <URL or citation> -type: paper | repo | blog -date_indexed: <ISO-8601> -tags: [world-model, distillation, evaluation, ...] ---- - -## Summary -<1-2 paragraph summary.> - -## Key Differences from FastVideo -- <comparison points> - -## Actionable Insights -- <what we could adopt or adapt> -``` - -### 3. Update the catalog - -If `.agents/memory/related-work/_catalog.md` exists, append the new entry. -If not, create it: - -```markdown -# Related Work Catalog - -| Slug | Title | Type | Tags | Date | -|------|-------|------|------|------| -| <slug> | <title> | <type> | <tags> | <date> | -``` - -## Outputs -- New file in `.agents/memory/related-work/<slug>.md`. -- Updated catalog. - -## Example Usage - -``` -Index the Self-Forcing paper: - - source: https://arxiv.org/abs/2406.xxxxx - type: paper - tags: [world-model, self-forcing, distillation] -``` - -## References -- `.agents/memory/related-work/README.md` — schema documentation - -## Changelog -| Date | Change | -|------|--------| -| 2026-03-02 | Initial version | diff --git a/.agents/skills/index.jsonl b/.agents/skills/index.jsonl index 1a36f836e..c1225a566 100644 --- a/.agents/skills/index.jsonl +++ b/.agents/skills/index.jsonl @@ -3,7 +3,5 @@ {"name": "summarize-run", "description": "Extract a W&B run summary into a structured experiment report", "path": "summarize-run/SKILL.md", "status": "draft", "trust": "low"} {"name": "log-experiment", "description": "Append or update an experiment entry in the experiment journal", "path": "log-experiment/SKILL.md", "status": "draft", "trust": "low"} {"name": "evaluate-video-quality", "description": "Evaluate generated video quality using available metrics (SSIM, loss trajectory, caption consistency)", "path": "evaluate-video-quality/SKILL.md", "status": "draft", "trust": "low"} -{"name": "index-related-work", "description": "Ingest a paper or repository into the related work index", "path": "index-related-work/SKILL.md", "status": "draft", "trust": "low"} -{"name": "search-related-work", "description": "Query the related work index for relevant papers, repos, or comparisons", "path": "search-related-work/SKILL.md", "status": "draft", "trust": "low"} {"name": "seed-ssim-references", "description": "Run a new or updated fastvideo/tests/ssim/ test on Modal, pull generated videos, and upload them to FastVideo/ssim-reference-videos so the test has a regression baseline", "path": "seed-ssim-references/SKILL.md", "status": "draft", "trust": "low"} {"name": "reseed-ssim-references", "description": "Re-seed (overwrite) HF reference videos for an existing fastvideo/tests/ssim/ test and a single model id on Modal L40S. Always backs up current refs first, regenerates on Modal, pauses for the user to eyeball before-vs-after, then uploads with --force scoped to --model-id. Sister skill to seed-ssim-references; use when intentional code change has invalidated existing refs", "path": "reseed-ssim-references/SKILL.md", "status": "draft", "trust": "low"} diff --git a/.agents/skills/search-related-work/SKILL.md b/.agents/skills/search-related-work/SKILL.md deleted file mode 100644 index 49ecaf9dc..000000000 --- a/.agents/skills/search-related-work/SKILL.md +++ /dev/null @@ -1,82 +0,0 @@ ---- -name: search-related-work -description: Query the related work index for relevant papers, repos, or comparisons ---- - -# Search Related Work - -## Purpose -Search through `.agents/memory/related-work/` to find indexed papers, repos, -or blog posts relevant to a query. Use this when you need to understand how -other work compares to FastVideo's approach, or when looking for techniques -to adopt. - -## Prerequisites -- The related work index has entries (`.agents/memory/related-work/*.md`). - -## Inputs - -| Parameter | Required | Description | -|-----------|----------|-------------| -| `query` | Yes | Natural language query | -| `tags` | No | Filter by tags (e.g., `[distillation, evaluation]`) | -| `type` | No | Filter by type (`paper`, `repo`, `blog`) | - -## Steps - -### 1. Search the index - -Use grep-based search through `.agents/memory/related-work/`: - -```bash -# Search by content -grep -rl "<query>" .agents/memory/related-work/ - -# Search by tags (in frontmatter) -grep -l "tags:.*<tag>" .agents/memory/related-work/*.md -``` - -### 2. Rank results - -For each matching file: -1. Read the file. -2. Score relevance to the query based on: - - Title match - - Tag match - - Content match (summary, differences, insights) -3. Return top results. - -### 3. Format output - -```markdown -## Related Work Search: "<query>" - -### 1. <Title> (relevance: high) -- **Source**: <URL> -- **Tags**: <tags> -- **Key insight**: <most relevant excerpt> -- **File**: `.agents/memory/related-work/<slug>.md` - -### 2. <Title> (relevance: medium) -... -``` - -## Outputs -- Ranked list of relevant related work entries with excerpts. - -## Example Usage - -``` -Search for work related to video quality evaluation metrics: - - query: "video generation quality evaluation metrics" - tags: [evaluation] -``` - -## References -- `.agents/memory/related-work/README.md` — index schema - -## Changelog -| Date | Change | -|------|--------| -| 2026-03-02 | Initial version | diff --git a/.agents/workflows/sync-dashboard.md b/.agents/workflows/sync-dashboard.md deleted file mode 100644 index 4ec13a254..000000000 --- a/.agents/workflows/sync-dashboard.md +++ /dev/null @@ -1,67 +0,0 @@ ---- -description: Synchronize the STATUS.md dashboard by scanning .agents/ directories ---- - -# Sync Dashboard - -Updates `.agents/STATUS.md` by scanning the skills, workflows, memory, lessons, -and exploration directories to reflect what actually exists on disk. - -## When to Use - -- After adding, removing, or renaming any file in `.agents/`. -- Periodically (e.g., at end of each conversation session). -- When the dashboard feels out of date. - -## Steps - -### 1. Scan directories - -List all files in each directory: - -```bash -echo "=== Skills ===" -ls -1 .agents/skills/*.md 2>/dev/null | grep -v SKILL_TEMPLATE - -echo "=== Workflows ===" -ls -1 .agents/workflows/*.md 2>/dev/null - -echo "=== Memory ===" -ls -1 .agents/memory/*.md 2>/dev/null -ls -1 .agents/memory/related-work/*.md 2>/dev/null | grep -v README - -echo "=== Lessons ===" -ls -1 .agents/lessons/*.md 2>/dev/null | grep -v README - -echo "=== Exploration ===" -ls -1 .agents/exploration/*.md 2>/dev/null | grep -v README -``` - -### 2. Compare with STATUS.md - -For each file found: -- If it's in STATUS.md → leave it (preserve status/trust/tested fields). -- If it's NOT in STATUS.md → add it with status `🔴 Stub`, trust `None`, tested `❌`. - -For each entry in STATUS.md: -- If the file no longer exists → mark it as `❌ Removed` or delete the row. - -### 3. Update counts - -Recalculate the summary table at the top: -- Count files per category. -- Count by status (Ready, Draft, Stub). - -### 4. Update timestamp - -Set `_Last synced: <current date>_` at the top of STATUS.md. - -### 5. Review - -Read through the updated STATUS.md for accuracy. Flag anything that looks wrong. - -## Notes - -- Do NOT change trust levels during sync — those are set manually after testing. -- Do NOT change status during sync — status changes require actual validation. -- This workflow only handles structural sync (file existence), not content review.