Commit Graph
19 Commits
Author SHA1 Message Date
Mac Lee 9bba72edab [ci]: tolerate legacy performance result artifacts (#1531) 2026-07-05 16:06:41 -07:00
Mac Lee 95a775b14a [docs]: clarify scheduled-main performance uploads (#1531) 2026-07-05 16:03:38 -07:00
Mac Lee bc51cd6d37 [ci]: fix v2 dashboard cohort handling (#1531) 2026-07-05 16:02:56 -07:00
Mac Lee f43bcdefae [ci]: emit v2 performance result schema (#1531) 2026-07-05 15:59:43 -07:00
SolitaryThinker 2e0dba1a4f [ci]: adopt per-parallelism-config baseline cohorts for wan-t2v (author decision)
Flip the wan benchmark identity from workload wan-t2v-1.3b / variant
canonical / benchmark_version 1 to workload wan-t2v / variant 1.3b-sp2 /
benchmark_version 2, adopting the contributor's per-parallelism-config
cohort labels and matching the #1551 fixtures. This deliberately opens a
new comparison cohort; the baseline reseed follows post-merge.
config_schema_version stays 2 as required by the #1544 validator.
2026-07-05 14:39:57 -07:00
SolitaryThinker dc8a661696 [bugfix]: address verify-pass findings on the 1546 fix branch
- recipe_fingerprint also excludes attention.resolved_backend (a silent
  runtime fallback must fail the gate in its cohort, not open a fresh
  ungated one); requested_backend stays in the hash; regression test
  extended to both runtime-resolved values.
- Legacy v1 configs no longer crash after the GPU measurement: identity
  fields are emitted only for config_schema_version=2 configs, and the
  comparator falls back to the legacy (model_id, gpu_type) cohort when a
  record carries no identity fields (partial identity still raises).
- 'recipe' removed from V2_OPTIONAL_METADATA_FIELDS: the generated recipe
  owns the key now; declaring it in a config fails validation loudly
  instead of being silently overwritten.
- Docs: stale 'until those land' paragraph reconciled with what this
  branch actually lands; baseline_status documented.
2026-07-05 14:39:57 -07:00
SolitaryThinker e03864a852 [docs]: align example records with the merged identity taxonomy 2026-07-05 14:39:57 -07:00
Mac Lee 53ce043b32 [ci]: align remaining performance cohort consumers 2026-07-05 14:39:57 -07:00
Mac Lee 7b74b94ad4 [ci]: complete performance cohort identity 2026-07-05 14:39:57 -07:00
Mac Lee 752248e466 [ci]: tighten performance cohort identity 2026-07-05 14:39:57 -07:00
Mac Lee cc7848ab46 [ci]: add performance fingerprint cohorts 2026-07-05 14:39:57 -07:00
Mac Lee 30b523edd6 [ci] Normalize performance stage component metrics (#1475) (#1550) 2026-07-05 14:05:26 -07:00
Mac Lee 9cd53fe5f8 [ci] Add metric-specific performance thresholds (#1545) 2026-07-05 12:04:33 -07:00
Mac Lee c53e85b767 [ci] Add v2 performance benchmark config identity fields (#1544) 2026-07-05 06:18:15 -07:00
Satyam Srivastava 8658f774f3 [docs] Restructure contributing CI/CD and testing docs (#1501) 2026-06-27 11:46:18 -07:00
Satyam Srivastava 3d8cc4f0a0 [bugfix] Fix performance component timing extraction (#1473) 2026-06-22 13:05:35 -07:00
Satyam Srivastava 0557f7a7d9 [ci] Add performance dashboard metadata and visualizations (#1470) 2026-06-19 14:27:01 -07:00
Satyam Srivastava b80148819c [ci] Add performance dashboard visualisation scripts (#1469) 2026-06-16 23:29:29 -07:00
Satyam SrivastavaandSolitaryThinker 2dd5760291 [docs] Document performance benchmark workflow (#1376)
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
2026-05-21 20:25:58 -07:00