tenseleyflow/bencch / af1b2ba

Browse files

Document capability policies

Authored by espadonne
SHA
af1b2ba142d675398c5cebf1b18f0bb3da0d5dfe
Parents
cd9eeae
Tree
6c619fe

2 changed files

StatusFile+-
M README.md 24 0
A suites/v2/capability_policy.afs 13 0
README.mdmodified
@@ -114,6 +114,10 @@ cargo run -p afs-tests --bin bencch -- doctor
114114
 `doctor` now also lists the generic artifacts and namespaced adapter extras
115115
 that each named compiler surface can provide in the current build.
116116
 
117
+The built-in named compiler set now includes `armfortas`, `gfortran`,
118
+`flang-new`, `lfortran`, `ifort`, `ifx`, and `nvfortran` / `pgfortran`, plus
119
+any explicit compiler path you pass to `compare` or `introspect`.
120
+
117121
 Write the same `doctor` snapshot to JSON and Markdown:
118122
 
119123
 ```bash
@@ -418,6 +422,25 @@ expect compare.difference_count equals 2
418422
 end
419423
 ```
420424
 
425
+If a suite-v2 case is intentionally blocked by adapter capability limits, you
426
+can say so directly:
427
+
428
+```text
429
+suite "v2/capability-policy"
430
+
431
+case "gfortran_armfortas_ir_future"
432
+source "../../fixtures/runtime/if_else.f90"
433
+compiler gfortran => armfortas.ir
434
+future capability "generic gfortran surface has no armfortas extras"
435
+end
436
+
437
+case "mixed_surface_ir_compare_xfail"
438
+source "../../fixtures/runtime/if_else.f90"
439
+compare armfortas gfortran => armfortas.ir
440
+xfail capability "mixed-surface namespaced compare stays soft for now"
441
+end
442
+```
443
+
421444
 Namespaced armfortas artifacts can be matrixed too:
422445
 
423446
 ```text
@@ -462,6 +485,7 @@ Common things the runner understands:
462485
 - `expect-fail comments` uses inline `! ERROR_EXPECTED:` source comments
463486
 - `xfail comments` uses the first inline `! XFAIL:` source comment
464487
 - generic compare cases like `compare gfortran flang-new => asm`, including opt matrices
488
+- capability-aware authored softening with `future capability "..."` and `xfail capability "..."`
465489
 - suite-v2 graph cases with `entry` plus ordered `file` lines
466490
 - opt matrices like `opts => O0, O1, O2`
467491
 - references like `differential => gfortran, flang-new`
suites/v2/capability_policy.afsadded
@@ -0,0 +1,13 @@
1
+suite "v2/capability-policy"
2
+
3
+case "gfortran_armfortas_ir_future"
4
+source "../../fixtures/runtime/if_else.f90"
5
+compiler gfortran => armfortas.ir
6
+future capability "generic gfortran surface has no armfortas extras"
7
+end
8
+
9
+case "mixed_surface_ir_compare_xfail"
10
+source "../../fixtures/runtime/if_else.f90"
11
+compare armfortas gfortran => armfortas.ir
12
+xfail capability "mixed-surface namespaced compare stays soft for now"
13
+end