OptionalacceptanceAggregate annotation criteria that gate the suite after all tests run. Each criterion fails the suite when its scores miss the configured bar (see AcceptanceCriterion).
OptionalclientOverride the Phoenix client used for syncing this suite.
Call a DELETE endpoint
Call a GET endpoint
Get the Phoenix server version, returning a cached value if available.
The version is first populated from the x-phoenix-server-version
response header on any API call. If no version has been seen yet,
this method fetches GET /arize_phoenix_version to populate the cache.
Call a HEAD endpoint
Call a OPTIONS endpoint
Call a PATCH endpoint
Call a POST endpoint
Call a PUT endpoint
Call a TRACE endpoint
Unregister middleware
Register middleware
OptionaldatasetOverride the dataset / experiment name used for the suite.
OptionaldescriptionDescription for the dataset and experiment.
OptionaldryWhen true, the whole suite runs as ordinary local tests — no dataset
is uploaded and no experiment, runs, or annotations are created in
Phoenix. Equivalent to PHOENIX_TEST_TRACKING=false scoped to this
suite. The reporter still prints a local summary.
OptionalmetadataSuite-level metadata applied to every run in this experiment.
OptionalrepetitionsNumber of times to run each test case in this suite. Individual tests
may override this via TestParams.repetitions. Defaults to the
PHOENIX_TEST_REPETITIONS env var, then 1.
Suite-level configuration accepted by
describe().