Commit Graph
86 Commits
Author SHA1 Message Date
Dean f52d0373ea Merge pull request #11486 from plexerPK/codex/test-selection-git-paths
fix(ci): preserve changed paths in test selection
2026-10-27 21:27:02 +13:00
Dean 808a557ac3 Merge pull request #11343 from MarcZX10/marc/ci-mingw-host-only-tests
ci(windows): link host-only tests on pull requests
2026-10-27 21:23:20 +13:00
Dean 8a062258e7 Merge pull request #10934 from ahmadmuj/fix/anyps5-relinker-gate-inputs
ci(build): run the relinker jobs for relinker-only build inputs outside core/relinker
2026-10-27 18:29:15 +13:00
plexerPK 46ac6233e9 fix(ci): preserve changed paths in test selection 2026-10-26 18:39:36 +01:00
MarcZX10 7bf29ea91b ci(windows): link host-only tests on pull requests 2026-10-26 07:57:14 +00:00
Brantley T. RobersonandClaude Opus 5.5 89fc74fa2b ci: skip the upstream-only jobs in forks
Forks inherit three jobs that cannot succeed there. Pages progress fails
on `gh api repos/<fork>/pages` (HTTP 404) after every push to main that
touches core/libs/prx, Pages fails at the release download or the
deployment, and the Build linux job waits for the self-hosted
`anyps5` runner, which forks don't have, until GitHub drops it. These
jobs now run only when the repository is not a fork.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-25 10:05:08 -04:00
Ahmad Mujahid eee902ac80 ci(build): run the relinker jobs for relinker-only build inputs outside core/relinker
The relinker eligibility list was written on 10-12 and missed inputs added to the relinker-only build since then: the nid sources that relinker_core and two relinker tests compile, the libkernel headers that ParamJsonParser.cpp includes, the pad command file test, the recompiler test targets and cache source tests, and the PR template and pr-overlap.yml that tools tests read. A pull request that changed only these got no automatic build, and a push to main skipped the macOS relinker hosts for them.

The recompiler is listed as a directory because shader_cache_runtime_sources copies all of core/shader/recompiler and hashes every file its CMakeLists globs, so an edit to any of them can change that test.

An edit to the relinker-asan job alone also skipped both relinker jobs, because only edits to the relinker job counted.
2026-10-25 14:58:21 +04:00
Dean Galvin 16996b5e64 revert: ci(windows): keep test temporary files on the runner's work disk (#10643)
This reverts commit da6c581a02, reversing changes made to 10a41a0d50.

On D:, the runner does not create 8.3 short names, so guest_named_shm_windows_short_temp and guest_named_shm_windows_long_short_temp skip and check_skips fails the Windows job.
2026-10-25 22:32:12 +13:00
Dean da6c581a02 Merge pull request #10643 from LeandroLP23/ci/windows-tests-temp-on-work-disk
ci(windows): keep test temporary files on the runner's work disk
2026-10-25 21:53:00 +13:00
LeandroLP23andClaude Opus 5.5 ae83030621 ci(windows): keep test temporary files on the runner's work disk
On windows-latest, TEMP is on C:, which writes 256 MiB in 1.9 s against
0.2 s on D:, where RUNNER_TEMP and the workspace live. The ctest step now
points TEMP and TMP at runner.temp. On a probe runner the optional byte-cap
capture test drops from a 6.4 s median to 1.3 s with four copies running,
and the git-heavy tool tests from 26-35 s to 24-26 s.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-24 16:15:57 +02:00
Dean Galvin 5cef36532c fix(tools): keep check_type_size results in configure_seed
CMake stores a check_type_size result as two cache entries: HAVE_<VAR>, documented as Result of TRY_COMPILE, and <VAR>, documented as CHECK_TYPE_SIZE. The exporter only recognized the first, so a seeded configure restored HAVE_<VAR>=TRUE, skipped the probe and had no size. Seed the size entry too, and hash tools/configure_seed.py into the seed cache key so a seed written by the old exporter is not restored.
2026-10-25 02:16:51 +13:00
LeandroLP23andClaude Opus 5.5 5b2955b9cf ci(build): let a running main build finish before the next push's build starts
Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-23 14:17:45 +02:00
Dean Galvin 7814a12b90 revert(ci): run Linux video output tests under Xvfb
This reverts the merge of #6932 (fce1fefe3b). Its "Install Xvfb" step fails on the self-hosted Linux runner, which has no xvfb-run and no passwordless sudo, so every Linux build stops before configuring.
2026-10-20 22:29:48 +13:00
MarcZX100 fe1d9eae67 ci: run Linux video output tests under Xvfb 2026-10-20 08:19:15 +00:00
Destroyers212x a37797625c ci(relinker): build and test the relinker for x86-64 on macOS under Rosetta 2026-10-17 23:31:02 +00:00
Dean e761af921e Merge pull request #7205 from wachi35676/fix/ci-context-jobs-build-dispatched-pr
ci(build): build the pull requests in the register context and write watch jobs
2026-10-18 09:58:51 +13:00
Dean 0268c1b3fb Merge pull request #7097 from inmert/ci/relinker-asan-tls
ci: run the relinker TLS coverage tests under AddressSanitizer
2026-10-18 09:42:41 +13:00
Adrià FranchandClaude 521babcd68 ci(build): run the relinker job's tests in parallel
The relinker job ran its 182 tests one at a time: 233 s on windows-latest, most of it Python tool tests. The full windows job already runs the same tests with --parallel 4.

Co-Authored-By: Claude <[email protected]>
2026-10-17 20:17:10 +02:00
Adrià FranchandClaude e572635506 ci(build): run test jobs only for the parts of build.yml a change touches
A change to build.yml ran the relinker, register-context and write-watch jobs whatever it touched. The patch's lines are now mapped to the job sections of the workflow at the head, and a test job runs only if its own section, the eligibility job or the shared part outside jobs changed; without a patch every job runs as before.

Co-Authored-By: Claude <[email protected]>
2026-10-17 20:08:51 +02:00
Adrià FranchandClaude 4cfb85482a ci(build): save the Windows ccache from merge queue builds
Queue builds are workflow_dispatch runs on main and never saved their ccache,
so each one restored the last push build's entry and recompiled everything the
queued PRs and the merges since then touched (32 min vs 6 min warm). They now
save under their own prefix, restore it first and fall back to the push
entries; push builds still restore only push entries, so main never starts
from a tree that held unmerged PRs.

Co-Authored-By: Claude <[email protected]>
2026-10-17 19:54:25 +02:00
Muhammad Wasif Ali WasifandClaude Opus 5.5 521a68ad9e ci(build): build the pull requests in the register context and write watch jobs
Both jobs checked out without a ref, so a dispatched build compiled and
tested main instead of the selected pull requests, although the gate
starts them because a pull request touched their files. They now check
out the gate's main commit and merge the pull requests with the same
step as the relinker, Linux and Windows jobs.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-17 21:25:39 +05:00
inmert 91fdcbdf1a ci: run the relinker TLS coverage tests under AddressSanitizer
The segment-prefix-at-eof case from #6401 only catches the 1-byte read
past the input when the relinker is built with AddressSanitizer, and no
CI job did that. The new job builds the relinker alone in Debug with
ANYPS5_ENABLE_ASAN and runs the tls_function_coverage tests. It has to
be Debug: at -O3 GCC no longer emits the stray load, so a Release ASan
build passes with the fix reverted.
2026-10-17 16:47:29 +05:30
Adrià FranchandClaude e5b31e0728 ci(windows): cache only the submodule git dirs
The cached tar held the 3rdparty work trees too, and its extraction fails on
the dangling symlink 3rdparty/zstd/tests/cli-tests/bin/unzstd, which Git Bash
tar can't create. Cache .git/modules alone and let git submodule update check
the work trees out from it, as a clean checkout does.

Co-Authored-By: Claude <[email protected]>
2026-10-16 21:31:16 +02:00
Adrià f474fb7768 Merge pull request #6900 from adriadam10/ci/select-tests
ci: build and run only the tests a change reaches on request
2026-10-16 21:06:09 +02:00
Adrià FranchandClaude 262de6ab19 ci: cache the submodules, FFmpeg and configure checks of the Windows job
Co-Authored-By: Claude <[email protected]>
2026-10-16 19:23:16 +02:00
Adrià FranchandClaude bca62ea696 ci: let a push to main cancel the build of the previous one
Push builds of main ran one after another, so a merge waited for the
builds of every earlier merge before main got a result for its tree; a
fix of a red main sat behind a build of the tree it fixes. The newest
push now cancels the build in progress, like pull request and dispatched
builds already do. The merge queue's baselines already skip cancelled
main builds and use the nearest completed ones.

Co-Authored-By: Claude <[email protected]>
2026-10-16 19:14:07 +02:00
Adrià FranchandClaude 13f6191b75 ci: build and run only the tests a change reaches on request
A new select input of the Build workflow limits the Linux and Windows jobs
to the test executables and tests whose build inputs the merged pull
requests change. Push builds of main always build and run everything and
save the test graph of their tree; dispatched runs with select restore the
latest graph and fall back to a full run without one.

tools/select_tests.py dump walks the ninja graph of every test executable
(order-only dependencies included, so prx libraries loaded at run time are
in it) plus the header dependencies of its objects, the CMake files that
register each test, the source files its command line names, and its
fixtures. select picks the tests whose closure, registration or arguments
contain a changed file, and every test that is not a native executable of
the tree; files no build reads select the tests under their directory;
changes to the root build, cmake/, 3rdparty/, the workflow or the tool run
everything. Tests added since the graph was written always run. ctest gets
the selection as -I indices through the tool, which keeps the cmd shell on
Windows and stays under its command line limit.

Co-Authored-By: Claude <[email protected]>
2026-10-16 19:10:16 +02:00
Adrià FranchandClaude 88687e19eb ci(linux): size build and tests to the host, cap cold compiles by memory
Co-Authored-By: Claude <[email protected]>
2026-10-16 17:52:29 +02:00
Adrià FranchandClaude b066940d4f ci(linux): link with wild
Co-Authored-By: Claude <[email protected]>
2026-10-16 16:44:10 +02:00
Adrià FranchandClaude 20c11e7334 Revert "ci(linux): link with wild" (#6861)
The runner cannot create directories under /var/cache/anyps5 (mkdir: Permission denied), so the install step failed
and the linux job built nothing.

Co-Authored-By: Claude <[email protected]>
2026-10-16 16:40:52 +02:00
Adrià FranchandClaude 94775df2b2 ci(linux): link with wild
Co-Authored-By: Claude <[email protected]>
2026-10-16 16:35:37 +02:00
Adrià FranchandClaude f7e767add9 ci(linux): size build and test parallelism to what the shared host has free
The self-hosted runners share one 32-thread host and were fixed at one job each, so
a build with many ccache misses compiled them one after another (686 misses took 37 min).
Pick jobs from the free CPUs and available memory (1 to 8, ctest at most 4) and pass a
load limit to ninja so a busy host backs off.

Co-Authored-By: Claude <[email protected]>
2026-10-16 12:14:07 +02:00
Adrià FranchandClaude e0b9572e3b ci(windows): find the CA bundle of Git for Windows under ucrt64 too
Git for Windows 2.56 (runner image 20261002) moved from mingw64 to ucrt64,
so the fixed SSL_CERT_FILE path no longer exists and the WinLibs CMake
fails the FFmpeg download with status 60 on every Windows build. Take the
bundle from whichever of ucrt64 and mingw64 exists.

Co-Authored-By: Claude <[email protected]>
2026-10-15 15:20:44 +02:00
Adrià FranchandClaude b139ac9b9f ci(build): build up to 40 pull requests together
Co-Authored-By: Claude <[email protected]>
2026-10-15 14:59:51 +02:00
NikoandClaude Opus 5.5 b9c91c89ba ci(build): accept merged pull requests in the relinker author check
The eligibility job enabled the relinker matrix for a pull request only
when repos.listCommits on main with the author's login returned a
commit. That filter misses authors whose commits in main are not
matched to their login. On 2026-10-13 it found no commit for 26 authors
of open pull requests who have 1 to 44 pull requests merged into main,
so their pull requests skip the relinker, against CONTRIBUTING.md ("if
its author already has a commit in main").

When listCommits finds nothing, the job now also searches for the
author's merged pull requests into main, with the query pr-intake.yml
uses. Incomplete search results count as none. A failed search, such as
the search API's own rate limit, skips the relinker with a warning
instead of failing the job. Both requests now run only when the pull
request changes a relinker file, so other pull requests make neither.

test_build_eligibility.py runs the step's script in node with a mocked
github object and skips when node is missing.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-15 13:18:25 +02:00
Dean Galvin a0d71c8917 ci(build): let a pull request's ref be replaced after it is force-pushed 2026-10-15 14:37:21 +13:00
Adrià FranchandClaude abfdd4b834 ci(build): add a dispatch input that runs only the relinker matrix
Co-Authored-By: Claude <[email protected]>
2026-10-14 21:57:22 +02:00
LeandroLP23andClaude Opus 5.5 c692334e00 ci(build): keep the Linux relinker tests when a manual build skips Linux
Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-14 20:07:18 +02:00
LeandroLP23andClaude Opus 5.5 8087908232 ci(build): skip test jobs a push to main does not touch, and duplicate relinker hosts
A push to main ran every job: relinker on three hosts, register context
on four and write watch on two, next to the full Linux and Windows
builds. The eligibility gate now reads the files of the push (compare
before...after) and applies the same path rules as pull requests; when
it cannot (a first push, 300 or more files, an API error) every job runs
as before.

Whenever the full builds run (push and manual builds), the Linux and
Windows relinker jobs repeat tests the full builds already run: the
relinker-only ctest lists (150 and 145 tests) are subsets of the full
Linux and Windows ones (1052 and 1069) in run 38397922579. The relinker
matrix now keeps only macOS then; automatic pull request builds, which
have no full build, still run all three.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-14 20:07:06 +02:00
boykopovar f74b8e2d87 ci(linux): limit build and test parallelism to one 2026-10-14 16:18:17 +03:00
boykopovar 069537d1c5 ci(linux): move builds to self-hosted runner with persistent caches 2026-10-14 15:31:22 +03:00
Adrià FranchandClaude e53b574782 ci(build): skip the pull request build of a pull request already closed
Co-Authored-By: Claude <[email protected]>
2026-10-14 13:50:34 +02:00
Adrià FranchandClaude 15503d11fe ci(build): build several pull requests together
Co-Authored-By: Claude <[email protected]>
2026-10-14 13:41:55 +02:00
Adrià FranchandClaude fe4831f350 ci(build): check out nested submodules
3rdparty/mbedtls (#3897) has its own framework submodule. The PR build
fetched it in its merge step, but push builds on main skipped that step
and failed at configure.

Co-Authored-By: Claude <[email protected]>
2026-10-14 13:13:22 +02:00
alfalfa-starandClaude Opus 5.5 040873f9dc feat(videoout): use native Wayland on Linux
Build SDL's Wayland backend next to X11 and ask SDL for "wayland,x11"
on Linux, so the window runs natively under a Wayland compositor instead
of through XWayland. SDL loads libwayland, xkbcommon and libdecor at run
time, so systems without them, or sessions without WAYLAND_DISPLAY, keep
using X11. SDL_VIDEODRIVER still overrides the choice.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-14 07:24:34 +02:00
Dean Galvin 8702de1e6f ci(build): key the Mesa shader cache by the runner's CPU model too
Since #5263 the Linux job restores a lavapipe shader cache keyed by the
runner's /proc/cpuinfo flags. llvmpipe compiles shaders with LLVM's host
CPU *name* (from vendor, family and model) plus the detected feature bits,
and keys its cache only by the feature bits, so two runners with the same
flags but different models share cached code. A hull shader JIT-compiled
on a znver4/znver5 or Ice Lake class host uses GFNI (vgf2p8affineqb);
loaded on a Zen 3 host with the same flags it raises SIGILL, which is what
agc_driver_tessellation has been hitting on main and on dispatched builds
since the first main build after #5234 saved that hull variant.

Hash vendor_id, cpu family, model and flags into the key, so a runner only
restores code compiled for its own CPU model, and print the model name so a
future mismatch can be read off the log.
2026-10-14 17:11:46 +13:00
Adrià FranchandClaude 32accfa938 ci(build): key the Mesa shader cache by the runner's CPU flags
The cache from #5107 was keyed by Mesa version only, so a runner restored
llvmpipe code compiled on another runner's CPU and about 85 agc tests died
with SIGILL (Illegal instruction) on main.

Co-Authored-By: Claude <[email protected]>
2026-10-13 17:57:49 +02:00
Adrià FranchandClaude 71f98dd746 ci(build): let a dispatched build skip the Linux job
Co-Authored-By: Claude <[email protected]>
2026-10-13 17:03:50 +02:00
Adrià FranchandClaude 5181b30d79 ci(windows): build the f16 unpack execution test, it runs without a device
Co-Authored-By: Claude <[email protected]>
2026-10-13 14:18:28 +02:00
Adrià FranchandClaude aef5972ff5 ci(linux): keep lavapipe's shader cache between builds
Co-Authored-By: Claude <[email protected]>
2026-10-13 13:51:10 +02:00