Repository navigation
[CI Postmortem] AppSizeTest failures across multiple PRs (API diff not updated) #25224
Closed as not planned
Description
Summary
Xamarin.Tests.AppSizeTest tests are failing across 4 unrelated PRs (10 builds) with API diff mismatches. The tests detect added/removed APIs that haven't been accounted for in the known-failures baseline.
Failure Details
Tests: 26 AppSizeTest variants across all platforms (iOS, tvOS, macOS, Mac Catalyst)
Configurations: MonoVM, CoreCLR, NativeAOT, Interpreter, R2R, TrimmableStatic
Error pattern:
Multiple failures or warnings in test:
1) No added APIs (set the environment variable WRITE_KNOWN_FAILURES=1 and run the test again to update the expected set of APIs)
Expected: <empty>
But was: < "Microsoft.tvOS.dll:ObjCRuntime.NSObjectProxyAttribute", ...>
2) No removed APIs (set the environment variable WRITE_KNOWN_FAILURES=1...)
Key added APIs:
ObjCRuntime.NSObjectProxyAttributeObjCRuntime.ProtocolProxyAttributeObjCRuntime.RegistrarHelper.LookupUnmanagedFunctionObjCRuntime.Runtime.ConstructINativeObject(new overload)
Key removed APIs:
*._Xamarin_ConstructINativeObject*._Xamarin_ConstructNSObjectObjCRuntime.RegistrarHelper.LookupUnmanagedFunction(old overload)
Classification
- Type: Shared regression / baseline drift
- Impact: 4 PRs, 10 builds, 26 test variants
- Confidence: High — consistent across unrelated PRs
Affected PRs
#25077, #25079, #25105, #25197
Resolution
Run the tests with WRITE_KNOWN_FAILURES=1 to update the expected API baseline, or review if the API changes are intentional and update accordingly.
Filed automatically by CI postmortem analysis.
Activity
rolfbjarne commentedon Apr 24, 2026
To Copilot: this particular test (AppSizeTest) is expected to fail in many different pull requests, because it's a very sensitive test (by design).
As such, this is not a CI issue that needs to be fixed.
dalexsoto commentedon Aug 27, 2026
Recurrence update (2026-08-27)
Stable signature:
Xamarin.Tests.AppSizeTest | TVOS tvos-arm64 | runtime-update baseline driftClassification: deterministic expected-baseline drift; no retry is appropriate.
Newly tracked occurrences:
b956034e64eae11ea91afcec93b11996be9adbe0: run 15086535, attempt 1,dotnettests_tvos. Six runtime configurations exceeded size baselines and four preserved-API baselines changed. A later head updated the expected sizes and those baseline checks passed.070e656c01f70d18b2f0a3eac813c9ffbe3bc1e7: run 15114195, attempt 1,dotnettests_tvosonAcesShared 31. FourAppSizeTestcases failed: CoreCLR Interpreter grew from 8,241,763 to 8,463,881 bytes (+222,118), CoreCLR R2R grew from 11,352,311 to 11,575,430 bytes (+223,119), and the MonoVM/MonoVM Interpreter preserved-API sets changed. NUnit reported 901 total, 165 passed, 4 failed, 2 inconclusive, and 730 skipped; there were no crashes, timeouts, launch failures, or missing devices. Diagnostic artifacts:TestSummary-simulator_testsdotnettests_tvos-1,HtmlReport-simulator_testsdotnettests_tvos-1, andupdated-expected-sizes-simulator_testsdotnettests_tvos-1.Confirmed count: 2 occurrences across 2 distinct PRs. No retries were requested.
Issue-specific checklist: the issue body has no Additional info to collect section.
Diagnosis/workaround: this matches the by-design sensitivity described in the closure comment. Review and update the expected size and preserved-API baselines when the dependency changes are intentional.
Not reopening: the current evidence matches, rather than invalidates, the
NOT_PLANNEDclosure reason.dalexsoto commentedon Aug 27, 2026
Additional platform recurrences (2026-08-27)
Three platform-specific
Xamarin.Tests.AppSizeTestsignatures are now confirmed across two monitored PRs:ios-arm64— PR #26454 headb956034e..., run 15086535 and PR #26356 head070e656c..., run 15114195. The current occurrence has four baseline failures: CoreCLR Interpreter +255,895 bytes, CoreCLR R2R +256,896 bytes, and preserved-API changes in both MonoVM configurations.maccatalyst-arm64— PR #26454, run 15086535 and PR #26356, run 15114195. The current occurrence has four baseline failures: CoreCLR Interpreter +198,073 bytes, CoreCLR R2R +200,745 bytes, and preserved-API changes in both MonoVM configurations.osx-arm64;osx-x64— PR #26454, run 15086535 and PR #26356, run 15114195. The current occurrence has three file-list/size baseline failures, with CoreCLR configurations growing by approximately 4.85 MB.Each stable signature has 2 confirmed occurrences across 2 distinct PRs. No retries were requested; these are deterministic expected-baseline changes. Diagnostic artifacts for run 15114195 include each platform's
TestSummary,HtmlReport, andupdated-expected-sizesartifacts.Issue-specific checklist: the issue body has no Additional info to collect section.
The later #26454 heads updated the expected baselines and passed these checks. Review and update the expected size, file-list, and preserved-API baselines when the dependency changes are intentional.
Not reopening: these recurrences match, rather than invalidate, the
NOT_PLANNEDby-design-sensitivity closure reason.dalexsoto commentedon Aug 27, 2026
tvOS baseline fix validation (2026-08-27)
PR #26356 head
34a614dfc2cae18a1a8c8968621493ba6ed6083aupdates the expected app-size files. In run 15115286,dotnettests_tvos:AppSizeTestconfigurations ran and passed: CoreCLR Interpreter, CoreCLR R2R, MonoVM, MonoVM Interpreter, NativeAOT, and NativeAOT TrimmableStatic.BuildNet10_0App(TVOS, "tvossimulator-arm64")also passed.This validates the tvOS expected-baseline update. The overall simulator pipeline is still running, so validation for the other platform signatures remains pending.
Issue-specific checklist: the issue body still has no Additional info to collect section.
The issue remains closed; this successful expected-baseline update is consistent with the existing
NOT_PLANNEDclosure reason.dalexsoto commentedon Aug 27, 2026
iOS baseline fix validation (2026-08-27)
PR #26356 head
10600548eb4614d4042b832a8dcc5388b9e612cfpassed run 15115823,dotnettests_ios:AppSizeTestconfigurations ran and passed: CoreCLR Interpreter, CoreCLR R2R, MonoVM, MonoVM Interpreter, NativeAOT, and NativeAOT TrimmableStatic.BuildNet10_0App(iOS, "ios-arm64")also passed, with no_mono_helper_box_nullablelinker trace.This validates the iOS expected-baseline update. Mac Catalyst validation remains active.
Issue-specific checklist: the issue body still has no Additional info to collect section.
The issue remains closed; this successful expected-baseline update is consistent with the existing
NOT_PLANNEDclosure reason.dalexsoto commentedon Aug 27, 2026
Mac Catalyst and macOS baseline fix validation (2026-08-27)
PR #26356 head
10600548eb4614d4042b832a8dcc5388b9e612cfpassed both remaining platform jobs in run 15115823:dotnettests_maccatalyst: all six Mac CatalystAppSizeTestconfigurations passed. NUnit reported 901 total, 215 passed, 0 failed, 2 inconclusive, and 684 skipped.dotnettests_macos: all five applicable macOSAppSizeTestconfigurations passed. NUnit reported 901 total, 217 passed, 0 failed, 2 inconclusive, and 682 skipped.Together with the previously reported iOS and tvOS results, this validates the expected-baseline updates on all affected platforms.
Issue-specific checklist: the issue body still has no Additional info to collect section.
The issue remains closed; these successful expected-baseline updates are consistent with the existing
NOT_PLANNEDclosure reason.dalexsoto commentedon Sep 2, 2026
macOS expected-size recurrence (2026-09-02)
Stable signature:
Xamarin.Tests.AppSizeTest | macOS osx-arm64;osx-x64 | expected-size baseline driftNew occurrence: PR #26513, head
a354efde93df4b8e7ad9eb15a88ebd64916b2be1, run 15184608 attempt 1,T: dotnettests_macosonAcesShared 43.Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)expected 331,609,114 bytes but produced 331,619,866 bytes: +10,752 bytes against a 10,240-byte tolerance. The updated-baseline artifact attributes 5,632 bytes to the arm64Microsoft.macOS.dlland 5,120 bytes to the x64Microsoft.macOS.dll. Diagnostic artifacts:TestSummary-simulator_testsdotnettests_macos-1,HtmlReport-simulator_testsdotnettests_macos-1, andupdated-expected-sizes-simulator_testsdotnettests_macos-1.Classification: deterministic expected-size baseline drift. This PR already changes
MacOSX-CoreCLR-R2R-size.txt; the current merge build needs the newly generated expected value reviewed and applied. No retry was requested, and the Rolf-authored branch remains unchanged.Confirmed macOS-signature count: 3 occurrences across 3 distinct PRs (#26454, #26356, #26513).
Issue-specific checklist: the issue body has no Additional info to collect section.
Not reopening: this recurrence matches the documented by-design sensitivity and does not invalidate the
NOT_PLANNEDclosure reason.dalexsoto commentedon Sep 2, 2026
New macOS expected-size occurrence on PR #26313 @
16a37c0640f986dfcf2b8c8d7a94a96c21cd738f:T: dotnettests_macosran onAcesShared 82.Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)expected 331,621,659 bytes and produced 331,634,202 bytes: +12,543 bytes against the 10,240-byte tolerance.Microsoft.macOS.dll, +6,144 bytes to x64Microsoft.macOS.dll, -736 bytes to the app executable, and -33 bytes toInfo.plist.The macOS-signature count is now 4 confirmed occurrences across 4 distinct PRs (#26454, #26356, #26513, #26313).
The issue body has no Additional info to collect checklist. Not reopening: this remains consistent with the documented by-design sensitivity and
NOT_PLANNEDclosure reason.dalexsoto commentedon Sep 3, 2026
Fix outcome for PR #26513, replacement head
dc916b616979c11042468b0a11894d28ed84ea17:MacOSX-CoreCLR-R2R-size.txtwith the reviewed expected-size baseline.T: dotnettests_macoscompleted successfully at 2026-09-03 06:00:19 UTC, and the overall GitHub simulator check completed successfully at 06:56:04 UTC.AppSizeTest.CoreCLR_R2Rpassed; the prior [CoreFoundation] Fix numerous issues with CFMessagePort. #26513 expected-size occurrence is resolved on this head.The macOS-signature count remains 4 confirmed occurrences across 4 distinct PRs. The issue remains closed as
NOT_PLANNED; this expected baseline update does not invalidate the by-design closure reason. The issue body has no Additional info to collect checklist.dalexsoto commentedon Sep 3, 2026
New .NET 11 dependency-driven macOS AppSize recurrence:
862c1b35c2bc5f9308ea8fa65fb02f907d205839, build 15198573 /T: dotnettests_macos, onAcesShared 50.11.0.100-rc.2.26452.102to11.0.100-rc.2.26452.117.CoreCLR_Interpreter_TrimmableStatic: 220,774,802 → 220,764,474 bytes (-10,328).CoreCLR_Interpreter: 220,774,802 → 220,764,474 bytes (-10,328).CoreCLR_R2R: 331,782,521 → 331,768,634 bytes (-13,887).updated-expected-sizes-simulator_testsdotnettests_macos-1artifact contains the corresponding three expected-file diffs. The harness recorded no crash, timeout, launch failure, or missing device.This matches the prior #26521 .NET 11 dependency/AppSize signature. The exact signature now has 24 confirmed test-case occurrences across 2 distinct PRs (#26521 and #26554), including two macOS job-level recurrences. Classification remains deterministic expected-baseline drift; no retry was requested, and the bot-authored branch was not modified.
The issue body has no Additional info to collect checklist. The issue remains closed as
NOT_PLANNED; this by-design-sensitive recurrence does not invalidate its closure reason.dalexsoto commentedon Sep 4, 2026
One replacement-head macOS AppSize occurrence remains on PR #26554 @
a17b2e3290d91f5f760494df421527c800dfd61e:T: dotnettests_macos/Run testscompleted at2026-09-04T04:17:01Z.Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)expected 331,782,521 bytes and produced 331,768,866 bytes: -13,655 bytes, beyond the ±10,240-byte tolerance.updated-expected-sizes-simulator_testsdotnettests_macos-1/MacOSX-CoreCLR-R2R-size.txt.diff.The two
CoreCLR_Interpretercases that failed on the superseded head no longer cross the threshold; onlyCoreCLR_R2Rremains. The canonical .NET 11 AppSize signature now contains 25 confirmed test-case occurrences across 2 distinct monitored PRs.Classification remains deterministic expected-size baseline drift. No retry was submitted, and the bot-authored branch was not modified. This evidence does not invalidate the issue's
NOT_PLANNEDclosure, so it remains closed.Issue-specific checklist: none; the issue body has no Additional info to collect section.
dalexsoto commentedon Sep 4, 2026
Fix validation for PR #26554 replacement head
7e8c4edb02eb98aa7ad72f1da2e6755a61af1517([tests] Update expected app size files):T: dotnettests_macoscompleted successfully at2026-09-04T06:38:07Z.Run teststask completed successfully with zero errors at2026-09-04T06:37:14Z.Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)passed; the prior replacement-head delta of -13,655 bytes did not recur.This validates the expected-size update for the recorded #26554 AppSize occurrence. The canonical count remains 25 confirmed test-case occurrences across 2 distinct monitored PRs.
The issue remains closed as
NOT_PLANNED; this expected baseline update does not invalidate its closure reason. These were fresh automatic CI runs, not retries, and the bot-authored branch was not modified by the monitor.Issue-specific checklist: none; the issue body has no Additional info to collect section.
dalexsoto commentedon Sep 21, 2026
Two matched macOS R2R size-baseline occurrences; keeping this issue closed
Two independently inspected runs fail
Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)with the same narrow four-assembly growth pattern:36d53003571d8cf3c57b5fb182de26320e57108e— run 15400505, attempt 1, task log 2890; test 2026-09-21 18:42:29–18:43:55 UTC.84a0c36a97a761eea2654171cb17b0a0561c90c3— run 15403840, attempt 1, task log 2613; test 22:01:30–22:02:49 UTC. This is not attributed to current head9416a96ea970676e00cd4a1824d45ed51dcfd486, whose CI is separate.Both use pipeline
xamarin-macios-sim-pr-tests(21922), jobT: dotnettests_macos, taskRun tests, and stage/job/task attempt 1. This is the actual app-byte-size assertion, not an informational current-PR API diff.The exact-head gate allows ±10,240 bytes; these exceed it by 2,945 and 2,348 bytes. Full per-file delta sums match the totals.
Correlation beyond the test name: in both runs,
Microsoft.macOS.dllgrows 4,096 bytes arm64 / 3,584 bytes x64, andSystem.Private.CoreLib.dllgrows 3,072 / 2,560 bytes relative to each run's own baseline. The actual CoreLib binaries are byte-identical across the two produced app bundles for each architecture. Both use the same AppSizeTest source and SDK11.0.100-rc.2.26465.108. Other file changes net −127 and −724 bytes. The binding assemblies are not claimed byte-identical, nor is a particular compiler optimization or shared PR source regression inferred.Classification/counts: deterministic expected-size baseline mismatch. 2 confirmed test occurrences across 2 distinct monitored PRs for this exact four-component signature. These scoped counts do not replace older, different signatures or historical totals in this issue.
Decision: reuse this existing closed / NOT_PLANNED baseline record; do not reopen. The evidence is consistent with the documented by-design sensitivity, not proof of a new infrastructure defect. No retry, source edit, suppression, or expected-file update was performed. There is no verified retry/fix outcome for these exact records. Baseline review belongs to the branch owners; the older #26669 result does not establish failure or recovery on its replacement head.
Diagnostics/checklist: the refreshed issue body has no Additional info to collect section. For each occurrence, exact head/run/attempt/job/task/test, original NUnit assertion/output, exact-head baseline/gate, full size deltas and actual failed app-bundle binary comparisons were collected. The lower-level reason for the R2R layout differences remains unestablished; no such explanation is invented. Worker identifiers and IP addresses are withheld.
Evidence is in each linked run's
HtmlReport-simulator_testsdotnettests_macos-1,updated-expected-sizes-simulator_testsdotnettests_macos-1, andfailed-app-size-bundles-simulator_testsdotnettests_macos-1artifacts, subject to retention.Stable signature:
deterministic-test|AppSizeTest.CoreCLR_R2R|macOS-universal|Microsoft.macOS-and-System.Private.CoreLib-size-growth|outside-102405 remaining items
dalexsoto commentedon Sep 23, 2026
Independently verified new-head size occurrence: PR #26574
306b9621faa1e9c5b6da750f2d701ceef2c2d378.xamarin-macios-sim-pr-tests(21922), 15425071 / dotnettests_macos / Run tests, stage/job/task attempt1, task log 2853.Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False), 2026-09-23 02:54:22–02:55:44 UTC.tests/DotNet-tests/322/results-20260922_194119.xmlinHtmlReport-simulator_testsdotnettests_macos-1.Expected 333,102,819 bytes, actual 333,115,407: +12,588, exceeding the ±10,240-byte gate by 2,348 bytes. The exact-head baseline and test source were independently fetched and remain unchanged. The entire per-file expected/actual profile matches the prior narrow signature:
Microsoft.macOS.dll+4,096 arm64 / +3,584 x64, andSystem.Private.CoreLib.dll+3,072 / +2,560; all file deltas sum to +12,588.Classification/counts: deterministic expected-size baseline mismatch. This distinct head/run adds one occurrence, not a new PR: 8 confirmed occurrences across2 distinct monitored PRs for this exact four-component signature. Other historical issue signatures and counts remain unchanged.
Keeping the issue closed / NOT_PLANNED. This is consistent with the documented by-design sensitivity. No retry, expected-file/source edit, suppression or reopening was performed. No fix/recovery or lower-level R2R layout cause is claimed. The size assertion is separate from this PR's package-generator failure, NativeAOT crash and any informational current-PR API diff.
Diagnostics/checklist: the refreshed issue body has no Additional info to collect section. Exact head/run/attempt/job/task/test, original assertion/output, current-head baseline/gate and full file deltas were collected. A verified recovery and lower-level reason for layout differences remain unavailable. Worker identifiers/IPs are withheld; artifacts are retention-limited.
dalexsoto commentedon Sep 23, 2026
External retry reproduced the macOS R2R size baseline failure
PR #26574, unchanged head
306b9621faa1e9c5b6da750f2d701ceef2c2d378, failed again in run 15425071 / dotnettests_macos / Run tests, pipelinexamarin-macios-sim-pr-tests(21922), stage/job attempt 2, task-record attempt 1, log 3133.Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)ran at 2026-09-23 11:53:19-11:54:40 UTC. Expected 333,102,819 bytes, actual 333,115,407: +12,588, exceeding the +/-10,240-byte gate by 2,348.The original attempt-2 NUnit output independently reproduces the narrow fingerprint:
Microsoft.macOS.dll+4,096 arm64 / +3,584 x64 andSystem.Private.CoreLib.dll+3,072 / +2,560. All 164 changed-file entries sum to +12,588. The exact-head baseline/gate is unchanged; this is an app-byte-size assertion, not an informational current-PR API diff.Classification/counts: deterministic expected-size mismatch; 9 confirmed occurrences across 2 distinct monitored PRs for this exact signature. This adds one newly confirmed retry attempt, not another PR or a repeated observation. Unrelated historical signatures remain unchanged.
The externally initiated macOS retry ended failed at 13:30:55 UTC; the separate iOS job was still running at observation. This monitor requested no retry and changed no source, expected files or suppressions. The result supports the existing by-design sensitivity rationale, so the issue remains closed / NOT_PLANNED.
Diagnostics/checklist: the freshly read body has no Additional info to collect section. Exact head/run/attempt/job/task/test, original assertion and complete file deltas are retained. A fix/recovery and the lower-level R2R layout explanation remain unavailable. Worker identifiers and IP addresses are withheld. Evidence:
HtmlReport-simulator_testsdotnettests_macos-2, originaltests/DotNet-tests/322/results-20260923_044016.xml; linked Azure artifacts are retention-limited.dalexsoto commentedon Sep 23, 2026
Verified external macOS R2R baseline fix: PR #26574
The replacement head
fe3c25fda59f9b5966f81fda854967bc5916300cchanges the checked-in macOS CoreCLR R2R expected size from 333,102,819 to 333,115,407 bytes. Its own CI now verifies that exact size:Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)Passed, running 2026-09-23 15:57:34-15:58:53 UTC.This is a verified new-head fix outcome for the two immediate prior-head records on
306b9621faa1e9c5b6da750f2d701ceef2c2d378, run15425071 attempts1 and2. Their original failures remain recorded. It does not establish recovery for unrelated old heads, other PRs, or different failure signatures.The failure count remains 9 occurrences across 2 distinct monitored PRs for the narrow four-component signature. A successful fix verification is not another failure and resets no retry counter. This was fresh automatic CI after an external source change, not a monitor retry or monitor-authored fix.
The whole simulator pipeline still ended failed on separate source-copy-race, linker-launch and NativeAOT crash failures. Only this size-baseline gate is declared fixed. The issue remains closed / NOT_PLANNED: reviewing and updating an intentionally sensitive expected baseline is consistent with its closure rationale.
Diagnostics/checklist: the freshly read body has no Additional info to collect section. The explicit source-baseline change, exact current-head NUnit case/result/duration, expected and measured totals, and job/task result were verified. A lower-level explanation for the original R2R layout difference is not inferred. Worker identifiers and IPs are withheld.
Evidence:
HtmlReport-simulator_testsdotnettests_macos-1, originaltests/DotNet-tests/322/results-20260923_084431.xml, in the linked run. Azure artifacts are retention-limited. No source edit, suppression, reopening or additional retry was performed by this monitor.AI-assisted CI monitoring update.
dalexsoto commentedon Sep 25, 2026
Exact macOS CoreCLR R2R size-baseline failure on four release backports
Four unrelated
release/11.0.1xx-rc.2PRs failedXamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)inxamarin-macios-sim-pr-tests(definition 21922). Each run'sTestSummaryandHtmlReportNUnit XML independently show expected 333,102,819 bytes; actual 333,115,407; +12,588 bytes, exceeding the +/-10,240-byte gate by 2,348 bytes. All four have the same 164-entry file-delta profile, includingMicrosoft.macOS.dllandSystem.Private.CoreLib.dllfor both architectures:4bdb4ee416040ecff31767e6916ff3dd433028f4: run 15446810, attempt 1,T: dotnettests_macosjob306fc6d1-8bac-5ab5-4f68-7aa08eedb9c6/Run teststaske65d0962-e63e-55e0-b05e-8969a40ef4ed, log 2816, execution 322, failed 2026-09-24 15:40:53 UTC.acf14905b74e7b82fd0f441238750be1396ab3a9: run 15447650, attempt 1,T: dotnettests_macosjob306fc6d1-8bac-5ab5-4f68-7aa08eedb9c6/ taske65d0962-e63e-55e0-b05e-8969a40ef4ed, log 2853, execution 322, failed 2026-09-24 17:04:31 UTC.66d57e67bf0d5a05a6cd5659d94b05ca41ad168f: run 15447656, attempt 1, job306fc6d1-8bac-5ab5-4f68-7aa08eedb9c6/ taske65d0962-e63e-55e0-b05e-8969a40ef4ed, log 2626, execution 322, failed 2026-09-24 17:09:02 UTC.c26cd59f582bbc46861a0288665d507711a69f8f: run 15447662, externally reexecuted simulator stage/job attempt 2, job9a2ea658-3288-5946-319d-f3240303ae84/ task1edbbe90-10c7-50fd-67e2-f08e70510db3, log 3016, execution 322, failed 2026-09-25 00:52:02 UTC. Stage attempt 1 was skipped, not a prior instance of this test failure; the accepted retry request grouping is unavailable.Classification: deterministic test failure from the old expected-size baseline on these release heads; the exact assertion and file profile match the previously mapped narrow signature. The corresponding expected-size update was verified on #26574 and merged into
mainon 2026-09-24, but these release-branch runs still used the old value. Totals: 13 confirmed occurrences across 6 distinct monitored PRs for this narrow signature. For each of the four records, the refreshed issue body has no "Additional info to collect" section; no issue-specific checklist item applies. The lower-level reason for R2R component-size growth is unavailable, and there are no Helix work-item links because tests ran directly in Azure DevOps. No monitor retry or source edit was made; retrying a deterministic size gate is not authorized. The issue remains CLOSED / NOT_PLANNED: a release head missing the recently merged main-branch fix does not invalidate its closure or authorize reopening. Linked artifacts have limited retention.dalexsoto commentedon Sep 25, 2026
Exact macOS CoreCLR R2R size-baseline mismatch on release PR #26703
f23610d3944070f9d46892bd45a3fe544d5a8013;release/11.0.1xx-rc.2target.T: dotnettests_macos/Run tests(pipeline 21922, stage/job attempt 1, task log 2863); original NUnit XMLresults-20260924_045709.xml, execution 322,Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False).Issue-specific diagnostics: No Additional info to collect section exists in the refreshed issue body. Exact PR/head/run/attempt/job/task/test, expected/actual/tolerance and original XML were collected. A new file-delta profile is unavailable from this investigation; no Helix item applies to this direct Azure test. Azure artifacts are retention-limited.
State/action: #25224 remains CLOSED / NOT_PLANNED. The merged main baseline update in #26574 is not proof it is in this release head. At investigation time, #26730/#26736 release baseline changes had no completed macOS test result; no fix outcome is claimed and the issue is not reopened. No retry of a deterministic assertion or source change to this Rolf PR.
AI-assisted CI monitoring update.
dalexsoto commentedon Sep 25, 2026
Exact macOS CoreCLR R2R AppSize baseline failure: PR #26731
#26731 /
99a053bc29f219df18306782e5930637b1654fe3failed Azure run 15462019 / simulatorT: dotnettests_macos/Run tests(pipeline 21922, stage/job attempt 1, task log 2826). OriginalHtmlReport-simulator_testsdotnettests_macos-1NUnit XML for execution 322 identifiesXamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)(2026-09-25 13:55:09–13:56:31 UTC): expected 333,102,819 bytes, actual 333,115,407, delta +12,588 over the 10,240 tolerance by 2,348. The test explicitly requests a universal macOS app; #26731’s change to the default macOS 27 architecture does not demonstrate a fix of this assertion.Classification/counts: exact deterministic release-branch expected-size baseline mismatch, 15 confirmed occurrences across 8 distinct monitored PRs. A fresh component-level file-delta profile was not computed on this head; it is not assumed identical to previous profiles. No retry of this deterministic assertion or Rolf source change.
Issue-specific diagnostics: The refreshed body has no Additional info to collect section. Exact PR/head/run/attempt/job/task/test, original NUnit XML and expected/actual/tolerance were collected; a new file-delta profile is unavailable from this investigation, and no Helix work item applies to the direct Azure test. Artifacts are retention-limited.
State/action: #25224 remains CLOSED / NOT_PLANNED. The merged main baseline update in #26574 is not proof that this release head contains it; the #26730/#26736 expected-size changes had no completed macOS job when checked. No fix outcome is claimed, and this recent evidence does not authorize reopening.
AI-assisted CI monitoring update.
dalexsoto commentedon Sep 25, 2026
Release AppSize recurrence on #26712; exact-case pass on #26730 expected-file update
d5a3a6d37e21a70d24e2da4a33197ab495f33e15, Azure run 15462174 / simulatorT: dotnettests_macos/Run tests(pipeline 21922, stage/job attempt 1, task log 2853). Original NUnit XML for execution 322 identifiesXamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)at 2026-09-25T14:17:37Z–2026-09-25T14:18:58Z: expected 333,102,819, actual 333,115,407 bytes, difference +12,588, outside the 10,240-byte limit by 2,348.4895a335b2b033f096b4e8972905c0de32b028a2updatestests/dotnet/UnitTests/expected/MacOSX-CoreCLR-R2R-size.txtfrom 333,102,819 to 333,116,131 bytes. In Azure run 15462010 /T: dotnettests_macosthe same case, execution 322, actually ran and passed (original NUnit XML 2026-09-25T13:56:58Z–13:58:34Z, zero failed cases); its TestSummary reports all one configuration passed and the macOS job succeeded at 2026-09-25T15:56:41Z. The parent pipeline was still in progress when observed; no merged/full-PR recovery is claimed. Passing XML does not print the actual bundle size, so its numeric margin is unavailable rather than inferred.Classification/counts: the #26712 assertion is the exact deterministic release-branch baseline signature, raising the total to 16 confirmed failures across 9 distinct monitored PRs. #26730's passing fix test adds no failure count. Do not retry a deterministic assertion or edit Rolf branches.
Issue-specific diagnostics: The refreshed body has no Additional info to collect section. For #26712, exact PR/head/run/attempt/job/task/test and measured expected/actual/tolerance were collected. A fresh component-level file-delta profile was not collected. For #26730, the expected-file diff, correct-case NUnit pass/timing, TestSummary and job result were collected; its actual measured size and full-parent outcome were unavailable at observation. Direct Azure jobs have no Helix item; worker identity/IP are withheld and artifacts are retention-limited.
State: #25224 remains CLOSED / NOT_PLANNED. The merged main baseline fix does not establish that #26712's older release head contains it. The dedicated #26736 fix job had no terminal macOS result when checked; do not reopen or claim its validation.
AI-assisted CI monitoring update.
dalexsoto commentedon Sep 25, 2026
Release/11 baseline fix merged; exact AppSize case passed (overall CI still failed)
The old-head macOS universal CoreCLR ReadyToRun size failure on #26712 (
d5a3a6d37e21a70d24e2da4a33197ab495f33e15, run 15462174 / task log 2853, attempt 1) was already reported in the previous comment:AppSizeTest.CoreCLR_R2R(MacOSX, osx-arm64;osx-x64, False)expected 333102819 bytes, observed 333115407, delta +12588 vs tolerance 10240, excess 2348. Its replacement head remains under automatic CI, not a demonstrated recovery. The previously documented #26730 expected-file head passed the exact case, but was also superseded.New, bounded fix outcome: #26736, head
2abd152cc2f43100e7933c3c672487c1ca92e6a6, merged intorelease/11.0.1xx-rc.2at 2026-09-25T16:27:08Z (merge commitcf43fbccb0c16e0362d3ae5ca69bde38c4eb8572). Its Azure run 15462510 / macOSDotnet testsjob (attempt 1, TestSummary/HtmlReport execution 322) actually ran that same macOS universal CoreCLR R2R case and passed at 14:51:05Z using the updated expected size 333115829. The passing actual bundle byte count was not logged; do not extrapolate to other heads/configurations.The parent run finished failed at 17:11:38Z from separately reported Windows HKLM permission setup (#26667) and PID-matched SpringBoard launch crashes (#26227), plus a post-merge publisher checkout that could not fetch the retired
refs/pull/26736/merge(task log 2990). This is exact-case release-baseline validation, not overall CI recovery. Counts remain 16 confirmed AppSize failures across 9 monitored PRs; a passing fix check is not a new failure. #25224 remains CLOSED / NOT_PLANNED; the release fix merge and independent CI failures do not justify reopening it. No monitor retry, source edit or push.Issue-specific diagnostics: The refreshed body has no Additional info to collect section. #26712's exact assertion/configuration/attempt/job and #26736's exact passing case, merged commit and independently failed parent outcome were collected from Azure TestSummary/NUnit artifacts, task timelines and merge metadata. Passing actual size, a new per-component delta profile, and Helix work items (these are direct Azure macOS jobs) are unavailable; artifacts are retention-limited. No worker identifiers, IPs or credentials are disclosed.
AI-assisted CI monitoring update.
dalexsoto commentedon Oct 2, 2026
Newly verified CI evidence (2026-10-02)
Signature:
deterministic-test|AppSizeTest.CoreCLR_R2R|macOS-universal|Microsoft.macOS-typemap-growth|outside-10240. Classification: deterministic test failure.Exact-signature counts: 1 confirmed occurrences / 1 distinct monitored PRs. Canonical aggregate: 17 records / 10 PRs, preserving separate aliases. This batch adds 1 exact failure records.
PR #26834 / run 15552429, head
2136dfd4d1f43b307b4e29fc18f98f0a0d764571, pipeline xamarin-macios-sim-pr-tests / definition21922, job306fc6d1-8bac-5ab5-4f68-7aa08eedb9c6, taske65d0962-e63e-55e0-b05e-8969a40ef4ed, stage/job/task 1/1/1, log 2816. 1 new test/configuration records:Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False).Per-occurrence diagnostic facts:
{"artifact":"HtmlReport-simulator_testsdotnettests_macos-1","member":"tests/DotNet-tests/322/results-20261002_114828.xml","outer_sha256":"4d0ee1e2e752bf2d557f70389d8995249f74cf39462b84948a38fd5e09b98d1d","expected":333115829,"actual":333130255,"delta":14426,"tolerance":10240,"excess":4186,"test_start":"2026-10-02T19:01:31Z","test_end":"2026-10-02T19:02:52Z"}.Actual measured AppSize bundle gate: expected333115829, actual333130255, delta14426 versus tolerance10240, excess4186 bytes. Raw expected-file diff: TypeMaps +4096 per architecture, Microsoft.macOS.dll +3584/+3072, executable -416, plist -6; System.Private.CoreLib unchanged. Keep this new exact component alias separate from the older CoreLib-growth signature. Exact-head file and raw updated-expected artifact verified. All-state exact test/error/component search selected #25224; #26562 is unrelated Windows MSB3021. Keep CLOSED/NOT_PLANNED. This is not either beta-Xcode API-diff baseline; no assertion-text baseline-update command was executed.
Issue-specific checklist: fresh body has no Additional info to collect section. Every included occurrence has its own source-member/hash and exact attribution retained. Unavailable diagnostic facts are stated above; worker identifiers and machine/peer addresses are withheld without independent publication permission. No Helix work items apply to these direct Azure jobs.
Retry/fix outcome: no monitor-triggered retry, source change, suppression, commit/push or reopening. All-actor accepted-request grouping and full lifetime/head counters remain uncertified; attempts are not accepted-request counts and successes do not reset budgets. Source/deterministic/unresolved failures are not retried. Azure artifacts/logs are retention-limited.
Artifacts.
dalexsoto commentedon Oct 3, 2026
Exact CI evidence and external retry outcomes
#26834 /
2136dfd4d1f43b307b4e29fc18f98f0a0d764571: run15552429 / exact job2, definition21922, stage/job 2/2.One new deterministic test failure, task
1edbbe90-10c7-50fd-67e2-f08e70510db3/ task-record1 / log3170:Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False), primary NUnittests/DotNet-tests/322/results-20261003_053130.xml, 2026-10-03T12:47:22Z--2026-10-03T12:48:56Z. NUnit/TRX are mirrors of this one case, counted once. Expected 333115829, actual 333130255, delta 14426 versus tolerance 10240, excess 4186 bytes: identical to original attempt1. Current source-GUID-matched raw size diff independently accounts for TypeMaps +4096 per architecture, Microsoft.macOS.dll +3584/+3072, native executable -416, plist -6; CoreLib unchanged. This is the measured macOS universal bundle gate, not API-preservation assertions or either beta API comparison. Classification: deterministic test failure. Current PR is CONFLICTING/DIRTY; no monitor retry/source/baseline edit. Prior exact mapping is reused from the accepted measured-size occurrence comment, not the unrelated body update instructions. This remains one PR; the second attempt is not a newly established cross-PR recurrence. Parent completed/failed at 2026-10-03T14:50:34.828829Z.Signature:
deterministic-test|AppSizeTest.CoreCLR_R2R|macOS-universal|Microsoft.macOS-typemap-growth|outside-10240. 2 exact confirmed occurrences / 1 distinct PRs, including retained historical and recovered confirmations. Canonical aggregate: 18 records/10 PRs, preserving distinct component/signature aliases. This batch adds1 new exact failure record(s) and updates0 existing outcome(s); successful retries do not erase original failures.Issue-specific checklist: freshly read body has no Additional info to collect section. Authorized exact PR/head/run/stage/job/task/attempt, primary artifact/member/hash/native or threshold evidence and UTC timing are attributed above. Unavailable: triggering actors/service-accepted request grouping and complete all-actor lifetime/head histories remain uncertified; a global OS/source-race fix and unrelated original faulting stacks are not established. Neither attempts nor scope rows certify25-lifetime/10-head budgets. No monitor retry, source/suppression/baseline edit, issue creation or reopening. Keep the canonical issue CLOSED/NOT_PLANNED; closed issue recurrence does not authorize reopening. Artifact/body update commands are inert and were not executed. Direct Azure work has no Helix item. Worker identifiers, addresses, credentials and environment blocks are withheld; remote artifacts are retention-limited.
dalexsoto commentedon Oct 3, 2026
Exact observed CI evidence and bounded outcomes
Externally observed source change, NOT a validated recovery: #26834 advanced from failed head
2136dfd4d1f43b307b4e29fc18f98f0a0d764571to6dd45a2de2767418ffcbe80d006844f71c39ff39. The exact GitHub commit delta modifies onlytests/dotnet/UnitTests/expected/MacOSX-CoreCLR-R2R-size.txt: expected bundle size333115829->333130255 with the matching six component-size entries previously verified from the failed CI artifact. This is a measured AppSize baseline edit, not API bindings or API suppression files. Current head is CONFLICTING/DIRTY. Exact GitHub check IDs111240782493/111240782621/111240782491 report ACTION_REQUIRED, title Skipped due to merge conflicts, summary This branch has conflicts that must be resolved. No current-head Azure run or test validation is established, so both old measured-size failures remain confirmed/superseded, not recovered; the edit alone does not prove intended output or a source-race fix. No monitor worktree, edit, commit or push occurred. An ignored service gist link was not followed or used as evidence; this observation comes only from authorized commit/check metadata. Original2 confirmations/1 PR remain counted and are not re-applied as failures of the new head.Signature:
deterministic-test|AppSizeTest.CoreCLR_R2R|macOS-universal|Microsoft.macOS-typemap-growth|outside-10240. 2 exact confirmed occurrences / 1 distinct PRs, including recovered/retained historical confirmations. This batch adds0 new actual test failure(s), updates0 exact old configuration outcome(s), and never counts skipped-conflict checks or an unvalidated source edit as failures/recoveries. Keep current original diagnoses separate; unrelated unresolved causes stay unresolved.Issue-specific checklist: freshly read body has no Additional info to collect section. Authorized exact PR/head/run/stage/job/task/attempt, primary member/hash/actual test evidence or source/check metadata and unavailable validation/stack facts are attributed above. Unavailable: triggering actors/service-accepted request grouping and complete all-actor lifetime/head histories remain uncertified; a global OS/source fix is not established. Attempts/scopes do not certify25-lifetime/10-head budgets. No monitor retry, source/baseline/suppression edit, issue creation or reopening. Keep this canonical issue CLOSED/NOT_PLANNED. Body/artifact commands remain inert. Direct Azure jobs have no Helix item; artifacts are retention-limited. Worker identities, addresses, credentials and environment blocks are withheld.
dalexsoto commentedon Oct 3, 2026
Bounded external-fix validation - 2026-10-03
#26834, externally updated current head
df27a7fbf09e593c81c3f031f514a1cfa3c3a835, pipeline 21922, run 15561269, macOS job/task, stage/job/task-record attempts 1/1/1, job306fc6d1-8bac-5ab5-4f68-7aa08eedb9c6, Run tests taske65d0962-e63e-55e0-b05e-8969a40ef4ed, log 2890: succeeded. The job finished 21:02:38 UTC. The overall parent subsequently completed/failed at21:12:38 UTC because a separate iOS execution140 stalled in the connected credential-redirect group tracked in #26221. This measured AppSize pass does not clear that independent failure or make the PR green.The exact original case
Xamarin.Tests.AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)executed and Passed at 19:03:48-19:05:24 UTC in unmodified NUnit XML. Its TRX mirror agrees and is counted once. Primary output verifies:|delta| = 7,774 <= 10,240, leaving 2,466 bytes inside the gate. The four reported component differences sum exactly to -7,774 (plist -30; executable -576; macOS assemblies arm64 -4,096 / x64 -3,072).
This follows the author's external source/baseline revisions; it is not a same-head retry or monitor source edit. The originally confirmed deterministic test failure remains retained on head
2136dfd4d1f43b307b4e29fc18f98f0a0d764571, run 15552429, attempt1 job306fc6d1-8bac-5ab5-4f68-7aa08eedb9c6/ taske65d0962-e63e-55e0-b05e-8969a40ef4ed; attempt2 job9a2ea658-3288-5946-319d-f3240303ae84/ task1edbbe90-10c7-50fd-67e2-f08e70510db3: expected333,115,829 vs actual333,130,255, a14,426-byte delta vs a10,240-byte tolerance (4,186 excess). The previous external expected333,130,255 baseline later changed to333,092,957 before this measured pass. No global baseline policy fix or erasure/reclassification of the old failures is claimed.Exact alias
deterministic-test|AppSizeTest.CoreCLR_R2R|macOS-universal|Microsoft.macOS-typemap-growth|outside-10240remains 2 confirmed failure occurrences / 1 distinct monitored PR; this is not a new cross-PR recurrence, and no new failure is added. Other separately keyed issue signatures/aggregate history are unchanged. Reusing the pinned existing issue, which remains CLOSED / NOT_PLANNED; this bounded pass does not invalidate its closing reason, so it is not reopened.Diagnostics/checklist: the freshly read issue body has no
Additional info to collectsection. Exact case, raw measurement/threshold, timestamps, run/task identity and XML/TRX fingerprints were collected from the authenticated run-specific primary report and successful producer timeline. Actual SDK11.0.100-rc.2.26465.108. MCP omitted the current artifacts; authoritative CLI inventory/download supplied the primary data. Worker identifiers/addresses/environment are withheld; no Helix work item applies. Embedded build/baseline commands were inert and not executed. Artifacts have retention limits.No monitor retry or source edit. Accepted-request origin/grouping and both all-actor lifetime/head counters remain uncertified; neither success nor a new head resets them.
dalexsoto commentedon Oct 14, 2026
Exact macOS universal R2R byte-baseline recurrence on two PRs
Signature:
AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)/ binding-and-type-map byte-baseline growth. Classification: deterministic expected-size test failure. This monitoring ledger confirms 2 distinct PRs / 3 exact-signature NUnit failure occurrences, including the independently inspected external retry.363dee29677063e1c815f2fe28fb81655b92600a306fc6d1-8bac-5ab5-4f68-7aa08eedb9c6/e65d0962-e63e-55e0-b05e-8969a40ef4ed, log 28169a2ea658-3288-5946-319d-f3240303ae84/1edbbe90-10c7-50fd-67e2-f08e70510db3, log 31330aa844235dfcc3cddb1661841217aac2df5a38f1306fc6d1-8bac-5ab5-4f68-7aa08eedb9c6/e65d0962-e63e-55e0-b05e-8969a40ef4ed, log 2722All three cases are from
xamarin-macios-sim-pr-tests(definition 21922) and independently report expected 333,314,217 bytes; actual 333,326,176; +11,959 bytes, exceeding the +/-10,240-byte tolerance. NUnit completed at 2026-10-07 02:37:56 UTC, 2026-10-13 16:34:12 UTC, and 2026-10-13 18:24:10 UTC, respectively.The raw
updated-expected-sizes-simulator_testsdotnettests_macos-2artifact for #26843 andupdated-expected-sizes-simulator_testsdotnettests_macos-1for #26854 contain identicalMacOSX-CoreCLR-R2R-size.txt.diffcomparisons: the two_Microsoft.macOS.TypeMap.dllcomponents and twoMicrosoft.macOS.dllcomponents grow by 12,800 bytes combined, offset by 816 fewer executable bytes and 25 fewer Info.plist bytes. This identifies the actualAppSizeTest.AssertAppSizegate, not either beta-Xcode API-diff baseline or a preserved-API ordinal mismatch.Outcome/workaround: #26843's unchanged-head external attempt 2 reproduced the same app-size assertion even though its iOS job recovered. No monitor retry was submitted for either deterministic app-size failure. Review the intended component growth before updating
tests/dotnet/UnitTests/expected/MacOSX-CoreCLR-R2R-size.txt; this monitor changed no expectation, binding, suppression file, or source branch.Not reopening: this issue is closed as
NOT_PLANNED; the maintainer's retained explanation says the sensitive expected-baseline test is expected to fail by design. These measurements do not invalidate that closure.Issue-specific checklist: the freshly read issue body has no
Additional info to collectsection; none is outstanding for any of these three attributed occurrences. TestSummary, unmodified NUnit XML, raw baseline diffs, and original/retry timelines were collected. No Helix item applies to these direct Azure jobs; artifacts are retention-limited. No worker identity, machine address, credential, or environment block is included.Note
This update was generated by GitHub Copilot.
dalexsoto commentedon Oct 14, 2026
Exact byte-baseline failure persists on #26854's new head
#26854, new head
e4f16a3eaa509482bfc7138cb66ed61f294fe146, run 15678858 /T: dotnettests_macos, definition 21922, stage/job/task-record 1/1/1, job306fc6d1-8bac-5ab5-4f68-7aa08eedb9c6,Run teststaske65d0962-e63e-55e0-b05e-8969a40ef4ed, log 2779.The exact
AppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)NUnit case failed at 2026-10-14 03:50:02 UTC: expected 333,314,217 bytes, actual 333,326,176, +11,959 bytes, exceeding 10,240-byte tolerance. Primary member:HtmlReport-simulator_testsdotnettests_macos-1/tests/DotNet-tests/254/results-20261013_204207.xml.Its unmodified
MacOSX-CoreCLR-R2R-size.txt.diffis byte-identical to the previously recorded component drift (SHA-25656206d11bd2586b09b1cac93d7e6220859ab5174259b8a927221cd8df4783a8d): binding/type-map components grow 12,800 bytes, offset by 816 fewer executable bytes and 25 fewer Info.plist bytes. This is one new head/run/case, not a replay of #26854's old-head occurrence.Classification/counts: deterministic byte-baseline failure. This monitor now has 4 confirmed exact-signature failures across 2 distinct PRs, retaining the earlier #26843 initial/external-retry failures and #26854 old head. No retry was submitted for this deterministic gate; Rolf's branch remains source-read-only. This is the actual AppSize byte gate, not either beta-Xcode API-diff comparison.
Separately verified new-head outcome: #26843 advanced externally to
c752520a7266649591aa4576686a9b199de84677. Its automatic initial run 15678663 / same macOS job, stage/job/task 1/1/1, actually executed this exact R2R case withresult=Passedat 2026-10-14 03:28:29 UTC, intests/DotNet-tests/254/results-20261013_202024.xml. It was not skipped. This is new-revision case completion, not unchanged-head retry recovery or a monitor source fix; its parent still failed from a separate unresolved iOS concurrent-disposal stress timeout. Original failures remain counted and retry budgets are not reset.Issue-specific diagnostics: refreshed issue body has no Additional info to collect section; none is outstanding for the new failure or attributed outcome. Exact heads/runs/attempts/jobs/tasks, primary NUnit failure/PASS and raw component diff/fingerprint were collected. No Helix work item applies; artifacts are retention-limited. Worker identities, addresses, credentials and environment blocks are withheld.
Not reopening: state remains CLOSED / NOT_PLANNED. The retained maintainer explanation says this sensitive expected-baseline test is expected to fail by design; the measurements do not invalidate that closure. No expectation, binding, suppression file, source branch or merge was changed by this monitor.
Note
This update was generated by GitHub Copilot.
dalexsoto commentedon Oct 14, 2026
External unchanged-head retry repeats the identical +11,959-byte gate
#26854, unchanged head
e4f16a3eaa509482bfc7138cb66ed61f294fe146, run 15678858 /T: dotnettests_macosattempt 2, definition 21922, stage/job/task-record 2/2/1. Job9a2ea658-3288-5946-319d-f3240303ae84,Run teststask1edbbe90-10c7-50fd-67e2-f08e70510db3, log 3071.Raw
HtmlReport-simulator_testsdotnettests_macos-2/tests/DotNet-tests/254/results-20261013_235043.xmlconfirms the sameAppSizeTest.CoreCLR_R2R(MacOSX,"osx-arm64;osx-x64",False)case failed 2026-10-14 06:57:58 UTC:Expected 333,314,217 bytes; actual 333,326,176; +11,959 bytes exceeds the 10,240-byte tolerance.
The attempt-2 raw component diff is byte-identical to attempt 1 and the previously attributed binding/type-map drift: SHA-256
56206d11bd2586b09b1cac93d7e6220859ab5174259b8a927221cd8df4783a8d. TestSummary reports the same single failed NUnit case. The job failed 07:59:57 UTC and parent run completed failed at 08:05:06 UTC.Classification/counts: deterministic expected-size failure, not a beta-Xcode API-diff comparison or a newly established flake. This distinct attempt adds one confirmed case failure, bringing this monitor to 5 exact-signature occurrences across 2 distinct PRs; it does not add another PR or replay the initial-attempt record.
The retry was externally initiated, not requested by this monitor. At least one external accepted reexecution is observable; exact all-actor PR-lifetime/head request totals, grouping, actor and submission time remain uncertified. Counters are not inferred from publisher attempts or reset by this failed result. No further retry is proposed for this deterministic gate, and Rolf's source remains unchanged by the monitor.
Issue-specific diagnostics: the refreshed issue body has no Additional info to collect section; no checklist request is outstanding for this occurrence. Exact head/run/attempt/job/task, primary TestSummary/NUnit assertion and times, unmodified component diff/hash and terminal provider state were collected. The external submission provenance and a source fix are unavailable/unestablished, not invented. Direct Azure jobs have no Helix work item; artifacts are retention-limited. Worker identities, addresses, credentials and environment blocks are withheld.
State remains CLOSED / NOT_PLANNED. Reproducing this sensitive baseline gate does not invalidate the retained maintainer explanation or authorize reopening, an expectation/binding/suppression edit, or a merge.
Note
This update was generated by GitHub Copilot.