[mobile] Enable NativeAOT library tests on Apple mobile platforms by kotlarmilos · Pull Request #125437 · dotnet/runtime

kotlarmilos · 2026-03-11T12:46:57Z

Description

Enables NativeAOT library tests on Apple mobile in extra platforms by wiring the trim+ILC step on the host build leg and consuming the produced static library in AppleAppBuilder library mode on the Helix.

Build flow

Host (build leg): publishes each test project with NativeLib=Static + CustomNativeMain=true, producing lib<TestAssembly>.a plus the staged ILC link inputs. eng/testing/tests.ioslike.targets is updated to set TestNativeAot/TestSingleFile/PublishAotUsingRuntimePack and to opt into _SuppressNativeLibEventSourceWarning for the static-library path.
Helix (proxy): src/mono/msbuild/apple/data/ProxyProjectForAOTOnHelix.proj no longer re-runs ILC on the agent. It detects the prebuilt static library via the new _NativeAotLibraryTestOnHelix property, replaces _AppleNativeAotCompile in $(AppleBuildDependsOn) with _StageNativeAotLinkInputsOnHelix, and unconditionally adds DirectPInvoke __Internal so the AppleAppBuilder-generated objc symbols (mono_ios_set_summary, …) are statically resolved by ILC.

Pipelines

runtime.yml keeps the existing AllSubsets_NativeAOT_Smoke legs for iOS device + maccatalyst arm64, runs System.Runtime.Tests plus iOS functional tests.
eng/pipelines/extra-platforms/runtime-extra-platforms-{ioslike,ioslikesimulator,maccatalyst}.yml add AllSubsets_NativeAOT[_AppSandbox] legs. They run a curated subset of library tests: System.Runtime, System.Collections, System.Linq, System.Threading, System.Threading.Tasks, System.Net.Http.Functional.

Depends on dotnet/xharness#1554
Fixes #81075

Replace NativeAOT runtime test legs with library test legs on iOS/tvOS devices, iOS/tvOS simulators, and Mac Catalyst. The runtime tests (nativeaot/SmokeTests) provide minimal value on mobile since the compiler doesn't meaningfully distinguish between iOS and macOS. Library tests exercise OS-specific APIs (crypto, networking, etc.) that are the real quality gate. Changes: - ioslike: remove NativeAOT runtime test leg, update existing library test leg to use dynamic smoke test arg - ioslikesimulator: replace NativeAOT runtime test leg with library test leg, fix isiOSLikeSimulatorOnlyBuild parameter - maccatalyst: replace both NativeAOT runtime test legs (regular + AppSandbox) with library test legs, fix coreclrContainsChange variable (was incorrectly using monoContainsChange) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot

Pull request overview

This PR updates the Apple “extra platforms” CI legs to validate NativeAOT on iOS/tvOS devices, iOS/tvOS simulators, and Mac Catalyst by running libraries tests (via Helix) instead of the minimal NativeAOT runtime SmokeTests, improving OS-specific coverage (crypto/networking/globalization) on mobile.

Changes:

Switch NativeAOT Apple-mobile legs from runtime SmokeTests submission to eng/pipelines/libraries/helix.yml submission of libraries tests.
Use eng/pipelines/libraries/helix-queues-setup.yml and pass NeedsToBuildAppsOnHelix=true for the new legs.
Update naming/args to use $(_runSmokeTestsOnlyArg) and fix path-evaluation variable naming in affected legs.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File	Description
eng/pipelines/extra-platforms/runtime-extra-platforms-maccatalyst.yml	Replaces NativeAOT runtime SmokeTests legs with libraries test legs (including App Sandbox variant) using libraries Helix templates/queues.
eng/pipelines/extra-platforms/runtime-extra-platforms-ioslikesimulator.yml	Replaces NativeAOT runtime SmokeTests on iOS/tvOS simulators with libraries tests using libraries Helix templates/queues.
eng/pipelines/extra-platforms/runtime-extra-platforms-ioslike.yml	Adjusts NativeAOT iOS/tvOS device leg to use `$(_runSmokeTestsOnlyArg)` for libraries tests and removes the old NativeAOT runtime SmokeTests device leg.

You can also share your feedback on Copilot code review. Take the survey.

…60312.1 On relative base path root Microsoft.DotNet.XHarness.CLI , Microsoft.DotNet.XHarness.TestRunners.Common , Microsoft.DotNet.XHarness.TestRunners.Xunit From Version 11.0.0-prerelease.26160.2 -> To Version 11.0.0-prerelease.26162.1

…60312.3 On relative base path root Microsoft.DotNet.XHarness.CLI , Microsoft.DotNet.XHarness.TestRunners.Common , Microsoft.DotNet.XHarness.TestRunners.Xunit From Version 11.0.0-prerelease.26160.2 -> To Version 11.0.0-prerelease.26162.3

…60314.3 On relative base path root Microsoft.DotNet.XHarness.CLI , Microsoft.DotNet.XHarness.TestRunners.Common , Microsoft.DotNet.XHarness.TestRunners.Xunit From Version 11.0.0-prerelease.26160.2 -> To Version 11.0.0-prerelease.26164.3

…60317.2 On relative base path root Microsoft.DotNet.XHarness.CLI , Microsoft.DotNet.XHarness.TestRunners.Common , Microsoft.DotNet.XHarness.TestRunners.Xunit From Version 11.0.0-prerelease.26160.2 -> To Version 11.0.0-prerelease.26167.2

…60318.1 On relative base path root Microsoft.DotNet.XHarness.CLI , Microsoft.DotNet.XHarness.TestRunners.Common , Microsoft.DotNet.XHarness.TestRunners.Xunit From Version 11.0.0-prerelease.26160.2 -> To Version 11.0.0-prerelease.26168.1

…bb6-53258cb4f260' into enable-nativeaot-libs-tests-mobile

Copilot

Pull request overview

Copilot reviewed 6 out of 6 changed files in this pull request and generated no new comments.

You can also share your feedback on Copilot code review. Take the survey.

azure-pipelines · 2026-05-20T13:04:09Z

Azure Pipelines successfully started running 1 pipeline(s).

MichalStrehovsky · 2026-05-20T22:04:54Z

+    <TrimmerRootAssembly Include="Microsoft.DotNet.XUnitExtensions" />
+    <TrimmerRootAssembly Include="xunit.core" />
+    <TrimmerRootDescriptor Include="$(MSBuildThisFileDirectory)ILLink.Descriptor.xunit.xml" />


What breaks without this? With "Is this needed?" I meant that I don't understand the platform difference here. Rooting less stuff means faster CI and faster compile times and being closer to user scenarios.

Desktop NativeAOT uses TrimMode=partial, so xunit aren't trimmable packages and stay intact. Mobile NativeAOT uses TrimMode=link to match the shipping configuration.

AppleTestRunner: set CurrentDirectory to AppContext.BaseDirectory at startup. On the Mono path mono_ios_runtime_init redirects CWD to the bundle root; on NativeAOT we don't have that fixup, so test data shipped alongside the test assemblies (via Content/CopyToOutputDirectory) isn't reachable via relative paths and DirectoryNotFoundException is thrown for paths like '/TestData/...', '/UncompressedTestFiles/...'. This fixes ~10 'test data not bundled' failures across: Microsoft.Bcl.Cryptography, Microsoft.Extensions.Hosting.Unit, System.Data.DataSetExtensions, System.Diagnostics.FileVersionInfo, System.IO.Compression{,.Brotli,.ZipFile}, System.IO.Packaging, System.Net.HttpListener, System.Net.NetworkInformation.Functional, System.Resources.ResourceManager. tests.proj: drop those exclusions, drop the tvos-only entries that were excluded due to device infra flakes (PACKAGE_INSTALLATION_FAILURE, APP_NOT_SIGNED, APP_LAUNCH_TIMEOUT - see helix job 328c0bc1-9e81-4725-9804-11cf937fe8c0 in build 1428144). Keep only the 4 real failure categories: EventSource tests requiring EventSourceSupport=true (2) and Apple-mobile behavioural differences (2). Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

kotlarmilos · 2026-05-21T10:26:54Z

/azp run runtime-extra-platforms

azure-pipelines · 2026-05-21T10:27:10Z

Azure Pipelines successfully started running 1 pipeline(s).

The desktop NativeAOT smoke set (11 projects, incl. System.IO.FileSystem and System.IO.Compression) was previously gated only on TestNativeAot. Now that tests.proj derives TestNativeAot for Apple-mobile, this set started running on the Apple-mobile NativeAOT_Smoke legs and surfaced preexisting failures (e.g. FileSystem UnixFileMode SetUser/SetGroup denied by iOS sandbox). Add 'TargetsAppleMobile != true' to keep the Apple-mobile smoke leg at the existing 'System.Runtime.Tests + iOS functional tests' set. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

kotlarmilos · 2026-05-21T11:48:21Z

/azp run runtime-extra-platforms

azure-pipelines · 2026-05-21T11:48:36Z

Azure Pipelines successfully started running 1 pipeline(s).

Mac Catalyst bundles binaries in .app/Contents/MacOS but test content (via Content/CopyToOutputDirectory) lands in .app/Contents/Resources. chdir(AppContext.BaseDirectory) lands in MacOS where the data isn't, so paths like 'ZLibTestData/foo' still resolve to a missing path. Detect the sibling Resources directory and chdir there when present; iOS/tvOS/simulators stay on AppContext.BaseDirectory. Confirmed via build 1429871 that the chdir-only fix made System.IO.Compression.Tests pass on iossim (1451/1451) but failed on maccatalyst because of this layout difference. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

kotlarmilos · 2026-05-22T11:22:06Z

/azp run runtime-extra-platforms

azure-pipelines · 2026-05-22T11:22:27Z

Azure Pipelines successfully started running 1 pipeline(s).

@jkotas

Address @jkotas review feedback. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

kotlarmilos · 2026-05-28T14:02:10Z

/azp run runtime-extra-platforms

azure-pipelines · 2026-05-28T14:02:28Z

Azure Pipelines successfully started running 1 pipeline(s).

Replace the blanket .json exclusion in the NativeAOT bundler path with specific publish-metadata suffixes (.deps.json, .runtimeconfig.json, .runtimeconfig.dev.json). Content files like appSettings.json now flow through to the .app/ bundle, fixing CanConfigureAppConfigurationFromFile and similar tests in Microsoft.Extensions.Hosting.Unit.Tests on iOS, tvOS, and MacCatalyst NativeAOT. The .dll exclusion is left in place because NativeAOT publish output contains ILC intermediate .dll files that legitimately shouldn't be bundled; separating content .dll from intermediate .dll requires a broader publish-folder refactor (per the existing TODO). Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot AI review requested due to automatic review settings March 11, 2026 12:46

github-actions Bot added the area-Infrastructure-mono label Mar 11, 2026

dotnet-policy-service Bot assigned kotlarmilos Mar 11, 2026

Copilot started reviewing on behalf of kotlarmilos March 11, 2026 12:47 View session

kotlarmilos added area-Infrastructure-coreclr Only use for closed issues os-ios Apple iOS and removed area-Infrastructure-mono labels Mar 11, 2026

github-project-automation Bot added this to Runtime Infra Mar 11, 2026

kotlarmilos requested review from MichalStrehovsky, jkoritzinsky, matouskozak and vitek-karas March 11, 2026 12:50

Copilot AI reviewed Mar 11, 2026

View reviewed changes

Comment thread eng/pipelines/extra-platforms/runtime-extra-platforms-ioslikesimulator.yml

matouskozak approved these changes Mar 11, 2026

View reviewed changes

build-analysis Bot mentioned this pull request Mar 11, 2026

slow macOS - "##[error]The job running on agent Azure Pipelines 9 ran longer than the maximum time of 60 minutes." dotnet/dnceng#1883

Open

3 tasks

jkoritzinsky approved these changes Mar 11, 2026

View reviewed changes

dotnet-maestro Bot and others added 5 commits March 12, 2026 10:30

Merge branch 'main' into enable-nativeaot-libs-tests-mobile

9e2a877

This was referenced Mar 17, 2026

XHarness package install failure on iOS due to devicectl NSPOSIXErrorDomain error 49 #123796

Open

MsQuic fails with QUIC_STATUS_OUT_OF_MEMORY on AzureLinux #123216

Closed

kotlarmilos marked this pull request as draft March 18, 2026 12:57

Merge remote-tracking branch 'upstream/darc-main-98c14788-b6c2-47d8-8…

98a831a

…bb6-53258cb4f260' into enable-nativeaot-libs-tests-mobile

Copilot AI review requested due to automatic review settings March 18, 2026 13:02

Copilot started reviewing on behalf of kotlarmilos March 18, 2026 13:03 View session

Copilot AI reviewed Mar 18, 2026

View reviewed changes

Copilot AI mentioned this pull request May 20, 2026

Relax localhost subdomain address-family checks on Android/AppleMobile #128404

Closed

This was referenced May 20, 2026

[ci-scan] Test failure: TpaLoadFailureTest on iossimulator - No exception thrown #128406

Closed

[ci-scan] Test failure: HostTests on iossimulator - Castle.DynamicProxy IndexOutOfRangeException #128405

Open

Copilot AI mentioned this pull request May 20, 2026

Disable TpaLoadFailureTest cases on mobile platforms #128417

Merged

MichalStrehovsky reviewed May 20, 2026

View reviewed changes

jkotas reviewed May 21, 2026

View reviewed changes

Comment thread src/libraries/Common/tests/AppleTestRunner/AppleTestRunner.cs Outdated

This was referenced May 22, 2026

Re-enable localhost loopback assertions on Apple mobile and Android #128480

Closed

Disable Validate.csproj build under Mono FullAOT to fix CS0246 #128481

Open

This was referenced May 22, 2026

[ci-scan] Test failure: CustomAttributeDecoderTests.TestCustomAttributeDecoderGenericUsingReflection on maccatalyst #128450

Open

[ci-scan] Test failure: CryptoStreamTests.ReadWrite_Success MemberData not found on maccatalyst #128451

Open

AppleTestRunner: drop Mono reference from CWD comment

a36569d

Address @jkotas review feedback. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

This was referenced May 29, 2026

DnsGetHostAddresses_LocalhostWithTrailingDot_ReturnsLoopback - SocketException : Name or service not known #128759

Open

MSBuild crashing in the build #92290

Open

Helix: System.IO.IOException: No space left on device #128758

Open

Conversation

kotlarmilos commented Mar 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Build flow

Pipelines

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

azure-pipelines Bot commented May 20, 2026

Uh oh!

MichalStrehovsky May 20, 2026

Choose a reason for hiding this comment

Uh oh!

kotlarmilos May 28, 2026

Choose a reason for hiding this comment

Uh oh!

kotlarmilos commented May 21, 2026

Uh oh!

azure-pipelines Bot commented May 21, 2026

Uh oh!

kotlarmilos commented May 21, 2026

Uh oh!

azure-pipelines Bot commented May 21, 2026

Uh oh!

Uh oh!

kotlarmilos commented May 22, 2026

Uh oh!

azure-pipelines Bot commented May 22, 2026

Uh oh!

kotlarmilos commented May 28, 2026

Uh oh!

azure-pipelines Bot commented May 28, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

kotlarmilos commented Mar 11, 2026 •

edited

Loading