[6.0] Android test failure: Failed to install mobile app

[carlossanlop]

Found in the internal->public merge PR for 6.0: #83404

Lots of tests affected by the exact same failure message.

• Queue: Build Android x64 Release AllSubsets_Mono_RuntimeTests
• Job: https://dev.azure.com/dnceng-public/public/_build/results?buildId=204115&view=logs&j=b6f63eff-75cc-59ca-fdbf-d2121601a613&t=92df95dc-ad7c-5fec-a8b4-c8301b7a2225
• Log file example: https://helixre107v0xd1eu3ibi6ka.blob.core.windows.net/dotnet-runtime-refs-pull-83404-merge-a043263a5a864fcdaa/JIT/1/console.22d84e79.log?helixlogtype=result
• Callstack:

Microsoft.DotNet.XUnitConsoleRunner v2.5.0 (64-bit .NET 6.0.14)
  Discovering: JIT.opt.XUnitWrapper (method display = ClassAndMethod, method display options = None)
  Discovered:  JIT.opt.XUnitWrapper (found 80 test cases)
  Starting:    JIT.opt.XUnitWrapper (parallel test collections = off, max threads = 2)
    JIT/opt/AssertionPropagation/ArrBoundBinaryOp/ArrBoundBinaryOp.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/AssertionPropagation/ArrBoundMinLength/ArrBoundMinLength.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/AssertionPropagation/ArrBoundUnsigned/ArrBoundUnsigned.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/Casts/shared/shared.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----

...
and goes on and on...

{
  "ErrorMessage": "The following constructor parameters did not have matching fixture data: _Global globalVar",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Report

Build	Repository	Test	Pull Request
1581470	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1581235	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1579251	dotnet/runtime	PayloadGroup0.WorkItemExecution
1576881	dotnet/runtime	PayloadGroup0.WorkItemExecution
1570294	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	4	5

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 6/28/2023 6:30:52 PM UTC

Tagging subscribers to 'arch-android': @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Found in the internal->public merge PR for 6.0: #83404

Lots of tests affected by the exact same failure message.

• Queue: Build Android x64 Release AllSubsets_Mono_RuntimeTests
• Job: https://dev.azure.com/dnceng-public/public/_build/results?buildId=204115&view=logs&j=b6f63eff-75cc-59ca-fdbf-d2121601a613&t=92df95dc-ad7c-5fec-a8b4-c8301b7a2225
• Log file example: https://helixre107v0xd1eu3ibi6ka.blob.core.windows.net/dotnet-runtime-refs-pull-83404-merge-a043263a5a864fcdaa/JIT/1/console.22d84e79.log?helixlogtype=result
• Callstack:

Microsoft.DotNet.XUnitConsoleRunner v2.5.0 (64-bit .NET 6.0.14)
  Discovering: JIT.opt.XUnitWrapper (method display = ClassAndMethod, method display options = None)
  Discovered:  JIT.opt.XUnitWrapper (found 80 test cases)
  Starting:    JIT.opt.XUnitWrapper (parallel test collections = off, max threads = 2)
    JIT/opt/AssertionPropagation/ArrBoundBinaryOp/ArrBoundBinaryOp.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/AssertionPropagation/ArrBoundMinLength/ArrBoundMinLength.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/AssertionPropagation/ArrBoundUnsigned/ArrBoundUnsigned.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/Casts/shared/shared.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----

...
and goes on and on...

{
  "ErrorMessage": "The following constructor parameters did not have matching fixture data: _Global globalVar",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Author:	carlossanlop
Assignees:	-
Labels:	arch-x64, os-android, area-VM-meta-mono
Milestone:	-

[steveisok]

@fanyang-mono does this happen in main as well?

[fanyang-mono]

@steveisok No I haven't seen apps failing to install for quite a while, since we introduced recovery mechanism. I checked that that code doesn't exit in release/6.0 branch.

Comparing
https://github.com/dotnet/runtime/blob/release/6.0/src/tests/Common/Coreclr.TestWrapper/MobileAppHandler.cs
and
https://github.com/dotnet/runtime/blob/main/src/tests/Common/Coreclr.TestWrapper/MobileAppHandler.cs

I am not sure if helix support that feature for 6.0. @premun

[premun]

Seems like the version of Arcade on the 6.0 branch does have this backported: https://github.com/dotnet/arcade/blob/0c93c1cb1ef9c9d5c1a59f4ab98c2f7e37f12197/src/Microsoft.DotNet.Helix/Sdk/tools/xharness-runner/xharness-runner.apple.sh

[fanyang-mono]

Seems like the version of Arcade on the 6.0 branch does have this backported: https://github.com/dotnet/arcade/blob/0c93c1cb1ef9c9d5c1a59f4ab98c2f7e37f12197/src/Microsoft.DotNet.Helix/Sdk/tools/xharness-runner/xharness-runner.apple.sh

I assume that the functionality for Android is backported as well?

[premun]

For Helix SDK, everything would be backported together

[carlossanlop]

Seen again in the latest 6.0 dependency flow PR: #83513

• Queue: Build Android x64 Release AllSubsets_Mono_RuntimeTests
• Job: https://dev.azure.com/dnceng-public/public/_build/results?buildId=211182&view=logs&j=b6f63eff-75cc-59ca-fdbf-d2121601a613&t=92df95dc-ad7c-5fec-a8b4-c8301b7a2225
• Log: https://helixre107v0xd1eu3ibi6ka.blob.core.windows.net/dotnet-runtime-refs-pull-83513-merge-e97b6a304a96472ea2/JIT.Methodical.eh/1/console.74b538d3.log?helixlogtype=result

Starting:    JIT.Methodical.XUnitWrapper (parallel test collections = off, max threads = 2)
    JIT/Methodical/eh/basics/emptyfinally_d/emptyfinally_d.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_Methodical._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/Methodical/eh/basics/multihandler_d/multihandler_d.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_Methodical._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----