Skip to content

Commit fc547fb

Browse files
thomhurstgithub-actions[bot]
thomhurst
authored and
github-actions[bot]
committed
chore: update benchmark results
1 parent e863cbb commit fc547fb

19 files changed

Lines changed: 470 additions & 368 deletions

‎README.md‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -61,14 +61,14 @@ Source generation shifts work from run time to build time: you pay a little up f
6161
<!-- benchmarks:start -->
6262
| Scenario | TUnit (AOT) | TUnit | xUnit v3 | NUnit | MSTest |
6363
|----------|---|---|---|---|---|
64-
| Data-driven tests | 13.53 ms | 318.76 ms | 680.19 ms | 540.84 ms | 577.30 ms |
65-
| Async-heavy tests | 118.5 ms | 437.3 ms | 906.6 ms | 653.1 ms | 724.2 ms |
66-
| Matrix combinations | 117.8 ms | 436.2 ms | 1,677.9 ms | 1,471.3 ms | 1,547.8 ms |
67-
| Large suites (scale) | 19.74 ms | 349.50 ms | 752.17 ms | 581.67 ms | 577.69 ms |
68-
| Massive parallelism | 218.0 ms | 566.0 ms | 3,101.4 ms | 1,151.5 ms | 3,028.4 ms |
69-
| Setup/teardown lifecycle | 66.91 ms | 355.61 ms | 1,292.08 ms | 1,045.37 ms | 1,104.79 ms |
70-
71-
<sub>Mean wall-clock time to run the same test suite. TUnit (AOT) 1.65.0 · TUnit 1.65.0 · xUnit v3 4.0.0 · NUnit 4.6.1 · MSTest 4.3.3. .NET SDK 10.0.400, .NET 10.0.11 (10.0.11, 10.0.1126.37416), X64 RyuJIT x86-64-v4. Updated 2026-08-16 — regenerated weekly by the [Speed Comparison workflow](https://github.com/thomhurst/TUnit/actions/workflows/speed-comparison.yml). Full results and methodology: [tunit.dev/docs/benchmarks](https://tunit.dev/docs/benchmarks/).</sub>
64+
| Data-driven tests | 17.72 ms | 358.40 ms | 667.29 ms | 570.46 ms | 545.91 ms |
65+
| Async-heavy tests | 118.3 ms | 415.9 ms | 802.7 ms | 588.7 ms | 672.9 ms |
66+
| Matrix combinations | 120.0 ms | 457.6 ms | 926.6 ms | 1,588.2 ms | 1,638.5 ms |
67+
| Large suites (scale) | 22.19 ms | 343.40 ms | 725.09 ms | 551.49 ms | 549.90 ms |
68+
| Massive parallelism | 221.8 ms | 537.0 ms | 1,384.1 ms | 1,134.8 ms | 3,085.7 ms |
69+
| Setup/teardown lifecycle | 66.39 ms | 350.34 ms | 758.64 ms | 1,024.36 ms | 1,116.57 ms |
70+
71+
<sub>Mean wall-clock time to run the same test suite. TUnit (AOT) 1.65.0 · TUnit 1.65.0 · xUnit v3 4.0.0 · NUnit 4.6.1 · MSTest 4.3.3. .NET SDK 10.0.400, .NET 10.0.11 (10.0.11, 10.0.1126.37416), X64 RyuJIT x86-64-v4. Updated 2026-08-17 — regenerated weekly by the [Speed Comparison workflow](https://github.com/thomhurst/TUnit/actions/workflows/speed-comparison.yml). Full results and methodology: [tunit.dev/docs/benchmarks](https://tunit.dev/docs/benchmarks/).</sub>
7272
<!-- benchmarks:end -->
7373

7474
## Getting Started

‎docs/docs/benchmarks/engine/AsyncTests.md‎

Lines changed: 12 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ sidebar_position: 3
99
> Realistic async/await patterns with I/O simulation
1010
1111
:::info Last Updated
12-
This benchmark was automatically generated on **2026-08-16** from the latest CI run.
12+
This benchmark was automatically generated on **2026-08-17** from the latest CI run.
1313

1414
**Environment:** Ubuntu Latest • .NET SDK 10.0.400
1515
:::
@@ -18,11 +18,12 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
1818

1919
| Framework | Version | Mean | Median | StdDev |
2020
|-----------|---------|------|--------|--------|
21-
| **TUnit** | 1.65.0 | 437.3 ms | 431.8 ms | 39.79 ms |
22-
| NUnit | 4.6.1 | 653.1 ms | 655.6 ms | 60.47 ms |
23-
| MSTest | 4.3.3 | 724.2 ms | 726.6 ms | 42.51 ms |
24-
| xUnit3 | 4.0.0 | 906.6 ms | 906.0 ms | 45.02 ms |
25-
| **TUnit (AOT)** | 1.65.0 | 118.5 ms | 118.3 ms | 1.24 ms |
21+
| **TUnit** | 1.65.0 | 415.9 ms | 406.8 ms | 30.53 ms |
22+
| NUnit | 4.6.1 | 588.7 ms | 589.5 ms | 6.23 ms |
23+
| MSTest | 4.3.3 | 672.9 ms | 671.4 ms | 7.38 ms |
24+
| xUnit3 | 4.0.0 | 802.7 ms | 767.0 ms | 92.97 ms |
25+
| **TUnit (AOT)** | 1.65.0 | 118.3 ms | 118.3 ms | 0.78 ms |
26+
| xUnit3_AOT | 4.0.0 | 128.7 ms | 128.5 ms | 0.87 ms |
2627

2728
## 📈 Visual Comparison
2829

@@ -59,19 +60,19 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
5960
}}%%
6061
xychart-beta
6162
title "AsyncTests Performance Comparison"
62-
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
63-
y-axis "Time (ms)" 0 --> 1088
64-
bar [437.3, 653.1, 724.2, 906.6, 118.5]
63+
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT", "xUnit3_AOT"]
64+
y-axis "Time (ms)" 0 --> 964
65+
bar [415.9, 588.7, 672.9, 802.7, 118.3, 128.7]
6566
```
6667

6768
## 🎯 Key Insights
6869

69-
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using identical test scenarios.
70+
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3, xUnit3_AOT using identical test scenarios.
7071

7172
---
7273

7374
:::note Methodology
7475
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
7576
:::
7677

77-
*Last generated: 2026-08-16T00:18:52.418Z*
78+
*Last generated: 2026-08-17T16:25:00.424Z*

‎docs/docs/benchmarks/engine/BuildTime.md‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ sidebar_position: 9
99
> Compilation time from a clean build across frameworks — how long it takes to build an identical test project.
1010
1111
:::info Last Updated
12-
This benchmark was automatically generated on **2026-08-16** from the latest CI run.
12+
This benchmark was automatically generated on **2026-08-17** from the latest CI run.
1313

1414
**Environment:** Ubuntu Latest • .NET SDK 10.0.400
1515
:::
@@ -20,10 +20,10 @@ Compilation time comparison across frameworks:
2020

2121
| Framework | Version | Mean | Median | StdDev |
2222
|-----------|---------|------|--------|--------|
23-
| **TUnit** | 1.65.0 | 1,022.9 ms | 1,015.7 ms | 54.92 ms |
24-
| Build_NUnit | 4.6.1 | 914.6 ms | 915.7 ms | 6.63 ms |
25-
| Build_MSTest | 4.3.3 | 1,115.7 ms | 1,115.6 ms | 52.23 ms |
26-
| Build_xUnit3 | 4.0.0 | 929.3 ms | 926.6 ms | 12.60 ms |
23+
| **TUnit** | 1.65.0 | 995.0 ms | 986.3 ms | 47.43 ms |
24+
| Build_NUnit | 4.6.1 | 945.9 ms | 937.1 ms | 56.25 ms |
25+
| Build_MSTest | 4.3.3 | 1,220.5 ms | 1,228.3 ms | 84.45 ms |
26+
| Build_xUnit3 | 4.0.0 | 938.7 ms | 897.0 ms | 87.80 ms |
2727

2828
## 📈 Visual Comparison
2929

@@ -61,8 +61,8 @@ Compilation time comparison across frameworks:
6161
xychart-beta
6262
title "Build Time Comparison"
6363
x-axis ["Build_TUnit", "Build_NUnit", "Build_MSTest", "Build_xUnit3"]
64-
y-axis "Time (ms)" 0 --> 1339
65-
bar [1022.9, 914.6, 1115.7, 929.3]
64+
y-axis "Time (ms)" 0 --> 1465
65+
bar [995, 945.9, 1220.5, 938.7]
6666
```
6767

6868
---
@@ -71,4 +71,4 @@ xychart-beta
7171
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
7272
:::
7373

74-
*Last generated: 2026-08-16T00:18:52.420Z*
74+
*Last generated: 2026-08-17T16:25:00.426Z*

‎docs/docs/benchmarks/engine/DataDrivenTests.md‎

Lines changed: 12 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ sidebar_position: 4
99
> Parameterized tests with multiple data sources
1010
1111
:::info Last Updated
12-
This benchmark was automatically generated on **2026-08-16** from the latest CI run.
12+
This benchmark was automatically generated on **2026-08-17** from the latest CI run.
1313

1414
**Environment:** Ubuntu Latest • .NET SDK 10.0.400
1515
:::
@@ -18,11 +18,12 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
1818

1919
| Framework | Version | Mean | Median | StdDev |
2020
|-----------|---------|------|--------|--------|
21-
| **TUnit** | 1.65.0 | 318.76 ms | 312.55 ms | 15.439 ms |
22-
| NUnit | 4.6.1 | 540.84 ms | 535.88 ms | 30.877 ms |
23-
| MSTest | 4.3.3 | 577.30 ms | 574.52 ms | 30.305 ms |
24-
| xUnit3 | 4.0.0 | 680.19 ms | 676.84 ms | 51.572 ms |
25-
| **TUnit (AOT)** | 1.65.0 | 13.53 ms | 13.47 ms | 0.228 ms |
21+
| **TUnit** | 1.65.0 | 358.40 ms | 356.20 ms | 29.202 ms |
22+
| NUnit | 4.6.1 | 570.46 ms | 566.19 ms | 35.441 ms |
23+
| MSTest | 4.3.3 | 545.91 ms | 542.10 ms | 39.329 ms |
24+
| xUnit3 | 4.0.0 | 667.29 ms | 663.44 ms | 45.522 ms |
25+
| **TUnit (AOT)** | 1.65.0 | 17.72 ms | 17.72 ms | 1.853 ms |
26+
| xUnit3_AOT | 4.0.0 | 21.10 ms | 20.77 ms | 1.486 ms |
2627

2728
## 📈 Visual Comparison
2829

@@ -59,19 +60,19 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
5960
}}%%
6061
xychart-beta
6162
title "DataDrivenTests Performance Comparison"
62-
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
63-
y-axis "Time (ms)" 0 --> 817
64-
bar [318.76, 540.84, 577.3, 680.19, 13.53]
63+
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT", "xUnit3_AOT"]
64+
y-axis "Time (ms)" 0 --> 801
65+
bar [358.4, 570.46, 545.91, 667.29, 17.72, 21.1]
6566
```
6667

6768
## 🎯 Key Insights
6869

69-
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using identical test scenarios.
70+
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3, xUnit3_AOT using identical test scenarios.
7071

7172
---
7273

7374
:::note Methodology
7475
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
7576
:::
7677

77-
*Last generated: 2026-08-16T00:18:52.418Z*
78+
*Last generated: 2026-08-17T16:25:00.424Z*

‎docs/docs/benchmarks/engine/MassiveParallelTests.md‎

Lines changed: 12 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ sidebar_position: 5
99
> Parallel execution stress tests
1010
1111
:::info Last Updated
12-
This benchmark was automatically generated on **2026-08-16** from the latest CI run.
12+
This benchmark was automatically generated on **2026-08-17** from the latest CI run.
1313

1414
**Environment:** Ubuntu Latest • .NET SDK 10.0.400
1515
:::
@@ -18,11 +18,12 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
1818

1919
| Framework | Version | Mean | Median | StdDev |
2020
|-----------|---------|------|--------|--------|
21-
| **TUnit** | 1.65.0 | 566.0 ms | 565.5 ms | 41.65 ms |
22-
| NUnit | 4.6.1 | 1,151.5 ms | 1,136.4 ms | 40.23 ms |
23-
| MSTest | 4.3.3 | 3,028.4 ms | 3,010.5 ms | 33.46 ms |
24-
| xUnit3 | 4.0.0 | 3,101.4 ms | 3,095.4 ms | 27.30 ms |
25-
| **TUnit (AOT)** | 1.65.0 | 218.0 ms | 217.2 ms | 1.54 ms |
21+
| **TUnit** | 1.65.0 | 537.0 ms | 536.9 ms | 21.20 ms |
22+
| NUnit | 4.6.1 | 1,134.8 ms | 1,126.3 ms | 21.66 ms |
23+
| MSTest | 4.3.3 | 3,085.7 ms | 3,082.5 ms | 36.57 ms |
24+
| xUnit3 | 4.0.0 | 1,384.1 ms | 1,374.8 ms | 60.88 ms |
25+
| **TUnit (AOT)** | 1.65.0 | 221.8 ms | 221.8 ms | 1.14 ms |
26+
| xUnit3_AOT | 4.0.0 | 677.9 ms | 677.9 ms | 3.03 ms |
2627

2728
## 📈 Visual Comparison
2829

@@ -59,19 +60,19 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
5960
}}%%
6061
xychart-beta
6162
title "MassiveParallelTests Performance Comparison"
62-
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
63-
y-axis "Time (ms)" 0 --> 3722
64-
bar [566, 1151.5, 3028.4, 3101.4, 218]
63+
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT", "xUnit3_AOT"]
64+
y-axis "Time (ms)" 0 --> 3703
65+
bar [537, 1134.8, 3085.7, 1384.1, 221.8, 677.9]
6566
```
6667

6768
## 🎯 Key Insights
6869

69-
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using identical test scenarios.
70+
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3, xUnit3_AOT using identical test scenarios.
7071

7172
---
7273

7374
:::note Methodology
7475
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
7576
:::
7677

77-
*Last generated: 2026-08-16T00:18:52.418Z*
78+
*Last generated: 2026-08-17T16:25:00.424Z*

‎docs/docs/benchmarks/engine/MatrixTests.md‎

Lines changed: 12 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ sidebar_position: 6
99
> Combinatorial test generation and execution
1010
1111
:::info Last Updated
12-
This benchmark was automatically generated on **2026-08-16** from the latest CI run.
12+
This benchmark was automatically generated on **2026-08-17** from the latest CI run.
1313

1414
**Environment:** Ubuntu Latest • .NET SDK 10.0.400
1515
:::
@@ -18,11 +18,12 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
1818

1919
| Framework | Version | Mean | Median | StdDev |
2020
|-----------|---------|------|--------|--------|
21-
| **TUnit** | 1.65.0 | 436.2 ms | 430.7 ms | 28.73 ms |
22-
| NUnit | 4.6.1 | 1,471.3 ms | 1,461.4 ms | 35.30 ms |
23-
| MSTest | 4.3.3 | 1,547.8 ms | 1,538.3 ms | 24.02 ms |
24-
| xUnit3 | 4.0.0 | 1,677.9 ms | 1,673.5 ms | 17.25 ms |
25-
| **TUnit (AOT)** | 1.65.0 | 117.8 ms | 117.7 ms | 0.34 ms |
21+
| **TUnit** | 1.65.0 | 457.6 ms | 457.0 ms | 24.40 ms |
22+
| NUnit | 4.6.1 | 1,588.2 ms | 1,580.9 ms | 23.63 ms |
23+
| MSTest | 4.3.3 | 1,638.5 ms | 1,641.1 ms | 32.81 ms |
24+
| xUnit3 | 4.0.0 | 926.6 ms | 918.2 ms | 38.85 ms |
25+
| **TUnit (AOT)** | 1.65.0 | 120.0 ms | 119.9 ms | 1.20 ms |
26+
| xUnit3_AOT | 4.0.0 | 274.5 ms | 273.8 ms | 2.76 ms |
2627

2728
## 📈 Visual Comparison
2829

@@ -59,19 +60,19 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
5960
}}%%
6061
xychart-beta
6162
title "MatrixTests Performance Comparison"
62-
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
63-
y-axis "Time (ms)" 0 --> 2014
64-
bar [436.2, 1471.3, 1547.8, 1677.9, 117.8]
63+
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT", "xUnit3_AOT"]
64+
y-axis "Time (ms)" 0 --> 1967
65+
bar [457.6, 1588.2, 1638.5, 926.6, 120, 274.5]
6566
```
6667

6768
## 🎯 Key Insights
6869

69-
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using identical test scenarios.
70+
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3, xUnit3_AOT using identical test scenarios.
7071

7172
---
7273

7374
:::note Methodology
7475
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
7576
:::
7677

77-
*Last generated: 2026-08-16T00:18:52.419Z*
78+
*Last generated: 2026-08-17T16:25:00.425Z*

‎docs/docs/benchmarks/engine/ScaleTests.md‎

Lines changed: 12 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ sidebar_position: 7
99
> Large test suites (150+ tests) measuring scalability
1010
1111
:::info Last Updated
12-
This benchmark was automatically generated on **2026-08-16** from the latest CI run.
12+
This benchmark was automatically generated on **2026-08-17** from the latest CI run.
1313

1414
**Environment:** Ubuntu Latest • .NET SDK 10.0.400
1515
:::
@@ -18,11 +18,12 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
1818

1919
| Framework | Version | Mean | Median | StdDev |
2020
|-----------|---------|------|--------|--------|
21-
| **TUnit** | 1.65.0 | 349.50 ms | 333.60 ms | 41.972 ms |
22-
| NUnit | 4.6.1 | 581.67 ms | 574.97 ms | 30.611 ms |
23-
| MSTest | 4.3.3 | 577.69 ms | 579.55 ms | 30.378 ms |
24-
| xUnit3 | 4.0.0 | 752.17 ms | 752.19 ms | 62.610 ms |
25-
| **TUnit (AOT)** | 1.65.0 | 19.74 ms | 19.67 ms | 0.613 ms |
21+
| **TUnit** | 1.65.0 | 343.40 ms | 340.79 ms | 22.201 ms |
22+
| NUnit | 4.6.1 | 551.49 ms | 546.91 ms | 32.588 ms |
23+
| MSTest | 4.3.3 | 549.90 ms | 547.70 ms | 29.407 ms |
24+
| xUnit3 | 4.0.0 | 725.09 ms | 717.83 ms | 63.212 ms |
25+
| **TUnit (AOT)** | 1.65.0 | 22.19 ms | 22.12 ms | 1.050 ms |
26+
| xUnit3_AOT | 4.0.0 | 26.04 ms | 26.14 ms | 0.610 ms |
2627

2728
## 📈 Visual Comparison
2829

@@ -59,19 +60,19 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
5960
}}%%
6061
xychart-beta
6162
title "ScaleTests Performance Comparison"
62-
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
63-
y-axis "Time (ms)" 0 --> 903
64-
bar [349.5, 581.67, 577.69, 752.17, 19.74]
63+
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT", "xUnit3_AOT"]
64+
y-axis "Time (ms)" 0 --> 871
65+
bar [343.4, 551.49, 549.9, 725.09, 22.19, 26.04]
6566
```
6667

6768
## 🎯 Key Insights
6869

69-
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using identical test scenarios.
70+
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3, xUnit3_AOT using identical test scenarios.
7071

7172
---
7273

7374
:::note Methodology
7475
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
7576
:::
7677

77-
*Last generated: 2026-08-16T00:18:52.419Z*
78+
*Last generated: 2026-08-17T16:25:00.425Z*

‎docs/docs/benchmarks/engine/SetupTeardownTests.md‎

Lines changed: 12 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ sidebar_position: 8
99
> Expensive test fixtures with setup/teardown overhead
1010
1111
:::info Last Updated
12-
This benchmark was automatically generated on **2026-08-16** from the latest CI run.
12+
This benchmark was automatically generated on **2026-08-17** from the latest CI run.
1313

1414
**Environment:** Ubuntu Latest • .NET SDK 10.0.400
1515
:::
@@ -18,11 +18,12 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
1818

1919
| Framework | Version | Mean | Median | StdDev |
2020
|-----------|---------|------|--------|--------|
21-
| **TUnit** | 1.65.0 | 355.61 ms | 356.54 ms | 4.842 ms |
22-
| NUnit | 4.6.1 | 1,045.37 ms | 1,047.53 ms | 14.229 ms |
23-
| MSTest | 4.3.3 | 1,104.79 ms | 1,107.44 ms | 8.732 ms |
24-
| xUnit3 | 4.0.0 | 1,292.08 ms | 1,281.97 ms | 41.267 ms |
25-
| **TUnit (AOT)** | 1.65.0 | 66.91 ms | 66.72 ms | 0.630 ms |
21+
| **TUnit** | 1.65.0 | 350.34 ms | 350.43 ms | 4.981 ms |
22+
| NUnit | 4.6.1 | 1,024.36 ms | 1,019.01 ms | 18.199 ms |
23+
| MSTest | 4.3.3 | 1,116.57 ms | 1,106.96 ms | 26.434 ms |
24+
| xUnit3 | 4.0.0 | 758.64 ms | 755.08 ms | 19.636 ms |
25+
| **TUnit (AOT)** | 1.65.0 | 66.39 ms | 66.18 ms | 0.746 ms |
26+
| xUnit3_AOT | 4.0.0 | 170.95 ms | 170.91 ms | 0.769 ms |
2627

2728
## 📈 Visual Comparison
2829

@@ -59,19 +60,19 @@ This benchmark was automatically generated on **2026-08-16** from the latest CI
5960
}}%%
6061
xychart-beta
6162
title "SetupTeardownTests Performance Comparison"
62-
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT"]
63-
y-axis "Time (ms)" 0 --> 1551
64-
bar [355.61, 1045.37, 1104.79, 1292.08, 66.91]
63+
x-axis ["TUnit", "NUnit", "MSTest", "xUnit3", "TUnit_AOT", "xUnit3_AOT"]
64+
y-axis "Time (ms)" 0 --> 1340
65+
bar [350.34, 1024.36, 1116.57, 758.64, 66.39, 170.95]
6566
```
6667

6768
## 🎯 Key Insights
6869

69-
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3 using identical test scenarios.
70+
This benchmark compares TUnit's performance against NUnit, MSTest, xUnit3, xUnit3_AOT using identical test scenarios.
7071

7172
---
7273

7374
:::note Methodology
7475
View the [benchmarks overview](/docs/benchmarks) for methodology details and environment information.
7576
:::
7677

77-
*Last generated: 2026-08-16T00:18:52.419Z*
78+
*Last generated: 2026-08-17T16:25:00.425Z*

‎docs/docs/benchmarks/index.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ sidebar_position: 1
77
# Performance Benchmarks
88

99
:::info Last Updated
10-
These benchmarks were automatically generated on **2026-08-16** from the latest CI run.
10+
These benchmarks were automatically generated on **2026-08-17** from the latest CI run.
1111

1212
**Environment:** Ubuntu Latest • .NET SDK 10.0.400
1313
:::
@@ -80,4 +80,4 @@ These benchmarks run automatically daily via [GitHub Actions](https://github.com
8080
Each benchmark runs multiple iterations with statistical analysis to ensure accuracy. Results may vary based on hardware and test characteristics.
8181
:::
8282

83-
*Last generated: 2026-08-16T00:18:52.420Z*
83+
*Last generated: 2026-08-17T16:25:00.426Z*

0 commit comments

Comments
 (0)