thomhurst / TUnit
- понедельник, 23 сентября 2024 г. в 00:00:01
A modern, fast and flexible .NET testing framework
A modern, flexible and fast testing framework for .NET 8 and up. With Native AOT and Trimmed Single File application support included!
See here: https://thomhurst.github.io/TUnit/
TUnit is built on top of the newer Microsoft.Testing.Platform, as opposed to the older VSTest platform. Because the infrastructure behind the scenes is new and different, you may need to enable some settings. This should just be a one time thing.
Visual Studio is supported on the Preview version currently.
Rider is supported. The Enable Testing Platform support option must be selected in Settings > Build, Execution, Deployment > Unit Testing > VSTest.
Visual Studio Code is supported.
dotnet
CLI - Fully supported. Tests should be runnable with dotnet test
, dotnet run
, dotnet exec
or executing an executable directly. See the docs for more information!
dotnet add package TUnit --prerelease
private static readonly TimeOnly Midnight = TimeOnly.FromTimeSpan(TimeSpan.Zero);
private static readonly TimeOnly Noon = TimeOnly.FromTimeSpan(TimeSpan.FromHours(12));
[Test]
public async Task IsMorning()
{
var time = GetTime();
await Assert.That(time).IsAfterOrEqualTo(Midnight)
.And.IsBefore(Noon);
}
or with more complex test orchestration needs
[Before(Class)]
public static async Task ClearDatabase(ClassHookContext context) { ... }
[After(Class)]
public static async Task AssertDatabaseIsAsExpected(ClassHookContext context) { ... }
[Before(Test)]
public async Task CreatePlaywrightBrowser(TestContext context) { ... }
[After(Test)]
public async Task DisposePlaywrightBrowser(TestContext context) { ... }
[Retry(3)]
[Test, DisplayName("Register an account")]
[MethodData(nameof(GetAuthDetails))]
public async Task Register(string username, string password) { ... }
[Repeat(5)]
[Test, DependsOn(nameof(Register))]
[MethodData(nameof(GetAuthDetails))]
public async Task Login(string username, string password) { ... }
[Test, DependsOn(nameof(Login), [typeof(string), typeof(string)])]
[MethodData(nameof(GetAuthDetails))]
public async Task DeleteAccount(string username, string password) { ... }
[Category("Downloads")]
[Timeout(300_000)]
[Test, NotInParallel(Order = 1)]
public async Task DownloadFile1() { ... }
[Category("Downloads")]
[Timeout(300_000)]
[Test, NotInParallel(Order = 2)]
public async Task DownloadFile2() { ... }
[Repeat(10)]
[Test]
[Arguments(1)]
[Arguments(2)]
[Arguments(3)]
[DisplayName("Go to the page numbered $page")]
public async Task GoToPage(int page) { ... }
[Category("Cookies")]
[Test, Skip("Not yet built!")]
public async Task CheckCookies() { ... }
[Test, Explicit, WindowsOnlyTest, RetryHttpServiceUnavailable(5)]
[Property("Some Key", "Some Value")]
public async Task Ping() { ... }
[Test]
[ParallelLimit<LoadTestParallelLimit>]
[Repeat(1000)]
public async Task LoadHomepage() { ... }
public static IEnumerable<(string Username, string Password)> GetAuthDetails()
{
yield return ("user1", "password1");
yield return ("user2", "password2");
yield return ("user3", "password3");
}
public class WindowsOnlyTestAttribute : SkipAttribute
{
public WindowsOnlyTestAttribute() : base("Windows only test")
{
}
public override Task<bool> ShouldSkip(TestContext testContext)
{
return Task.FromResult(!OperatingSystem.IsWindows());
}
}
public class RetryHttpServiceUnavailableAttribute : RetryAttribute
{
public RetryHttpServiceUnavailableAttribute(int times) : base(times)
{
}
public override Task<bool> ShouldRetry(TestInformation testInformation, Exception exception, int currentRetryCount)
{
return Task.FromResult(exception is HttpRequestException { StatusCode: HttpStatusCode.ServiceUnavailable });
}
}
public class LoadTestParallelLimit : IParallelLimit
{
public int Limit => 50;
}
TUnit is inspired by NUnit and xUnit - two of the most popular testing frameworks for .NET.
It aims to build upon the useful features of both while trying to address any pain points that they may have.
BenchmarkDotNet v0.14.0, macOS Sonoma 14.6.1 (23G93) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 8.0.401
[Host] : .NET 8.0.8 (8.0.824.36612), Arm64 RyuJIT AdvSIMD
DefaultJob : .NET 8.0.8 (8.0.824.36612), Arm64 RyuJIT AdvSIMD
Method | Mean | Error | StdDev |
---|---|---|---|
Build_TUnit | 796.9 ms | 15.14 ms | 28.81 ms |
Build_NUnit | 697.7 ms | 8.99 ms | 8.41 ms |
Build_xUnit | 701.5 ms | 5.57 ms | 4.94 ms |
Build_MSTest | 767.8 ms | 9.52 ms | 7.43 ms |
BenchmarkDotNet v0.14.0, Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 8.0.401
[Host] : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
DefaultJob : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
Method | Mean | Error | StdDev |
---|---|---|---|
Build_TUnit | 1.512 s | 0.0212 s | 0.0177 s |
Build_NUnit | 1.391 s | 0.0276 s | 0.0283 s |
Build_xUnit | 1.411 s | 0.0205 s | 0.0192 s |
Build_MSTest | 1.415 s | 0.0132 s | 0.0123 s |
BenchmarkDotNet v0.14.0, Windows 10 (10.0.20348.2700) (Hyper-V)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 8.0.401
[Host] : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
DefaultJob : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
Method | Mean | Error | StdDev |
---|---|---|---|
Build_TUnit | 1.494 s | 0.0290 s | 0.0345 s |
Build_NUnit | 1.362 s | 0.0158 s | 0.0148 s |
Build_xUnit | 1.360 s | 0.0202 s | 0.0189 s |
Build_MSTest | 1.384 s | 0.0269 s | 0.0252 s |
BenchmarkDotNet v0.14.0, macOS Sonoma 14.6.1 (23G93) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 8.0.401
[Host] : .NET 8.0.8 (8.0.824.36612), Arm64 RyuJIT AdvSIMD
DefaultJob : .NET 8.0.8 (8.0.824.36612), Arm64 RyuJIT AdvSIMD
Method | Mean | Error | StdDev |
---|---|---|---|
TUnit_AOT | 68.80 ms | 1.362 ms | 1.207 ms |
TUnit | 450.73 ms | 8.902 ms | 16.500 ms |
NUnit | 757.78 ms | 13.848 ms | 18.006 ms |
xUnit | 695.72 ms | 11.988 ms | 25.805 ms |
MSTest | 642.67 ms | 12.841 ms | 21.099 ms |
BenchmarkDotNet v0.14.0, Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 8.0.401
[Host] : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
DefaultJob : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
Method | Mean | Error | StdDev |
---|---|---|---|
TUnit_AOT | 47.03 ms | 0.940 ms | 2.410 ms |
TUnit | 740.50 ms | 14.533 ms | 18.380 ms |
NUnit | 1,312.94 ms | 7.099 ms | 5.928 ms |
xUnit | 1,294.45 ms | 10.919 ms | 9.679 ms |
MSTest | 1,163.70 ms | 11.724 ms | 10.393 ms |
BenchmarkDotNet v0.14.0, Windows 10 (10.0.20348.2700) (Hyper-V)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 8.0.401
[Host] : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
DefaultJob : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
Method | Mean | Error | StdDev |
---|---|---|---|
TUnit_AOT | 77.97 ms | 0.745 ms | 0.582 ms |
TUnit | 762.01 ms | 15.137 ms | 23.567 ms |
NUnit | 1,310.72 ms | 10.354 ms | 9.179 ms |
xUnit | 1,309.65 ms | 14.801 ms | 13.121 ms |
MSTest | 1,168.89 ms | 12.864 ms | 10.742 ms |
BenchmarkDotNet v0.14.0, Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 8.0.401
[Host] : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
DefaultJob : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
Method | Mean | Error | StdDev |
---|---|---|---|
TUnit_AOT | 83.95 ms | 1.665 ms | 4.501 ms |
TUnit | 810.22 ms | 16.098 ms | 17.893 ms |
NUnit | 6,304.34 ms | 13.803 ms | 12.236 ms |
xUnit | 6,364.37 ms | 10.816 ms | 10.118 ms |
MSTest | 6,283.71 ms | 10.757 ms | 9.536 ms |
BenchmarkDotNet v0.14.0, Windows 10 (10.0.20348.2700) (Hyper-V)
AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
.NET SDK 8.0.401
[Host] : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
DefaultJob : .NET 8.0.8 (8.0.824.36612), X64 RyuJIT AVX2
Method | Mean | Error | StdDev |
---|---|---|---|
TUnit_AOT | 131.5 ms | 2.60 ms | 6.94 ms |
TUnit | 818.4 ms | 16.22 ms | 21.09 ms |
NUnit | 7,491.8 ms | 12.21 ms | 10.82 ms |
xUnit | 7,480.4 ms | 13.35 ms | 12.49 ms |
MSTest | 7,448.6 ms | 13.67 ms | 12.78 ms |
BenchmarkDotNet v0.14.0, macOS Sonoma 14.6.1 (23G93) [Darwin 23.6.0]
Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
.NET SDK 8.0.401
[Host] : .NET 8.0.8 (8.0.824.36612), Arm64 RyuJIT AdvSIMD
DefaultJob : .NET 8.0.8 (8.0.824.36612), Arm64 RyuJIT AdvSIMD
Method | Mean | Error | StdDev |
---|---|---|---|
TUnit_AOT | 244.1 ms | 12.62 ms | 37.23 ms |
TUnit | 554.5 ms | 21.69 ms | 63.96 ms |
NUnit | 14,037.5 ms | 279.36 ms | 570.66 ms |
xUnit | 14,483.5 ms | 289.34 ms | 376.22 ms |
MSTest | 14,246.7 ms | 218.16 ms | 193.39 ms |