GodotSharp.TestAdapter 0.1.0-rc1

This is a prerelease version of GodotSharp.TestAdapter.
dotnet add package GodotSharp.TestAdapter --version 0.1.0-rc1                
NuGet\Install-Package GodotSharp.TestAdapter -Version 0.1.0-rc1                
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="GodotSharp.TestAdapter" Version="0.1.0-rc1" />                
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add GodotSharp.TestAdapter --version 0.1.0-rc1                
#r "nuget: GodotSharp.TestAdapter, 0.1.0-rc1"                
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
// Install GodotSharp.TestAdapter as a Cake Addin
#addin nuget:?package=GodotSharp.TestAdapter&version=0.1.0-rc1&prerelease

// Install GodotSharp.TestAdapter as a Cake Tool
#tool nuget:?package=GodotSharp.TestAdapter&version=0.1.0-rc1&prerelease                

GodotSharp.TestAdapter

An experimental .NET Test Adapter for the Godot 4 game engine. Provides In-Engine execution and debugging of tests using standard MSTest attributes across various IDEs.

Test are ran inside the Godot Engine runtime meaning you have full access to C#, your code, and all of Godot's managed runtime resources, and many of the test management features the IDEs provide.

Feel free to open any of the examples in your favorite IDE on your platform to try it out. Check out features for current known compatability.

Features

NOTE: The .NET ecosystem has a complicated history in regards to testing frameworks and tooling, making research and development of a universal test adapter/runner difficult. Documentation is sparse or buried in prior implementations. Below is a listing of known features and IDE integrations, and their status:

βœ…Seems to work ❌Does not work ❓Untested 🚧Future

Main Features

<table> <tr> <th>Feature</th> <th>Windows</th> <th>Linux</th> <th>Macosx</th> </tr> <tr> <td>Run / Debug Tests In-Engine</td> <td>βœ…</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Single or mutli project layouts</td> <td>βœ…</td> <td>βœ…</td> <td>βœ…</td> </tr> <tr> <td>MSTest [TestClass] attribute</td> <td>βœ…</td> <td>βœ…</td> <td>βœ…</td> </tr> <tr> <td>MSTest [TestMethod] attribute</td> <td>βœ…</td> <td>βœ…</td> <td>βœ…</td> </tr> <tr> <td>MSTest [TestInitialize] attribute</td> <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> <tr> <td>MSTest [TestCleanup] attribute</td> <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> <tr> <td>MSTest [AssemblyInitialize] attribute</td> <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> <tr> <td>MSTest [AssemblyCleanup] attribute</td> <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> <tr> <td>MSTest [ClassInitialize] attribute</td> <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> <tr> <td>MSTest [ClassCleanup] attribute</td> <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> </table>

Visual Studio Code Integration

<table> <tbody> <tr> <th>Feature</th> <th>Windows</th> <th>Linux</th> <th>Macosx</th> </tr> <tr> <td>Test Explorer β†’ Discover Tests <td>βœ…</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Run All <td>βœ…</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Debug All <td>❌</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Run Test <td>βœ…</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Debug Test <td>❌</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Go To Code <td>❌</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Code Editor β†’ Run Test <td>βœ…</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Code Editor β†’ Debug Test <td>βœ…</td> <td>❓</td> <td>❓</td> </tr> <tbody> </table>

Jetbrains Rider Integration

<table> <tbody> <tr> <th>Feature</th> <th>Windows</th> <th>Linux</th> <th>Macosx</th> </tr> <tr> <td>Test Explorer β†’ Discover Tests <td>βœ…</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Run All <td>βœ…</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Run Test <td>βœ…</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Debug Test <td>❌</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Go To Code <td>βœ…</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Code Editor β†’ Run Test <td>βœ…</td> <td>❓</td> <td>❓</td> </tr> <tr> <td>Code Editor β†’ Debug Test <td>❌</td> <td>❓</td> <td>❓</td> </tr> <tbody> </table>

Visual Studio 2022 Integration

<table> <tbody> <tr> <th>Feature</th> <th>Windows</th> <th>Macosx</th> </tr> <tr> <td>Test Explorer β†’ Discover Tests <td>βœ…</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Run All <td>βœ…</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Debug All <td>βœ…</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Run Test <td>βœ…</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Debug Test <td>βœ…</td> <td>❓</td> </tr> <tr> <td>Test Explorer β†’ Go To Code <td>❌</td> <td>❓</td> </tr> <tr> <td>Code Editor β†’ Run Test <td>βœ…</td> <td>❓</td> </tr> <tr> <td>Code Editor β†’ Debug Test <td>βœ…</td> <td>❓</td> </tr> <tbody> </table>

Godot Editor Integration

<table> <tbody> <tr> <th>Feature</th> <th>Windows</th> <th>Linux</th> <th>Macosx</th> </tr> <tr> <td>Test Explorer β†’ Discover Tests <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> <tr> <td>Test Explorer β†’ Run All <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> <tr> <td>Test Explorer β†’ Debug All <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> <tr> <td>Test Explorer β†’ Run Test <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> <tr> <td>Test Explorer β†’ Debug Test <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> <tr> <td>Test Explorer β†’ Go To Code <td>🚧</td> <td>🚧</td> <td>🚧</td> </tr> <tbody> </table>

Installation

Install Nuget Packages and Project References

Add the following framework reference to your csproj:

<FrameworkReference Include="Microsoft.AspNetCore.App" />

Add the following nuget packages to your csproj (you may keep these up to date with recent versions)

dotnet add package Microsoft.NET.Test.Sdk
dotnet add package MSTest.TestFramework
dotnet add package GodotSharp.TestAdapter

IF: you are using a multi project layout, you must also install the above nuget references in addition to adding your other projects as references to the main godot project (so the test proxy can find your assemblies)

<ProjectReference Include="..\MyOtherProject\MyOtherProject.csproj" />

Install Godot Addon

Download a recent copy of the GodotSharp.TestAdapter addon archive from the releases page https://github.com/awesolabs/godotsharp-testadapter/releases

Extract the GodotSharp.TestAdapter folder from the archive to your addons/ folder. The final path should be addons/GodotSharp.TestAdapter

Configure Godot Project

Open your project with the Godot Editor

Navigate Project -> Project Settings

Toggle advanced settings

Add the godot executable path setting for your respective platform. You may use environment variables in your paths as they will be expanded during test execution. This helps keep project configuration portable across developer and CI environments.

Platform Setting Name Example Path Example Env Var
Windows godotsharp/testadapter/exe_path_windows c:\path\to\godot.exe %GODOT4%
Linux godotsharp/testadapter/exe_path_linux /path/to/godot $GODOT4
Macosx godotsharp/testadapter/exe_path_macosx /path/to/godot $GODOT4

Example of setting the variable for windows:

Alt text

Alt text

Configure Visual Studio Code

Install C# extensions https://marketplace.visualstudio.com/items?itemName=ms-dotnettools.csharp or https://marketplace.visualstudio.com/items?itemName=ms-dotnettools.csdevkit

After installation ensure your project solution builds and restart visual studio code. Navigate to Test Explorer and click on the refresh icon to find your tests, or navigate to a test file and run tests from the editor.

Alt text

Configure JetBrains Rider

NOTE: Its possible the Rider Godot Plugin interfers with running the test adapter. Mileage may vary report your results.

Open File -> Settings -> Build, Execution, Deployment -> Unit Testing

Open VSTest and select Enable VSTest adapters support

Under MSTest set Test Discovery to Metadata and provide Rider with a path to your Visual Studio installation or other vstest.console program example:

C:\Program Files\Microsoft Visual Studio\2022\Community\Common7\IDE

Alt text

Alt text

Alt text

Configure Visual Studio

Ensure your solution builds. Beyond that it appears no other configuration is needed.

Alt text

Configure Godot Editor

No support for the Godot Editor yet. Would be neat though.

Resources

<table> <tr> <th>Link</th> <th>Description</th> </tr> <tr> <td>https://github.com/microsoft/vstest</td> <td>Visual Studio Test Platform repo</td> </tr> <tr> <td>https://github.com/microsoft/testfx</td> <td>MSTest Adapter and Framework</td> </tr> <tr> <td>https://github.com/microsoft/vstest/blob/main/docs/RFCs/0004-Adapter-Extensibility.md#writing-an-adapter</td> <td>Some docs on writing adapters</td> </tr> <tr> <td>https://github.com/Samsung/netcoredbg</td> <td>Open Source .NET debugger with same CLI interface as vsdbg (useful for linux?) </tr> </table>

Known Issues and Workarounds

Unable to debug tests from vscode test explorer

When attempting to debug tests from the vscode test explorer, you may recieve error: error : Could not resolve SDK "Godot.NET.Sdk". Exactly one of the probing messages below indicates why we could not resolve the SDK. Investigate and resolve that message to correctly specify the SDK.

The cause of this is unknown. Instead prefer to run or debug tests directly from the [Run Test] or [Debug Test] code lens options inside the test source file.

Product Compatible and additional computed target framework versions.
.NET net6.0 is compatible.  net6.0-android was computed.  net6.0-ios was computed.  net6.0-maccatalyst was computed.  net6.0-macos was computed.  net6.0-tvos was computed.  net6.0-windows was computed.  net7.0 was computed.  net7.0-android was computed.  net7.0-ios was computed.  net7.0-maccatalyst was computed.  net7.0-macos was computed.  net7.0-tvos was computed.  net7.0-windows was computed.  net8.0 was computed.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last updated
0.1.0-rc1 108 9/27/2023