ChatGPT解决这个技术问题 Extra ChatGPT

Why is the Visual Studio 2015/2017/2019 Test Runner not discovering my xUnit v2 tests

Want to improve this post? Provide detailed answers to this question, including citations and an explanation of why your answer is correct. Answers without enough detail may be edited or deleted.

UPDATE: Adding a 2019; the discovery/runner integration mechanism is same as per 2017 & 2015, so the key things that can go wrong are the same.

I've read Why is the xUnit runner not finding my tests, which covers reasons xUnit would never be able to find your tests but my problem is different - I'm confident there's nothing subtle going on with my tests; (they have worked in other environments, this seems to be just my machine) - the Visual Studio Test Runner in Visual Studio 2015 [Community Edition] is simply not showing any of my tests. I'm not doing anything remotely exciting; the tests target xUnit.net v2 on the Desktop.

I've looked in the Output window and am not seeing anything in at all under Test in the Show output from tabs.

It is just one possible problem, but obviously you have to compile the test project before it will be shown in the test explorer.
I had this problem, by forgetting to make my new test class public.

I
Ian Kemp

Eliminate discovery exceptions from your inquiries; go to the output Window (Ctrl-Alt-O), then switch the show output from dropdown (Shift-Alt-S) to Tests and make sure there are no discovery exceptions Test|Test settings|Default processor architecture can help if your tests are x86/x64 specific and discovery is triggering bittedness-related exceptions, i.e. not AnyCpu As suggested in this answer(upvote it if the technique helps) running the desktop console runner (instructions) can be a good cross check to eliminate other possibilities, e.g. mangled config files:-

> packages\xunit.runner.console.2.2.0\tools\xunit.console <tests.dll>

NOTE The xunit.runner.console package is deprecated - when you get stuff working in VS, you'll be able to have dotnet test run them in CI contexts too

Go read the documentation - it's comprehensive, up to date, includes troubleshooting info and takes PRs:-

Important note: If you've previously installed the xUnit.net Visual Studio Runner VSIX (Extension), you must uninstall it first. The Visual Studio runner is only distributed via NuGet now. To remove it, to go Tools > Extensions and Updates. Scroll to the bottom of the list, and if xUnit.net is installed, uninstall it. This will force you to restart Visual Studio.

If you're having problems discovering or running tests, you may be a victim of a corrupted runner cache inside Visual Studio. To clear this cache, shut down all instances of Visual Studio, then delete the folder %TEMP%\VisualStudioTestExplorerExtensions. Also make sure your project is only linked against a single version of the Visual Studio runner NuGet package (xunit.runner.visualstudio).

The following steps worked for me:

(Only if you suspect there is a serious mess on your machine - in general the more common case is that the visual studio integration is simply not installed yet)

Do the DEL %TEMP%\VisualStudioTestExplorerExtensions as advised :-

PS> del $env:TEMP\VisualStudioTestExplorerExtensions

Install the NuGet Package xunit.runner.visualstudio in all test projects Paket: .paket\paket add nuget xunit.runner.visualstudio -i You need to end up with the following in your paket.dependencies: nuget xunit.runner.visualstudio version_in_path: true Note the version_in_path: true bit is important Nuget: Go to Package Manager Console (Alt-T,N,O) and Install-Package xunit.runner.visualstudio Rebuild to make sure xunit.runner ends up in the output dir Close Test Explorer <- this was the missing bit for me Re-open Test Explorer (Alt-S,W,T) Run All tests (Ctrl R, A)


"Close Test Explorer <- this was the missing bit for me" This is the most important step that I missed as well and spent 5 hours to figure out. Thank you, I should have paid attention to the steps :)
the xunit VS runner was working for my sln. However, it had stopped showing up one day. Found out that I did not installed the VS running, and it was working probably because of the cache, left by the other sln which has the runner installed. After installing the runner, things work fine again. So don't forget to install the runner for every sln.
This is unbelievable. Deleting the folder that had three other empty folders in it fixed the issue.
@martinJH I have a self answered one for that (Linked in OP) :- stackoverflow.com/questions/16214684/… ;) Not revealing how I discovered that though
Really weird stuff, but deleting %TEMP%\VisualStudioTestExplorerExtensions and restarting VS finally worked!
Ω
ΩmegaMan

None of the above solutions worked for me (dotnetcore 1.1, VS2017). Here's what fixed it:

Add NuGet Package Microsoft.TestPlatform.TestHost Add NuGet Package Microsoft.NET.Test.Sdk

Those are in addition to these packages I installed prior:

xunit (2.3.0-beta1-build3642)

xunit.runner.visualstudio (2.3.0-beta1-build1309)


This helped me, i was missing xunit.runner.visualstudio package.
My .NET 4.72 MS Test project needed TestPlatform.TestHost only when migrating from VS 2017 to VS 2019.
This solved it for me. In the Output window, select Tests from the drop down => see message "missing TestHost" message.
M
Max

I had to change the Test Settings after changing the test projects CPU to x64. Then the tests where detected again.

https://i.stack.imgur.com/sIfw0.png


Did you see a message before that in the test discovery output?
No I didn't see any errors, it took a while to figure out.
hmm; strange (see top of my answer - it explains where to look; normally this is flagged (though there are def cases where there simply are no messages anywhere))
This fixed it for me. I don't know why this helps, but it does.
I had to clean --> rebuild after changing.
C
Chris Aelbrecht

Install xunit.runner.visualstudio package for the test project


Best answer on the page. Fixed my problem.
Already installed, but upgrading the version through nuget got it working again.
Precise solution, works for VS 2019
s
shaeed

Make sure that your test class is public.


thats explicitly addressed in the first proviso (I link t another question that covers that case); this Q+A is only about troubleshooting how how normally OK tests that work in other places dont work for someone righjt now in a given environment. For me this answer just confuses matters as it dilutes that distinctino.
This is what my issue was. Thanks!
M
Marian Nasry

Follow this steps :

Update your MsTest.TestAdapter and MsTest.TestFramework dll's from nugget package manager. Clean your solution Build your solution.


Can you open a clone of this question and self answer please as I have done? This one is about xUnit v2 and later. Even xUnit v1 answers have no place here. You can link to it with a see also at the top of the question, or I can link to it in the question
This solution works.. Otherwise everytime i had to remove %TEMP%\VisualStudioTestExplorerExtensions and still sometimes i had to run the tests from console.
I am using NUnit and I solved this issue by updating NUnit3TestAdapter to the latest version via NuGet.
Thanks for this - in my instance just had to Update-Package -reinstall MSTest.TestAdapter and the tests got picked up.
T
Tom Makin

I've been struggling with this all afternoon whilst working with an ASP Core project and xUnit 2.2.0. The solution for me was adding a reference to Microsoft.DotNet.InternalAbstractions

I found this out when trying to run the test project manually with dotnet test which failed but reported that InternalAbstractions was missing. I did not see this error in the test output window when the auto discovery failed. The only info I saw in the discovery window was a return code, which didn't mean anything to me at the time, but in hindsight was probably indicating an error.


"but reported a useful error" ... which was ? Also can you verify it was definitely not listed in the discovery errors window as stated in the OP - i.e. can you confidently state "I've looked in the Output window and am not seeing anything in at all under Test in the Show output from tabs." ?
See updated answer, I will post the return code info later on in case it is relevant.
L
Liam

It's happened to me a couple of times - when I Clean the project and Build it again it tends to be fine.


any telltale messages when you look in the output window with Tests selected in the dropdown?
None at all, it just says No tests found
In my case, Test Explorer was hanging on a previously failed test. If I browsed to it and tried to right click -> Run or anything then the whole VS would hang. Just doing a Clean and Rebuild cleared the test status and fixed the issue for me.
May I add that simply building (i.e. F6) won't help, you need to right-click on the solution in VS Solution Explorer and click Rebuild Solution.
C
Chamila Maddumage

I had the same issue with Visual Studio 2019. Just Installed the following NuGet packages and the issue was solved.

1). xUnit

2). xunit.runner.visualstudio

3). Microsoft.TestPlatform.TestHost

4). Microsoft.NET.Test.Sdk


c
curiousBoy

After spending 2 days... none of the above worked for me. The only "solution" was: Go to project properties -> Build Tab. Then click Advanced button on the right bottom corner of the pane. Change "Debug Info:" to "full" and click OK.

https://i.stack.imgur.com/tOT3L.jpg

https://i.stack.imgur.com/AtUag.jpg


sounds painful. Thanks for sharing and hope it helps someone some day. However I have to say: I can't think of any reason for the debug info level to affect the discovery process so I can only say "I don't think that was what actually shot the bear" - let's hope I'm wrong though ;)
@RubenBartelink completely agree with you, that is why I mentioned "solution" in a quote :) but weird enough, it worked right away once I did this.
Thank you very much. This was also the fix for me :)
R
Ruben Bartelink

The reason in my case was the target build was not the same between project debugger and test runner. To unify those elements:

Test>Test Settings>Default Processor Architecture. then select either X64 or X86. Project>(your project)Properties>Build(tab)>platform target.

After they are identical, rebuild your solution then test methods will appear for you.


S
SohamC

I am using xUnit 2.2.0.

My issue was my solution was not able to find certain dlls and app.config was trying to resolve them. The error was not showing up in the test output window in Visual Studio.

I was able to identify the error when I installed xunit.runner.console and tried to run the tests through command line.

How to run xunit tests in CLI.


b
baumgarb

I can provide a solution for an edge case I ran into a few days ago. It's not gonna be the solution that fits all of the scenarios described above, however, for the edge case I had it fixed it.

I had the same issue with most recent VS 2017 (version 15.5.7) and XUnit 2.3.1. The xunit.runner.visualstudio package was installed, however, the tests didn't show up in VisualStudio's built-in test explorer.

I was working on a legacy project that was targeting .NET framework 4.5. However, beginning with version 2.2. XUnit does not support .NET frameworks lower thant 4.5.2 (see Release Notes - XUnit 2.2: February 19, 2017

Changing the test project's target framework to a version >= 4.5.2 worked for me. You don't have to change the project's version that you're testing, it's just about the test project itself.


l
live-love

Ran into a similar problem with VS not discovering test methods. In my case I had the static keyword with the method, which I removed and it worked.

[TestMethod]

Before: public static void Test1()

After: public void Test1()

I'd really prefer if this was not here as this is about otherwise correct tests that can't be found in a particular instance of VS. I have a self-answered one re why an xunit test can't be discovered: stackoverflow.com/questions/16214684/…. May I suggest you create a why cant my MSTest test be picked up (by VS if you want). (As you prob know, this particular concern does not even apply to xUnit which is another reason why, helpful as it is, your answer does not belong here)
MSTest did not find my tests because the class access modifier was internal.
c
cd747

This can also be due to the build check box not being ticked for the current platform project in the build configuration. Click Build | Configuration manager, then make sure the test projects have a tick in the build column for the platform that you're using (for example 'x86').

This was definitely the solution that worked for me.


I would upvote this if it was on stackoverflow.com/questions/16214684/… as this is not xunit2 specific and a good checklist element
v
vullnetyy

Do make sure that you haven't written your unit tests in a .NET Standard 2.0 Class Library. The visualstudio runner does not support running tests in netstandard2.0 class libraries at the time of this writing.

Check here for the Test Runner Compatibility matrix:

https://xunit.net


Both links are dead.
s
stakx - no longer contributing

There is one other reason that can cause Test Explorer not showing any tests, and it has to do with the new portable .pdb file format introduced with Visual Studio 2017 / for .NET Core which can break some VS tooling. (Background: See the bug report "Mono.Cecil causes OutOfMemoryException with new .csproj PDBs".)

Are your tests not found because of the new portable .pdb (debug symbols) format?

Open the Output window.

Change drop-down selection for Show output from to Tests.

If you see output like to the following (possibly repeated once for each of your tests), then you've got the problem described in this answer: Exception System.OutOfMemoryException, Exception converting Array dimensions exceeded supported range.

If yes, do this to resolve the problem:

Open your test project's Properties (select the test project in Solution Explorer and press Alt+Enter).

Switch to the Build tab.

Click on the Advanced... button (located at the very end of that tab page).

In the drop-down labelled Debugging information, choose none, pdb-only, or full, but NOT portable. It is this last setting that causes the tests to not be found.

Click OK and clean & rebuild your project. If you want to be extra sure, go to your test project's output directory and clean all .pdb files before rebuilding. Now your tests should be back.


Z
Zach J.

In my case, I had 2 different test projects in the solution. Project 1 tests could be found, but Project 2 tests could not. I found that first Unloading the test Project 1, then closing VS > clearing my temp files > re-open solution > rebuild, allowed VS to discover my Project 2 tests.

I'm assuming something must be conflicting between the two test projects and this was the quickest way to get me up and running in a few minutes. The kinks can be worked out later :).


N
Nafeez Abrar

I was suffering from this problem for long times.

I had about 100 projects different version was deployed in different server.

Updating xunit from 2.2.0 to 2.3.1 was not a solution because build was failing in 2.3.1.

Then I just updated xunit.runner.visualstudio to 2.3.1 and everything started to work fine. I have used this command in my package manager console to updated my xunit.runner.visualstudio package

Get-Project ComapanyName.ProjectName.*.Tests | Install-Package xunit.runner.visualstudio -Version 2.3.1

a
alvarodoune

Close all Visual Studio instances Go to %TEMP%\VisualStudioTestExplorerExtensions\ Delete specrun related folders Try again

let me know, thanks


C
Catalin Enache-Stoian

I hope my answer will be helpful for some of you: In most of the cases when my unit tests were not discovered I had to change the the test class access modifier to public. When add a new class (Shift+Alt+C) the default access modifier is internal and most of the time I forget to change it.


This set of reasons, which will make them not work on anyone's machine anywhere (except TestDriven.net will half-run them) is covered under the question linked to in the OP: stackoverflow.com/questions/16214684/…
Please don't add "thank you" as an answer. Once you have sufficient reputation, you will be able to vote up questions and answers that you found helpful. - From Review
T
Tobias J

The most common culprit for me has been Visual Studio trying to run the tests using a different architecture than the library it's testing. Unfortunately there are multiple places where it seems this can go wrong.

In VS 2017, try creating a Run Settings file, e.g. Default.runsettings in your test project. If your main lib is x64, the contents should be:

<?xml version="1.0" encoding="utf-8"?>
<RunSettings>
  <RunConfiguration>
    <TargetPlatform>x64</TargetPlatform>
  </RunConfiguration>
</RunSettings>

Then choose this file from Test -> Test Settings -> Select Test Settings File.

Then, under Test -> Test Settings, Default Processor Architecture, choose the correct architecture again.

Be sure to Clean and Build the entire solution. You may need to close and reopen the Test Explorer window. Look for any additional errors in the Output -> Test window, for more clues about incorrect architecture types.

FYI additional Test Settings entries can be found here.


C
Christian

Happend to me when i took my first first walking attempts with IntelliTest in VS 2017.

Sometimes, when the test project gets auto-created by IntelliTest, the assembly reference to Microsoft.ExtendedReflection (...\Program Files (x86)\Microsoft Visual Studio\2017\Enterprise\Common7\IDE\Extensions\Microsoft\Pex\Microsoft.ExtendedReflection.dll) is missing. When added, the generated Tests will show up in test explorer after recompile.


A
Alex Albu

Disclaimer: it is not about xunit with visual studio 2015, but Visual Studio 2017 with a UWP unit test application (MSTest). I got to this thread searching the same thing so maybe someone else will do the same :)

The solution for me was to update the nuget packages for MSTest.TestAdapter and MSTest.TestFramework. It seems that when you create a unit test app for UWP you don't automatically get the latest versions.


I'd suggest asking a self answered question as I did is the best way to sequester such info - feel free to copy paste my entire question and s/xUnit/MSTest/ if you think it makes sense ;)
k
kDar

My problem was resolved by installing the nuget xunit.runner.visualstudio


C
CBBSpike

In my case I have multiple test projects in the same solution, and only one of the projects was not displaying the "Test Explorer"

I went to the "Manage Nuget Package for Solution" by right-clicking on the solution.

I noticed under the "Consolidate" tab there was some "Test" nuget packages that were out of sync between the projects. I clicked on "Install" and my missing tests showed up.


P
Paul G

I tried most of the suggestions above and nothing worked. In my case, I'm on a team and tests were appearing for other devs for the same solution. So, I attempted just deleting my .vs folder, but no luck there either.

I ended up deleting my local folder entirely and re-cloning the repo. That solved it for me.


Z
Zoe stands with Ukraine

Here is the solution that worked for us. Not the best but maybe one can benefit.

Background:

Our scripts were developed with VS 2013 and used NUnit VS Adapter 2.1..

Recently we migrated to VS 2017 and when open the same solution - test wouldn't show in the Test Explorer

Upon Build we would see this message:

[Informational] NUnit Adapter 3.10.0.21: Test discovery starting
[Informational] Assembly contains no NUnit 3.0 tests: C:\ihealautomatedTests\SeleniumTest\bin\x86\Debug\SeleniumTest.dll
[Informational] NUnit Adapter 3.10.0.21: Test discovery complete

Solution (temporary):

Uninstall NUnit Adapter 3.10...

Install NUnit VS Adapter 2.1..

Now the Tests are shown.


Please extract your (at least seemingly) new question to its own post to make this a clear answer :)
... Entitled "why is the NUnit TestAdapter v3 not seeing my NUnit v2 tests? and a) ping here b) an put a "see also <link>" at top (even if it is slightly tenuous), but I'd like this answer removed as it does not fit well with the xUnit v2 tests in the title.
G
Gopal Krishnan

Also check if a completely empty app.config file (completely blank with absolutely no markup) is within the test project. This was the culprit in my case.


E
Emil

In my case, I created a new "Solution Configuration" like shown in the image. So when I select my custom one as "Prod", it doesnt recognize TestMehods for some reason. Changing back to "Debug" solves the problem

https://i.stack.imgur.com/k8Rpq.png