Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ignore Testng Retried tests results #22

Open
Soumendu-Khilar opened this issue Dec 18, 2022 · 10 comments
Open

Ignore Testng Retried tests results #22

Soumendu-Khilar opened this issue Dec 18, 2022 · 10 comments

Comments

@Soumendu-Khilar
Copy link

Soumendu-Khilar commented Dec 18, 2022

Currently when a Cucumber test case is retried using Retry Analyzer the result of all the runs for a test case is displayed in extent reports. This is causing an issue where if a test case PASSES in the second run the overall status still shows that the feature has FAILED.
Is there any implementation to include only the last run of a test.
Run 1 - Failed
Run 2 - Failed
Run 3 - Passed

Only Passed result to attach in extent reports.

@grasshopper7
Copy link
Owner

There is no solution to remove failed tests in retried scenarios. Tests should not be removed from the report without the user knowing abut it.
Will have a look at a solution.

@Soumendu-Khilar
Copy link
Author

Can their be a workaround for this because as of now if there is a failed test case then the entire feature is marked as failed irrespective of if the retried test run passes. This behavior is incorrect.

@grasshopper7
Copy link
Owner

Currently I do not have spare time to look at this. Not exactly sure about timelines. I would suggest you look at another reporting solution which addresses this specific need. Thx.

@darasandeep91
Copy link

@Soumendu-Khilar did you find any solution for the problem that you mentioned above.

@Soumendu-Khilar
Copy link
Author

@darasandeep91 No, I didn't find any solution.

@grasshopper7
Copy link
Owner

THis has been added in version 5.1.0 of the extent report with a configuration setting. Please go through the changelog in the extentreport repository

@rameshkhatri1
Copy link

@grasshopper7 I am using extentreports-cucumber7-adapter Version: 1.14.0 . I do not found the docs about retried test.
I tried adding keepLastRetryOnly=true in extent.properties but it did not work. Could you please help on what to keep on properties file or provide me the docs link where this information is provided. Thank you

@grasshopper7
Copy link
Owner

extent-framework/extentreports-java#386
you are right it needs to be enabled in the adapter code. I will reopen and fix this. Thx.

@grasshopper7 grasshopper7 reopened this Sep 15, 2023
@SSINGHPR
Copy link

Following This +

I have a similar issue reported with this request, since I am not sure if it was fixed yet like mentioned by the @grasshopper7 above:
#38

Thanks for all your help @grasshopper7.

@Sumit-Systango
Copy link

@rameshkhatri1 DId you find any solution for this ? I'm still not sure where to use the "keepLastRetryOnly=true".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants