Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reporting comments for error and stack trace variables are appearing uninteligable in Zephyr Scale cloud #45

Open
KeithHEnnis opened this issue Oct 18, 2023 · 2 comments
Assignees
Labels
bug Something isn't working

Comments

@KeithHEnnis
Copy link

I had a simple set of Typescript Playwright API tests set up and reporting just fine (error and stack trace messages reflected playwright's test results ) with the provided zephyr cloud reporter settings,

I progressed my test design by creating helper object classes and changing the .spect.ts import of test from @playwright/test to my fixture.ts which extends test via
import { test as base } from '@playwright/test';
and substantiate the class making use of it's constructor

export const test = base.extend<{ 
  importedHelperClass: ImportedHelperClass;
}>({
    importedHelperClass:async ({request}, use) => {
        await use(new ImportedHelperClass(request));      
    }
});

Since then the error and stack trace messages recorded in Zephyr Scale are far from human readable:

❌ Error Message:
�[2mexpect(�[22m�[31mreceived�[39m�[2m).�[22mtoBe�[2m(�[22m�[32mexpected�[39m�[2m) // Object.is equality�[22m

Expected: �[32m400�[39m
Received: �[31m200�[39m

🧱 Stack Trace:
Error: �[2mexpect(�[22m�[31mreceived�[39m�[2m).�[22mtoBe�[2m(�[22m�[32mexpected�[39m�[2m) // Object.is equality�[22m

Expected: �[32m400�[39m
Received: �[31m200�[39m

Is there something to further configure in the reporter? or is this an issue with the repo not handling playwright test being extended?

@elaichenkov
Copy link
Owner

Hey,
Thank you for reporting the issue. However, that looks odd because the reporter uses the playwright's native error message (e.g. result.error.message). Anyway, I'll try to investigate it more.

@elaichenkov elaichenkov self-assigned this Oct 19, 2023
@elaichenkov elaichenkov added the bug Something isn't working label Oct 19, 2023
@KeithHEnnis
Copy link
Author

KeithHEnnis commented Oct 19, 2023

I thought it odd too, especially since the playwright extension for VSCode I use reports just fine per test, and running the whole thing locally or in docker switched back to the html reporter shows no signs of corrupted error output. Thanks for investigating.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants