Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

{testdisk,flash}: Remove hdiutil-requiring tests #66311

Closed
wants to merge 2 commits into from

Conversation

mitchblank
Copy link
Contributor

As I discussed more in #66304, tests requiring hdiutil are failing, probably due to a sandbox limitation.

For gptfdisk I had an easy workaround, but these two would be harder. Regrettably, I think the easiest thing is to just remove these tests since they never pass anymore.

This should also let testdisk re-bottle for Big Sur correctly -- it's currently on the #65000 leaderboard of top-downloaded formulae with bottling issues

This test fails to run at least on Big Sur with hdiutil failing
with a strange "Directory not empty"  This seems to be a sideeffect
of the sandboxing that "brew test" does and I can't find an easy
way to repair it.
This test fails to run at least on Big Sur with hdiutil failing
with a strange "Directory not empty"  This seems to be a sideeffect
of the sandboxing that "brew test" does and I can't find an easy
way to repair it.
@SMillerDev
Copy link
Member

We won't be removing all tests, you'll need to find a different way to test the program.

@mitchblank
Copy link
Contributor Author

OK, so you'd rather keep tests that literally fail every time they run?

Keep in mind that I am not the originator of these formulae; I am just trying to help out getting broken formulae building again so that we can fix some Big Sur bottling issues. These ones currently can't auto-bottle because brew test fails on them.

@SMillerDev
Copy link
Member

I am just trying to help out getting broken formulae building again so that we can fix some Big Sur bottling issues.

This doesn't do that though, it hides a problem. We need some test that succeeds and shows that the compilation went okay, otherwise we're just blindly hoping that it succeeded.

@fxcoudert
Copy link
Member

Agree with @SMillerDev completely, let's not remove tests, otherwise we're just blind. We already have too many formulas without tests.

Regarding sandboxing, it's possible Xcode 12 introduced new or finer-grained permissions. Something similar happened with Xcode 11, I think, and we had to change the sandbox profile in brew. See Homebrew/brew#6546 and Homebrew/brew@1cd75e4

@fxcoudert
Copy link
Member

I've created a brew PR to add a test.dmg to our fixtures: Homebrew/brew#9499
This could be used to make those tests work

@carlocab carlocab mentioned this pull request Dec 11, 2020
5 tasks
@fxcoudert
Copy link
Member

@mitchblank I've merged the dmg test fixtures PR in brew

mitchblank added a commit to mitchblank/homebrew-core that referenced this pull request Dec 20, 2020
Per the discussion on Homebrew#66311, "hdiutil -create" no longer works
inside of the testing sandbox; use the new gzip'ed disk image
inside fixtures instead
mitchblank added a commit to mitchblank/homebrew-core that referenced this pull request Dec 20, 2020
Per the discussion on Homebrew#66311, "hdiutil -create" no longer works inside of
the testing sandbox; use the new gzip'ed disk image inside fixtures instead
@mitchblank
Copy link
Contributor Author

OK I opened #67273 and #67276 to switch these two to using fixtures instead; discuss there

@mitchblank mitchblank closed this Dec 20, 2020
fxcoudert pushed a commit that referenced this pull request Dec 20, 2020
Per the discussion on #66311, "hdiutil -create" no longer works inside of
the testing sandbox; use the new gzip'ed disk image inside fixtures instead
fxcoudert pushed a commit that referenced this pull request Dec 20, 2020
Per the discussion on #66311, "hdiutil -create" no longer works
inside of the testing sandbox; use the new gzip'ed disk image
inside fixtures instead
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants