-
Notifications
You must be signed in to change notification settings - Fork 49
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Inconsistent use of is_mc
property
#467
Comments
Hi @AdrianSosic
Re 3 and 4: Those are imo not the same. From the baybe perspective eg Re 3: This is only done in the tests for now but I think whats really intended by those is to check for 1. So if they are slightly reworked 3 is not a required property we need to enable. Re 4: This is the attempted usage in #465 but other than that the property has never been used for that. Depending on the implementation choice below it could either become a property or we just require that this check always has to be done via Implementation choice for a Fix:
Variant A) properties dont load the botorch objects and still sue the currently implemented name check. Afaik it will remain the same for 1 and 2 for all classes except |
Hey @Scienfitz, thanks for this very detailed investigation. I think you have a very good overview at the moment, so I'd generally follow your preferences. However, I think Variant B indeed suffers from lazy-loading issues --> you'd not be able to implement this as a property. It would need to become a method, which somehow appears odd to me. So I guess a non-loading variant is the better option. It is not entirely clear to me, though, how the properties would actually be implemented. Will we need to hardcode? I think the fastest way to converge would be if you created a corresponding draft so that we can actually see the necessary changes. |
Ok I can draft something. From what I understand at this moment it would mean
|
Fixes #467 and #458 BayBE acquisition functions have been refactored - Removed `is_mc` - Added `supports_batching` and `supports_pending_experiments` indicators - Changed tests using these properties + some changes to have more readable output - Fixed bug with `PSTD` where the direction was negated depending on target type. However, for `PSTD` the direction is set by the user and means to change whether points with large or small std are returned - ie it is fully independent of the target type. So it needs to be exempt from the overwriting of the `maximize` setting that is done for other analytical acqfs - Enabled the new `qPSTD` function which requires a higher botorch version, conveniently also including the upgrade to support higher scipy versions, version pins have been adjusted accordingly.
The semantics of
is_mc
need to be consistently (re-)defined. Originally, it was used to indicate if an acquisition function is capable of batch optimization, but with the newer code features this definition is no longer accurate (see here)The text was updated successfully, but these errors were encountered: