Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test Rhat for the Gibbs kernels #135

Open
3 tasks
emilyfertig opened this issue Aug 1, 2024 · 1 comment
Open
3 tasks

Test Rhat for the Gibbs kernels #135

emilyfertig opened this issue Aug 1, 2024 · 1 comment
Labels
MCMC convergence testing Lower-priority unit tests
Milestone

Comments

@emilyfertig
Copy link

This consists of multiple tests that follow the same basic structure:

Test each of these components

  • Transitioning entity cluster assignments, using the mean number of clusters as a metric
  • Transitioning relation cluster assignments, using the mean number of clusters as a metric
  • Transitioning latent values

The tests should be applied both to a case where the individual Gibbs kernel is transitioned repeatedly (with everything else held constant) and to a case where the whole model is transitioned.

@emilyfertig emilyfertig added this to the Testing milestone Aug 1, 2024
@emilyfertig emilyfertig added the MCMC convergence testing Lower-priority unit tests label Aug 13, 2024
@alex-lew
Copy link

This sounds ultimately good to have but maybe not highest-priority. (I have rarely used these diagnostics in the early stages of developing a model / inference algorithm, but it's possible there are good ways of doing so -- so I don't mean to discourage if we think it would be useful!)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
MCMC convergence testing Lower-priority unit tests
Projects
None yet
Development

No branches or pull requests

2 participants