Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upload Chirayu and Shlok's MPE env wrappers and training script for MARL #11

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

SimpleGeometry
Copy link
Collaborator

@SimpleGeometry SimpleGeometry commented Nov 14, 2024

Draft PR. Putting this up for now so we can integrate this later. These environment wrappers (for MPE simple and tag) and training scripts were created by Chirayu Nimonkar and Shlok Shah, and I've created this PR on behalf of them with their permission.

Environments are in a good state, but need to integrate training script into the main JaxGCRL library (ideally we merge in clean_JaxGCRL in a way that's satisfying to the users). A direct integration with if statements and more flags is straightforward, but I hesitate to add complexity into the codebase (single-agent environment users will see more complexity from MARL which they won't use).

  • We can of course just keep a separate MARL training file (either in cleanJaxGCRL or in main JaxGCRL) but this code duplication is prone to divergence when we need to update files.

For now, anyone that wants to use the MPE environments and train them can just use this branch and use the corresponding training file with cleanJaxGCRL.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant