New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Simple tests that demonstrate "tensor" parallel and "batch" parallel #211

Open

nsmithtt opened this issue Jan 29, 2025 · 0 comments

Labels

multichip

Milestone

[Multi Device 1]

nsmithtt commented Jan 29, 2025

That is:

some tests that demonstrate how to cut tensors on XY dims, i.e. tensor parallel
some tests that demonstrate how to cut tensors on batch dim, i.e. batch parallel
Potentially some combination of both

nsmithtt added the multichip label

nsmithtt added this to the [Multi Device 1] milestone

ajakovljevicTT mentioned this issue

Adding infrastructure for multichip tests #231

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment