Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve learner multi-gpu ergonomics #2277

Open
laggui opened this issue Sep 13, 2024 · 0 comments
Open

Improve learner multi-gpu ergonomics #2277

laggui opened this issue Sep 13, 2024 · 0 comments
Labels
enhancement Enhance existing features

Comments

@laggui
Copy link
Member

laggui commented Sep 13, 2024

Especially w.r.t data loading, the data should automatically be transferred to the correct device.

Right now the batch is moved to the first GPU and users are moving the inputs to the correct device before inference (which works, but is less nice and might limit multi-gpu usage since the first GPU always gets filled first).

@laggui laggui added the enhancement Enhance existing features label Sep 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhance existing features
Projects
None yet
Development

No branches or pull requests

1 participant