Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE REQUEST] Easier integration of model parallelism #24

Open
Dando18 opened this issue Sep 13, 2019 · 0 comments
Open

[FEATURE REQUEST] Easier integration of model parallelism #24

Dando18 opened this issue Sep 13, 2019 · 0 comments
Assignees
@Dando18
Labels
feature-request requesting a new feature
Milestone
MagmaDNN-v1.2

Comments

@Dando18
Copy link
Collaborator

Dando18 commented Sep 13, 2019

Is your feature request related to a problem? Please describe.
Models are not distributed in parallel by default (i.e. when they exceed device memory). Thus the user must first encounter an Out of Memory error and then employ some model parallelism techniques.

Describe the solution you'd like
The Model class or Compute Graph should be able to detect this and distribute accordingly.
@Dando18 Dando18 added the feature-request requesting a new feature label Sep 13, 2019
@Dando18 Dando18 added this to the MagmaDNN-v1.2 milestone Sep 13, 2019
@Dando18 Dando18 self-assigned this Sep 13, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Dando18 Dando18

Labels
feature-request requesting a new feature
Projects
None yet
Milestone
MagmaDNN-v1.2
Development

No branches or pull requests
1 participant
@Dando18