pytorch/ignite

Add oneCCL backend for idist

Open

#1,728 opened on Mar 2, 2021

View on GitHub
 (5 comments) (0 reactions) (0 assignees)Python (602 forks)batch import
HacktoberfestPyDataGlobalenhancementhelp wantedneeds-discussion

Repository metrics

Stars
 (4,313 stars)
PR merge metrics
 (Avg merge 15d 11h) (17 merged PRs in 30d)

Description

🚀 Feature

The idea is to add "oneCCL" backend by extending our torch native dist model.

Any interest for that ?

Refs:

Contributor guide

Research direction
Review the existing native distributed model in ignite/distributed/comp models/native.py, and study the Intel oneCCL backend integration as shown in torch ccl and the referenced Medium article.
Tech stack
pythonpytorch
Domain
backend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Mostly clear
Prerequisites
PythonPyTorchDistributed computing
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
40