FHElium

Appearance

fhelium.backend.distributed.resources ​

Process-group resources used by distributed operation implementations.

PROCESS_GROUP_RESOURCE_KIND ​

constant View source

python
PROCESS_GROUP_RESOURCE_KIND = 'process-group'

ProcessGroupExecutionResource ​

class View source

python
ProcessGroupExecutionResource(group: torch.distributed.ProcessGroup | None = None)

Expose one initialized rank-local process group to Backend operations.

group=None names PyTorch's default process group. Ranks represented by distributed IR are process-group ranks; conversion to a global rank occurs only when a PyTorch collective requires it.

Attributes ​

NameTypeDefault/value
grouptorch.distributed.ProcessGroup | NoneNone

rank ​

property

python
rank: int

Return this process's rank within the selected group.

size ​

property

python
size: int

Return the number of participating group ranks.

global_rank ​

method

python
def global_rank(group_rank: int) -> int: ...

Map one group-relative rank to its process-global rank.