vertebrae.execution.ray_backend

Ray execution backend.

Classes

RayJobHandle

Handle for a submitted Ray task.

RayBackend

Ray execution backend.

Module Contents

class vertebrae.execution.ray_backend.RayJobHandle[source]

Handle for a submitted Ray task.

class vertebrae.execution.ray_backend.RayBackend(address=None, num_cpus=None, num_gpus=None, memory_bytes=None, runtime_env=None)[source]

Ray execution backend.

Parameters:
  • address (Optional[str]) – Optional Ray cluster address.

  • num_cpus (Optional[float]) – Optional default CPU request for tasks.

  • num_gpus (Optional[float]) – Optional default GPU request for tasks.

  • memory_bytes (Optional[int]) – Optional default memory request for tasks.

  • runtime_env (Optional[dict[str, Any]]) – Optional Ray runtime environment.

submit(fn, job)[source]

Submit a single Ray job.

Parameters:
  • fn (Callable[[Any], Any])

  • job (Any)

Return type:

RayJobHandle

gather(handles)[source]

Collect Ray job results.

Parameters:

handles (Iterable[RayJobHandle])

Return type:

List[Any]

status(handle)[source]

Return Ray task status.

Parameters:

handle (RayJobHandle)

Return type:

str

map(fn, jobs)[source]

Map a callable over Ray jobs while preserving order.

Parameters:
  • fn (Callable[[Any], Any])

  • jobs (Iterable[Any])

Return type:

List[Any]