vertebrae.execution.dask_backend

Dask execution backend.

Classes

DaskJobHandle

Handle for a submitted Dask future.

DaskBackend

Dask execution backend.

Module Contents

class vertebrae.execution.dask_backend.DaskJobHandle[source]

Handle for a submitted Dask future.

class vertebrae.execution.dask_backend.DaskBackend(address=None, client=None, timeout=None)[source]

Dask execution backend.

Parameters:

  • address (Optional[str]) – Optional scheduler address.

  • client (Any) – Optional pre-existing Dask client.

  • timeout (Optional[str]) – Optional client connect timeout.

submit(fn, job)[source]

Submit a single Dask job.

Parameters:

  • fn (Callable[[Any], Any])

  • job (Any)

Return type:

DaskJobHandle

gather(handles)[source]

Collect Dask job results.

Parameters:

handles (Iterable[DaskJobHandle])

Return type:

List[Any]

status(handle)[source]

Return Dask future status.

Parameters:

handle (DaskJobHandle)

Return type:

str

map(fn, jobs)[source]

Map a callable over Dask jobs while preserving order.

Parameters:

  • fn (Callable[[Any], Any])

  • jobs (Iterable[Any])

Return type:

List[Any]