Backend

class hailtop.batch.backend.Backend(requester_pays_fses)

Bases: ABC, Generic[RunningBatchType]

Abstract class for backends.

Methods

_async_run

Execute a batch.

_run

See _async_run().

async_close

close

Close a Hail Batch Backend.

requester_pays_fs

rtype:

RouterAsyncFS

validate_file

rtype:

None

abstract async _async_run(batch, dry_run, verbose, delete_scratch_on_exit, **backend_kwargs)

Execute a batch. :rtype: Optional[TypeVar(RunningBatchType)]

Warning

This method should not be called directly. Instead, use batch.Batch.run().

_run(batch, dry_run, verbose, delete_scratch_on_exit, **backend_kwargs)

See _async_run(). :rtype: Optional[TypeVar(RunningBatchType)]

Warning

This method should not be called directly. Instead, use batch.Batch.run().

async async_close()
close()

Close a Hail Batch Backend.

Notes

This method should be called after executing your batches at the end of your script.

requester_pays_fs(requester_pays_config)
Return type:

RouterAsyncFS

async validate_file(uri, requester_pays_config=None)
Return type:

None