Backend

class hailtop.batch.backend.Backend(requester_pays_fses)

Bases: ABC, Generic[RunningBatchType]

Abstract class for backends.

Methods

_async_run	Execute a batch.
_run	See _async_run().
async_close
close	Close a Hail Batch Backend.
requester_pays_fs	rtype: RouterAsyncFS
validate_file	rtype: None

abstract async _async_run(batch, dry_run, verbose, delete_scratch_on_exit, **backend_kwargs)

Execute a batch. :rtype: Optional[TypeVar(RunningBatchType)]

Warning

This method should not be called directly. Instead, use batch.Batch.run().

_run(batch, dry_run, verbose, delete_scratch_on_exit, **backend_kwargs)

See _async_run(). :rtype: Optional[TypeVar(RunningBatchType)]

Warning

This method should not be called directly. Instead, use batch.Batch.run().

async async_close()

close()

Close a Hail Batch Backend.

Notes

This method should be called after executing your batches at the end of your script.

requester_pays_fs(requester_pays_config)

Return type:

RouterAsyncFS

validate_file(uri, requester_pays_config=None)

Return type:

None