pipeline
Simple pipeline workflow processing.
CLASS | DESCRIPTION |
---|---|
Action |
An action to perform in a pipeline. |
Pipeline |
A collection of actions to perform on an input. |
FUNCTION | DESCRIPTION |
---|---|
import_function |
Import a function from a dotted path. |
noop_func |
A function that does nothing when called. |
pipeline_factory |
Create a |
Attributes¶
Classes¶
Action
¶
Action(
action: str,
id_: Optional[str] = None,
args: Optional[list] = None,
kwargs: Optional[dict] = None,
commit_metadata_func: Optional[Callable] = None,
version_metadata_func: Optional[Callable] = None,
)
An action to perform in a pipeline.
METHOD | DESCRIPTION |
---|---|
run |
Perform the action on the input. |
ATTRIBUTE | DESCRIPTION |
---|---|
commit_metadata_func |
Function the action can call to set metadata about the commit. |
id |
Identifier for the action. |
version_metadata_func |
Function the action can call to set metadata about the version a commit belongs to. |
Pipeline
¶
A collection of actions to perform on an input.
METHOD | DESCRIPTION |
---|---|
run |
Run the pipeline using |
ATTRIBUTE | DESCRIPTION |
---|---|
actions |
The actions to perform on the input.
TYPE:
|
context |
The current state of the pipeline initialized by keyword arguments.
TYPE:
|
Functions¶
import_function
¶
pipeline_factory
¶
pipeline_factory(
action_list: list,
commit_metadata_func: Optional[Callable] = None,
version_metadata_func: Optional[Callable] = None,
**kwargs: Any
) -> Pipeline
Create a Pipeline
from a list of actions specified by dictionaries.
PARAMETER | DESCRIPTION |
---|---|
action_list
|
A
TYPE:
|
commit_metadata_func
|
Optional callable that actions can use to set commit metadata |
version_metadata_func
|
Optional callable that actions can use to set version metadata |
**kwargs
|
keyword arguments to pass to the
TYPE:
|
RETURNS | DESCRIPTION |
---|---|
Pipeline
|
The instantiated Pipeline |