You can defer processing operations for data in output repositories by configuring an output branch field in your pipeline specification. This allows you to accumulate data in an output branch before processing it.
How to Defer Processing in an Output Branch #
In the pipeline specification, add the
output_branchfield with the name of the branch in which you want to accumulate your data before processing:"output_branch": "staging"
When you want to process data, run:
pachctl create branch pipeline@master --head staging