Workflow Tools - snakemake & targets
Introduction
Workflow tools let you automate the running and rerunning of code with multiple steps.
Python - snakemake
Getting Started
Handling complex inputs with input functions
In our workflows with deal with complex input-output structures, like having early phases of the pipeline work on one flight (file) at a time and later phases work on all of the files from a given site and year as a group.
This can be accomplished by defining custom input functions.