Decide on what CI stages to run when
Current stages:
- Unit: process individual tests (uses small data)
- Integration: SE/PE full test (uses full data)
- Consistency: checks output of Integration test to make sure it is in range of an expected output (uses output of Integration, so very fast)
- Override: check if the pipeline works with local bag OR fastqs instead of what is downloaded (bag test uses full data, fastq test uses small data)