Ci

Add and improve CI

PR checklist

• This comment contains a description of changes (with reason)
• If you've fixed a bug or added code that should be tested, add tests!
• Documentation in docs is updated
• Replace dag.png with the most recent CI pipleine integrated_pe artifact
• CHANGELOG.md is updated
• README.md is updated
• LICENSE.md is updated with new contributors
• Docker images moved to production release and changed in pipeline
• Docker images used in the CI unit tests match those used in pipleine

• Close issue
  Closes #27 (closed) Closes #48 (closed) Closes #54 (closed)

/cc @ghenry @venkat.malladi

.gitlab-ci.yml

@@ -10,6 +10,7 @@ before_script:
 stages:
   - unit
   - integration
+  - consistency
 
 getBag:
   stage: unit
@@ -132,6 +133,16 @@ integration_se:
   - hostname
   - ulimit -a
   - nextflow -bg run ./workflow/rna-seq.nf --deriva ./test_data/auth/credential.json --bdbag ./test_data/auth/cookies.txt --repRID 16-1ZX4 --ci true
+  artifacts:
+    name: "$CI_JOB_NAME"
+    when: always
+    paths:
+      - dag.png
+      - output/qc/
+    expire_in: 7 days
+  cache:
+    paths:
+    - output/qc/
 
 integration_pe:
   stage: integration
@@ -144,4 +155,8 @@ integration_pe:
     when: always
     paths:
       - dag.png
+      - output/qc/
     expire_in: 7 days
+  cache:
+    paths:
+    - output/qc/