Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
RNA-seq
Manage
Activity
Members
Labels
Plan
Issues
12
Issue boards
Milestones
Iterations
Wiki
Requirements
Code
Merge requests
0
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Locked files
Build
Pipelines
Jobs
Pipeline schedules
Test cases
Artifacts
Deploy
Releases
Container Registry
Operate
Environments
Monitor
Incidents
Service Desk
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Code review analytics
Issue analytics
Insights
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
GUDMAP_RBK
RNA-seq
Commits
466e814a
Commit
466e814a
authored
4 years ago
by
Gervaise Henry
Browse files
Options
Downloads
Patches
Plain Diff
Link deriva credentials for upload processed files and fix logs
parent
9fd3eb5a
Branches
Branches containing commit
Tags
Tags containing commit
2 merge requests
!76
Develop
,
!70
Dnanexus
Pipeline
#9244
failed with stages
in 3 minutes and 17 seconds
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
rna-seq.nf
+13
-7
13 additions, 7 deletions
rna-seq.nf
with
13 additions
and
7 deletions
rna-seq.nf
+
13
−
7
View file @
466e814a
...
...
@@ -2196,8 +2196,14 @@ process uploadProcessedFile {
script:
"""
hostname > ${repRID}.outputBag.log
ulimit -a >> ${repRID}.outputBag.log
hostname > ${repRID}.uploadProcessedFile.log
ulimit -a >> ${repRID}.uploadProcessedFile.log
# link credential file for authentication
echo -e "LOG: linking deriva credentials" >> ${repRID}.uploadProcessedFile.log
mkdir -p ~/.deriva
ln -sf `readlink -e credential.json` ~/.deriva/credential.json
echo -e "LOG: linked" >> ${repRID}.uploadProcessedFile.log
mkdir -p ./deriva/Seq/pipeline/${studyRID}/${executionRunRID}/
cp ${bam} ./deriva/Seq/pipeline/${studyRID}/${executionRunRID}/
...
...
@@ -2216,14 +2222,14 @@ process uploadProcessedFile {
do
python3 ${script_deleteEntry_uploadProcessedFile} -r \${rid} -t Processed_File -o ${source} -c \${cookie}
done
echo LOG: all old processed file RIDs deleted >> ${repRID}.upload
QC
.log
echo LOG: all old processed file RIDs deleted >> ${repRID}.upload
ProcessedFile
.log
fi
deriva-upload-cli --catalog 2 --token \${cookie:9} ${source} ./deriva
echo LOG: processed files uploaded >> ${repRID}.outputBag.log
echo LOG: processed files uploaded >> ${repRID}.outpu
ploadProcessedFileu
tBag.log
deriva-download-cli --catalog 2 --token \${cookie:9} ${source} ${executionRunExportConfig} . rid=${executionRunRID}
echo LOG: execution run bag downloaded >> ${repRID}.
outputBag
.log
echo LOG: execution run bag downloaded >> ${repRID}.
uploadProcessedFile
.log
echo -e "### Run Details" >> runDetails.md
echo -e "**Workflow URL:** https://git.biohpc.swmed.edu/gudmap_rbk/rna-seq" >> runDetails.md
...
...
@@ -2241,7 +2247,7 @@ process uploadProcessedFile {
echo -e "**Genome Assembly Version:** \${genome} patch \${patch}" >> runDetails.md
echo -e "**Annotation Version:** GENCODE release \${annotation}" >> runDetails.md
echo -e "**Run ID:** ${repRID}" >> runDetails.md
echo LOG: runDetails.md created >> ${repRID}.
outputBag
.log
echo LOG: runDetails.md created >> ${repRID}.
uploadProcessedFile
.log
unzip Execution_Run_${executionRunRID}.zip
yr=\$(date +'%Y')
...
...
@@ -2255,7 +2261,7 @@ process uploadProcessedFile {
cp ${multiqcJSON} \${loc}
bdbag ./${repRID}_Output_Bag/ --update --archiver zip --debug
echo LOG: output bag created >> ${repRID}.
outputBag
.log
echo LOG: output bag created >> ${repRID}.
uploadProcessedFile
.log
"""
}
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment