BICF issueshttps://git.biohpc.swmed.edu/groups/BICF/-/issues2020-04-25T18:55:13-05:00https://git.biohpc.swmed.edu/BICF/KCE/kce_etl/-/issues/27New Beaker code2020-04-25T18:55:13-05:00Venkat MalladiNew Beaker codeVenkat MalladiVenkat Malladihttps://git.biohpc.swmed.edu/BICF/KCE/kce_etl/-/issues/28Comparison Script2020-04-25T19:02:01-05:00Venkat MalladiComparison ScriptComparison between current database and updates.Comparison between current database and updates.Venkat MalladiVenkat Malladihttps://git.biohpc.swmed.edu/BICF/Astrocyte/cellranger_count/-/issues/46Add simple integration CI test2020-11-03T12:29:40-06:00Gervaise Henrygervaise.henry@utsouthwestern.eduAdd simple integration CI testto branches except master and develop to test nextflow run on branchesto branches except master and develop to test nextflow run on branches3.0.0Gervaise Henrygervaise.henry@utsouthwestern.eduGervaise Henrygervaise.henry@utsouthwestern.eduhttps://git.biohpc.swmed.edu/BICF/Astrocyte/sra_pipeline/-/issues/19Add concatination flag2020-04-30T16:16:25-05:00Jonathan GesellAdd concatination flagAdd a flag to concatenate the resulting fastq files if there are multiple files found (default is to concat).Add a flag to concatenate the resulting fastq files if there are multiple files found (default is to concat).Astrocyte FunctionalityJonathan GesellJonathan Gesellhttps://git.biohpc.swmed.edu/BICF/Astrocyte/chipseq_analysis/-/issues/83Unique Experiment check2020-06-23T15:49:10-05:00Venkat MalladiUnique Experiment checkCheck design file for unique experiments and replicates before starting.Check design file for unique experiments and replicates before starting.2.0.0https://git.biohpc.swmed.edu/BICF/Astrocyte/sra_pipeline/-/issues/22Parallelize tests2020-06-16T09:35:08-05:00Jonathan GesellParallelize testsRe-write the tests using a combination of joblib.Parallel and pytest-parallel to see if we can speed up the tests. Note: on Nucleus009, we want to keep the core usage count down to no more than 4 cores.Re-write the tests using a combination of joblib.Parallel and pytest-parallel to see if we can speed up the tests. Note: on Nucleus009, we want to keep the core usage count down to no more than 4 cores.Jonathan GesellJonathan Gesellhttps://git.biohpc.swmed.edu/BICF/Astrocyte/sra_pipeline/-/issues/24Containerize Pipeline2020-06-17T16:37:54-05:00Jonathan GesellContainerize PipelineDesign the container so that it can be run by Docker as one image.Design the container so that it can be run by Docker as one image.Azure FunctionalityJonathan GesellJonathan Gesellhttps://git.biohpc.swmed.edu/BICF/Astrocyte/cellranger_mkfastq/-/issues/40Update multiqc version/references report2020-11-03T12:04:45-06:00Gervaise Henrygervaise.henry@utsouthwestern.eduUpdate multiqc version/references report* Add pipeline zenodo references report
* Add astrocyte version to version report (if param.astrocyte=true)
* Add astrocyte reference to reference report (if param.astrocyte=true)* Add pipeline zenodo references report
* Add astrocyte version to version report (if param.astrocyte=true)
* Add astrocyte reference to reference report (if param.astrocyte=true)Pendinghttps://git.biohpc.swmed.edu/BICF/Astrocyte/cellranger_count/-/issues/48Update multiqc version/references report2020-11-03T12:29:40-06:00Gervaise Henrygervaise.henry@utsouthwestern.eduUpdate multiqc version/references report* Add pipeline zenodo references report
* Add astrocyte version to version report (if param.astrocyte=true)
* Add astrocyte reference to reference report (if param.astrocyte=true)* Add pipeline zenodo references report
* Add astrocyte version to version report (if param.astrocyte=true)
* Add astrocyte reference to reference report (if param.astrocyte=true)3.0.0https://git.biohpc.swmed.edu/BICF/Astrocyte/chipseq_analysis/-/issues/85Update multiqc version/references report2020-06-23T15:48:58-05:00Gervaise Henrygervaise.henry@utsouthwestern.eduUpdate multiqc version/references report* Add astrocyte version to version report (if param.astrocyte=true)
* Add astrocyte reference to reference report (if param.astrocyte=true)* Add astrocyte version to version report (if param.astrocyte=true)
* Add astrocyte reference to reference report (if param.astrocyte=true)2.0.0https://git.biohpc.swmed.edu/BICF/Astrocyte/atacseq_analysis/-/issues/41Update multiqc version/references report2020-07-01T14:36:11-05:00Gervaise Henrygervaise.henry@utsouthwestern.eduUpdate multiqc version/references report* Add astrocyte version to version report (if param.astrocyte=true)
* Add astrocyte reference to reference report (if param.astrocyte=true)* Add astrocyte version to version report (if param.astrocyte=true)
* Add astrocyte reference to reference report (if param.astrocyte=true)Version 2.1.0https://git.biohpc.swmed.edu/BICF/Astrocyte/sra_pipeline/-/issues/25update test for astrocyte 0.3.12020-06-26T15:38:59-05:00Venkat Malladiupdate test for astrocyte 0.3.1Add test for astrocyte
update Readme to have astrocyte badgeAdd test for astrocyte
update Readme to have astrocyte badgehttps://git.biohpc.swmed.edu/BICF/Astrocyte/cellranger_count/-/issues/49Add test for astrocyte 0.3.12020-08-02T09:57:17-05:00Venkat MalladiAdd test for astrocyte 0.3.1# Summary
* [ ] Add test for astrocyte-specific test besides cli
* [ ] Add Badge for astrocyte
* [ ] Test for astrocyte 0.3.1 instead of loading astrocyte
/cc @ghenry# Summary
* [ ] Add test for astrocyte-specific test besides cli
* [ ] Add Badge for astrocyte
* [ ] Test for astrocyte 0.3.1 instead of loading astrocyte
/cc @ghenryGervaise Henrygervaise.henry@utsouthwestern.eduGervaise Henrygervaise.henry@utsouthwestern.eduhttps://git.biohpc.swmed.edu/BICF/Astrocyte/cellranger_mkfastq/-/issues/41Add test for astrocyte specific run of pipline2020-10-30T11:48:42-05:00Venkat MalladiAdd test for astrocyte specific run of pipline# Summary
* [x] Add test for astrocyte-specific test besides cli
* [x] Add Badge for astrocyte
* [x] Test for astrocyte 0.4.0 instead of loading astrocyte
/cc @ghenry @venkat.malladi @s181706 @s189701# Summary
* [x] Add test for astrocyte-specific test besides cli
* [x] Add Badge for astrocyte
* [x] Test for astrocyte 0.4.0 instead of loading astrocyte
/cc @ghenry @venkat.malladi @s181706 @s189701https://git.biohpc.swmed.edu/BICF/onboarding/-/issues/20Pipeline maintaince documentation2021-04-06T08:15:08-05:00Venkat MalladiPipeline maintaince documentationhttps://git.biohpc.swmed.edu/BICF/Astrocyte/methylation_analysis/-/issues/2Update Readme2020-12-29T17:33:49-06:00Venkat MalladiUpdate ReadmeUpdate reamde to include and copy to docs
[![pipeline status](https://git.biohpc.swmed.edu/BICF/Astrocyte/methylation_analysis/badges/master/pipeline.svg)](https://git.biohpc.swmed.edu/BICF/Astrocyte/methylation_analysis/commits/master)...Update reamde to include and copy to docs
[![pipeline status](https://git.biohpc.swmed.edu/BICF/Astrocyte/methylation_analysis/badges/master/pipeline.svg)](https://git.biohpc.swmed.edu/BICF/Astrocyte/methylation_analysis/commits/master)
[![coverage report](https://git.biohpc.swmed.edu/BICF/Astrocyte/methylation_analysis/badges/master/coverage.svg)](https://git.biohpc.swmed.edu/BICF/Astrocyte/methylation_analysis/commits/master)|
[![Nextflow](https://img.shields.io/badge/nextflow-%E2%89%A50.31.0-brightgreen)](https://www.nextflow.io/)
[![Astrocyte](https://img.shields.io/badge/astrocyte-%E2%89%A50.3.1-blue)](https://astrocyte-test.biohpc.swmed.edu/static/docs/index.html)
[![DOI]()]()
Current version of the software and issue reports are at
https://git.biohpc.swmed.edu/BICF/Astrocyte/chipseq_analysis
To download the current version of the software
```bash
$ git clone git@git.biohpc.swmed.edu:BICF/Astrocyte/methylation_analysis.git
```
## Input files
##### 1) Fastq Files
+ You will need the full path to the files for the Bash Scipt
##### 2) Design File
+ The Design file is a tab-delimited file with 8 columns for Single-End and 9 columns for Paired-End. Letter, numbers, and underlines can be used in the names. However, the names can only begin with a letter. Columns must be as follows:
1. sample_id a short, unique, and concise name used to label output files; will be used as a control_id if it is the control sample
2. experiment_id biosample_treatment_factor; same name given for all replicates of treatment. Will be used for the consensus header.
3. biosample symbol for tissue type or cell line
4. factor symbol for antibody target
5. treatment symbol of treatment applied
6. replicate a number, usually from 1-3 (i.e. 1)
7. control_id sample_id name that is the control for this sample
8. fastq_read1 name of fastq file 1 for SE or PC data
9. fastq_read2 name of fastq file 2 for PE data
+ See [HERE](test_data/test_design_pe.txt) for an example design file, paired-end
+ See [HERE](test_data/test_design_se.txt) for an example design file, single-end
##### 3) Bash Script
+ You will need to create a bash script to run the Methylation pipeline on [BioHPC](https://portal.biohpc.swmed.edu/content/)
+ This pipeline has been optimized for the correct partition
+ See [HERE](docs/Methylation.sh) for an example bash script
+ The parameters that must be specified are:
## Pipeline (Details output and steps)
+
Add flowchart
See [FLOWCHART](docs/flowchart.pdf)
## Output Files
Folder | File | Description
--- | --- | ---
d
## Common Quality Control Metrics
+ These are the list of files that should be reviewed before continuing on with the CHIPseq experiment. If your experiment fails any of these metrics, you should pause and re-evaluate whether the data should remain in the study.
1. multiqcReport/multiqc_report.html: follow the ChiP-seq standards [HERE](https://www.encodeproject.org/chip-seq/);
2. experimentQC/*_fingerprint.pdf: make sure the plots information is correct for your antibody/input. See [HERE](https://deeptools.readthedocs.io/en/develop/content/tools/plotFingerprint.html) for more details.
3. crossReads/*cc.plot.pdf: make sure your sample data has the correct signal intensity and location. See [HERE](hhttps://ccg.epfl.ch//var/sib_april15/cases/landt12/strand_correlation.html) for more details.
4. crossReads/*.cc.qc: Column 9 (NSC) should be > 1.1 for experiment and < 1.1 for input. Column 10 (RSC) should be > 0.8 for experiment and < 0.8 for input. See [HERE](https://genome.ucsc.edu/encode/qualityMetrics.html) for more details.
5. experimentQC/coverage.pdf, experimentQC/heatmeap_SpearmanCorr.pdf, experimentQC/heatmeap_PearsonCorr.pdf: See [HERE](https://deeptools.readthedocs.io/en/develop/content/list_of_tools.html) for more details.
## Common Errors
If you find an error, please let the [BICF](mailto:BICF@UTSouthwestern.edu) know and we will add it here.
## Citation
Please cite individual programs and versions used [HERE](docs/references.md), and the pipeline doi:[](). Please cite in publications: Pipeline was developed by BICF from funding provided by Cancer Prevention and Research Institute of Texas (RP150596).
## Programs and Versions
## Credits
This example worklow is derived from original scripts kindly contributed by the Bioinformatic Core Facility ([BICF](https://www.utsouthwestern.edu/labs/bioinformatics/)), in the [Department of Bioinformatics](https://www.utsouthwestern.edu/departments/bioinformatics/).1.0.0Spencer BarnesSpencer Barneshttps://git.biohpc.swmed.edu/BICF/Astrocyte/methylation_analysis/-/issues/3Add a changelog2020-12-29T17:33:43-06:00Venkat MalladiAdd a changelog1.0.0https://git.biohpc.swmed.edu/BICF/Astrocyte/methylation_analysis/-/issues/5Add back tags per process2020-12-29T17:33:34-06:00Venkat MalladiAdd back tags per process1.0.0https://git.biohpc.swmed.edu/BICF/Astrocyte/chipseq_analysis/-/issues/88create down-sampled test data2020-08-07T10:17:20-05:00Spencer Barnescreate down-sampled test dataCreate down-sampled fastq's for quick tests when applying bug fixes.Create down-sampled fastq's for quick tests when applying bug fixes.Spencer BarnesSpencer Barneshttps://git.biohpc.swmed.edu/BICF/Astrocyte/sra_pipeline/-/issues/26Fix issue downloading and spliting for single cell data2020-08-21T14:20:59-05:00Venkat MalladiFix issue downloading and spliting for single cell dataThere is an issue of properly splitting single-cell data if I, R1, R2 reads are all uploadedThere is an issue of properly splitting single-cell data if I, R1, R2 reads are all uploaded