Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chunking and stitching to parallelise alignment #797

Closed
pontussk opened this issue Sep 15, 2021 · 3 comments
Closed

Chunking and stitching to parallelise alignment #797

pontussk opened this issue Sep 15, 2021 · 3 comments
Labels
Milestone

Comments

@pontussk
Copy link

It would be very useful to have automated splitting of large fastq files to parallelise alignment, and then have automated concatenation of the output aligned files. BWA alignment is often the most time-consuming step of processing.

This could speed up processing of e.g. mammalian ancient genome sequencing which can be 300-4000 million reads from a single library.

@jfy133
Copy link
Member

jfy133 commented Sep 16, 2021

This would be good for a centralised nf-core module. One for the upcoming hackathon!

@yassineS
Copy link

yassineS commented Oct 6, 2021

FYI, this could be a great option: bigdatagenomics/cannoli#323 and it works out of the box with singularity and docker

@jfy133 jfy133 added the DSL2 label Nov 29, 2021
@jfy133 jfy133 added this to the 3.0 Augsburg milestone May 26, 2023
@jfy133
Copy link
Member

jfy133 commented Mar 15, 2024

This is already done with sharding from @shyama-mama !

#1023

@jfy133 jfy133 closed this as completed Mar 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants