nf-cloudcache

This plugin provides cloud-based caching support for Nextflow pipelines, enabling workflow resume capability when using cloud storage as the work directory.

Get Started

To use this plugin, add it to your nextflow.config:

plugins {
    id 'nf-cloudcache'
}

The plugin is automatically activated when using cloud storage (S3, GS, Azure Blob) as the work directory with resume enabled.

workDir = 's3://my-bucket/work'

Run your pipeline with the -resume flag:

nextflow run main.nf -resume

Examples

AWS S3 Cache

plugins {
    id 'nf-amazon'
    id 'nf-cloudcache'
}

workDir = 's3://my-bucket/work'

aws {
    region = 'us-east-1'
}

Google Cloud Storage Cache

plugins {
    id 'nf-google'
    id 'nf-cloudcache'
}

workDir = 'gs://my-bucket/work'

google {
    project = 'my-project'
    location = 'us-central1'
}

Azure Blob Storage Cache

plugins {
    id 'nf-azure'
    id 'nf-cloudcache'
}

workDir = 'az://my-container/work'

azure {
    storage {
        accountName = 'mystorageaccount'
        accountKey = System.getenv('AZURE_STORAGE_KEY')
    }
}

Resources

• Nextflow Cache and Resume

License

Apache License 2.0