Skip to content

BUG: Failed EffectorDB download stops test run #102

@markusHaferkamp

Description

@markusHaferkamp

Hi again!

One of the URLs in the test dataset does not work with wget. Manually downloading the file through a browser from that very URL still works; then uploading it to another file hoster and adjusting the appropriate line in nextflow.config fixes the issue.

I am not sure about the legality of re-hosting the file publicly, so I haven't created a PR for this.

Best regards,
Markus

Nextflow.config

private_effectordb_url = "https://figshare.com/ndownloader/files/31397770"

Error description

Aug-19 08:39:23.435 [TaskFinalizer-2] DEBUG nextflow.processor.TaskProcessor - Handling unexpected condition for                                                                                                                                                                                                                
  task: name=validate_input:download_effectordb; work-dir=/beegfs/u/bbe0337/output/predector_test/work/ac/f8b25b2abdc1cbe4100e0a5829ab2d                                                                                                                                                                                        
  error [nextflow.exception.ProcessFailedException]: Process `validate_input:download_effectordb` terminated with an error exit status (8)                                                                                                                                                                                      
Aug-19 08:39:23.445 [TaskFinalizer-2] ERROR nextflow.processor.TaskProcessor - Error executing process > 'validate_input:download_effectordb'                                                                                                                                                                                   
                                                                                                                                                                                                                                                                                                                                
Caused by:                                                                                                                                                                                                                                                                                                                      
  Process `validate_input:download_effectordb` terminated with an error exit status (8)                                                                                                                                                                                                                                         
                                                                                                                                                                                                                                                                                                                                
                                                                                                                                                                                                                                                                                                                                
Command executed:                                                                                                                                                                                                                                                                                                               
                                                                                                                                                                                                                                                                                                                                
  wget -O "effectordb.hmm.gz" "https://figshare.com/ndownloader/files/31397770"                                                                                                                                                                                                                                                 
                                                                                                                                                                                                                                                                                                                                
Command exit status:                                                                                                                                                                                                                                                                                                            
  8                                                                                                                                                                                                                                                                                                                             
                                                                                                                                                                                                                                                                                                                                
Command output:                                                                                                                                                                                                                                                                                                                 
  (empty)                                                                                                                                                                                                                                                                                                                       
                                                                                                                                                                                                                                                                                                                                
Command error:                                                                                                                                                                                                                                                                                                                  
  --2025-08-19 10:39:23--  https://figshare.com/ndownloader/files/31397770                                                                                                                                                                                                                                                      
  Resolving figshare.com (figshare.com)... 52.49.13.227, 52.213.199.5, 52.212.7.129, ...                                                                                                                                                                                                                                        
  Connecting to figshare.com (figshare.com)|52.49.13.227|:443... connected.                                                                                                                                                                                                                                                     
  HTTP request sent, awaiting response... 403 Forbidden                                                                                                                                                                                                                                                                         
  2025-08-19 10:39:23 ERROR 403: Forbidden.   

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions