UGENE Forum - SPAdes - Mac, no tool

Sep 21^st, 2024 at 4:36am

Choose Language:

	Welcome, Guest. Please Login or Register
	Welcome to our forum.

UGENE Forum › General Category › Help and How-to › SPAdes - Mac, no tool

‹ Previous Topic | Next Topic ›

Pages: 1 2

Print

SPAdes - Mac, no tool (Read 99889 times)

Jan 29^th, 2015 at 3:44pm

Leiga Offline
YaBB Newbies

Posts: 14

Hi everyone.
I am a fresh user of your software and have problem with genome assembly using SPAdes.
As is written in the topic I am using this application on MacBook Pro. Following the instructions I have downloaded external package (with SPAdes for 64-bit MAC), change in the settings location of that folder and tried to run genome assemby. At the end I have this kind of notification:
Quote:

Task {GenomeAssemblyMultiTask} finished with error: Subtask {GenomeAssemblyTask} is failed: Subtask {SPAdestool} is failed: Undefined tool: 'SPAdes'

SPAdes folder is in folder, but on the list of Preferences/External tools in UGENE software I still do not have anything with "SPAdes" letters.
Can you help me?
Regards
L.

IP Logged

Reply #1 - Jan 29^th, 2015 at 7:17pm

Olga Golosova Offline
YaBB Administrator

Posts: 338

Hi Leiga!

There was an issue in the release UGENE version that is already fixed.

Could you please download and use the snapshot UGENE version to run SPAdes? The snapshot package can be downloaded here: http://ugene.unipro.ru/snapshot.html

You will need to specify "SPAdes" and "python" external tools in the Application Settings.

Sorry for this inconvenience and thanks for your question!

IP Logged

Reply #2 - Jan 30^th, 2015 at 5:53am

Leiga Offline
YaBB Newbies

Posts: 14

Dear Olga,
I think I do some steps forward... changed version for mentioned by you, changed location of external package in preferences sheet. I tried to assemble genome:
Quote:

[ERROR][23:45] Spades: == Error == exception caught while parsing YAML file (/Biofizyka/UGENE/Bakteriofagi/JD/R15011/datasets.yaml):
[ERROR][23:45] Task {GenomeAssemblyMultiTask} finished with error: Subtask {GenomeAssemblyTask} is failed: Subtask {SPAdes tool} is failed: SPAdes tool exited with code 1

I am not sure where is a mistake now (I choose SPAdes, Paired-ends, I left properties in default mode, add equal number of files for left and right reads, dataset - multi cell, running mode - error correction and assembly, k-mer size - auto.
These are reads from unknown bacteriophage (dsDNA), not above 200k bp.

Regards
L.

IP Logged

Reply #3 - Jan 30^th, 2015 at 5:53pm

Olga Golosova Offline
YaBB Administrator

Posts: 338

Dear Leiga,

I was not able to reproduce the issue on our test data on the snapshot UGENE version (on Mac OS X 64-bit). I used, for example, the following sample data:
https://dl.dropboxusercontent.com/u/59362392/SRR1617092_1.fastq
https://dl.dropboxusercontent.com/u/59362392/SRR1617092_2.fastq

Could you please download the data and try to run SPAdes with them? The run may take ~0.5 hour.

Note that I used the following versions of the external tools:
- python 2.7
- SPAdes 3.1.1 (bin/spades.py file was specified as the tool)

Also, could you please send the YAML file (/Biofizyka/UGENE/Bakteriofagi/JD/R15011/datasets.yaml)?
And, if it is possible, it would be great if you could send some test files on which the issue is reproduced.

By the way, what was the sequencing platform?

IP Logged

Reply #4 - Jan 30^th, 2015 at 7:16pm

Leiga Offline
YaBB Newbies

Posts: 14

I think it is just a bad day

I run this app using your data:

Quote:

[ERROR][13:05] Mode: read error correction and assembling
[ERROR][13:05] Read error correction parameters:
[ERROR][13:05] ===== Read error correction started.
[ERROR][13:05] == Running read error correction tool: /Biofizyka/UGENE/ext_tools_mac_64-bit/SPAdes-3.1.1/bin/hammer /Biofizyka/UGENE/Testowe/corrected/configs/config.info

System?
NextSeq 500

yaml file:
Quote:

[
{
orientation: "fr",
type: "paired-end",
single reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L003_R1_001.fastq",
]
}
{
orientation: "fr",
type: "paired-end",
single reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L004_R1_001.fastq",
]
}
{
orientation: "fr",
type: "paired-end",
single reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L002_R1_001.fastq",
]
}
{
orientation: "fr",
type: "paired-end",
single reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L001_R1_001.fastq",
]
}
]

Hope, solution is easy to find, and it is just my fault.
Regards
L.

IP Logged

Reply #5 - Jan 30^th, 2015 at 8:44pm

Olga Golosova Offline
YaBB Administrator

Posts: 338

Yeap, this is definitely not the best day

Quote:

[ERROR][13:05] Mode: read error correction and assembling
[ERROR][13:05] Read error correction parameters:
[ERROR][13:05] ===== Read error correction started.
[ERROR][13:05] == Running read error correction tool: /Biofizyka/UGENE/ext_tools_mac_64-bit/SPAdes-3.1.1/bin/hammer /Biofizyka/UGENE/Testowe/corrected/configs/config.info

This "errors" are not actually errors. You can skip this UGENE status. It happens because the log lines are parsed incorrectly. Notice that each of the log lines you posted contains the "error" word.

Has the pipeline with the sample data finished successfully anyway?

Thanks for the YAML file. We will investigate this problem.

Links to the issues in the bug-tracker:
* SPAdes error: exception caught while parsing YAML file:
https://local.ugene.unipro.ru/tracker/browse/UGENE-3967

* SPAdes log is parsed incorrectly:
https://local.ugene.unipro.ru/tracker/browse/UGENE-3966

IP Logged

Reply #6 - Jan 31^st, 2015 at 12:54am

Leiga Offline
YaBB Newbies

Posts: 14

Yes, assembly reach the end of the process and finally I have several contigs from your data.
After that I tried to do the same with my data and have the same log as before but different yaml file:

Quote:

[
{
orientation: "fr",
type: "paired-end",
left reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L003_R1_001.fastq",
],
right reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L003_R2_001.fastq",
],
}
{
orientation: "fr",
type: "paired-end",
left reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L004_R1_001.fastq",
],
right reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L004_R2_001.fastq",
],
}
{
orientation: "fr",
type: "paired-end",
left reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L002_R1_001.fastq",
],
right reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L002_R2_001.fastq",
],
}
{
orientation: "fr",
type: "paired-end",
left reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L001_R1_001.fastq",
],
right reads: [
"/Biofizyka/BaseSpace/R15011/R15011_S11_L001_R2_001.fastq",
],
}
]

Maybe there is a problem with file names?

IP Logged

Reply #7 - Feb 3^rd, 2015 at 7:05pm

Yuriy Vaskin Offline
Global Moderator

Gender:
Posts: 138

Dear Leiga,

It looks like there is a bug with interlaced paired-read processing. It will be fixed in the next UGENE release thanks to your help.

For now you could try using the paired-end mode with demultiplexed left and right reads.

IP Logged

Reply #8 - Feb 3^rd, 2015 at 7:34pm

Olga Golosova Offline
YaBB Administrator

Posts: 338

Dear Leiga,

Alternatively, you may also use a new snapshot with the fixture! I will write you as soon as it is ready. I think, it will be tomorrow.
Sorry again for these problems!

Olga

IP Logged

Reply #9 - Feb 4^th, 2015 at 10:17pm

Olga Golosova Offline
YaBB Administrator

Posts: 338

Dear Leiga,

Could you please try the new snapshot (revision must be >= 9049)?
Can be downloaded from: http://ugene.unipro.ru/snapshot.html

Thank you very much!

Kind regards,
Olga

IP Logged

Reply #10 - Feb 6^th, 2015 at 1:49am

Leiga Offline
YaBB Newbies

Posts: 14

Dear Olga,
below you can find log after new run of app (this new one):
Quote:

[INFO][15:32] UGENE started
[INFO][15:32] UGENE version: 1.16.0-dev 64-bit
[INFO][15:32] UGENE distribution: portable
[INFO][15:32] Starting {Check for updates} task
[INFO][15:32] Task {Check for updates} finished
[ERROR][19:40] Spades: == Error == system call for: "['/Biofizyka/UGENE/ext_tools_mac_64-bit/SPAdes-3.1.1/bin/hammer', '/Biofizyka/UGENE/Bakteriofagi/JD/R15011/corrected/configs/config.info']" finished abnormally, err code: -9
[ERROR][19:40] == Error == system call for: "['/Biofizyka/UGENE/ext_tools_mac_64-bit/SPAdes-3.1.1/bin/hammer', '/Biofizyka/UGENE/Bakteriofagi/JD/R15011/corrected/configs/config.info']" finished abnormally, err code: -9
[ERROR][19:40] Task {GenomeAssemblyMultiTask} finished with error: Subtask {GenomeAssemblyTask} is failed: Subtask {SPAdes tool} is failed: SPAdes tool exited with code 1

As you can see it takes some time, and computer was very unstable (i did not see that before, during alignment with bowtie cpu was used in 90-98% for ugene app, but now it was strange, like sea waves, 2-90% for hammer app).
Regards,
L.

IP Logged

Reply #11 - Feb 6^th, 2015 at 8:58pm

Olga Golosova Offline
YaBB Administrator

Posts: 338

Dear Leiga,

We are not able to reproduce the error on our test data.

It seems that now it is a problem in the SPAdes tool (http://bioinf.spbau.ru/spades), integrated into UGENE for assembly of sequencing data. It seems that the error occurs on particular data. As can be seen from the log, the error happened several hours later after you had launched the tool.

Could you please try to launch SPAdes from the command line to make sure that this error is indeed inside the SPAdes algorithm?

Below are instructions to do it:
1) Create a new folder.
2) Put into the folder:
2.1) the input files ("R15011_S11_L003_R1_001.fastq", etc.).
2.2) "/Biofizyka/UGENE/Bakteriofagi/JD/R15011/datasets.yaml" file.
3) Launch "Terminal" on Mac OS.
4) In the terminal change directory to the created folder. To do it input:
Code:

cd /path/to/new/folder

5) Launch SPAdes from the terminal. To do it input:
Code:

python /path/to/spades/spades.py --dataset datasets.yaml -t 2 -o /path/to/output

Kind regards,
Olga

IP Logged

Reply #12 - Mar 4^th, 2015 at 7:16pm

Leiga Offline
YaBB Newbies

Posts: 14

Log report from newest version of UGENE release and command line is the same....

UGENE 1.16.0

Quote:

Command line: /Volumes/Unipro UGENE 1.16.0/Unipro UGENE.app/Contents/MacOS/tools/SPAdes-3.1.1/bin/spades.py --dataset /Biofizyka/UGENE/Bakteriofagi/JD/R15011/datasets.yaml -t 4 -m 250 -o /Biofizyka/UGENE/Bakteriofagi/JD/R15011

System information:
SPAdes version: 3.1.1
Python version: 2.7.5
OS: Darwin-14.0.0-x86_64-i386-64bit

Output dir: /Biofizyka/UGENE/Bakteriofagi/JD/R15011
Mode: read error correction and assembling
Debug mode is turned OFF

Dataset parameters:
Multi-cell mode (you should set '--sc' flag if input data was obtained with MDA (single-cell) technology
Reads:
Library number: 1, library type: paired-end
   orientation: fr
   left reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L003_R1_001.fastq']
   right reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L004_R2_001.fastq']
   interlaced reads: not specified
   single reads: not specified
Library number: 2, library type: paired-end
   orientation: fr
   left reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L004_R1_001.fastq']
   right reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L003_R2_001.fastq']
   interlaced reads: not specified
   single reads: not specified
Library number: 3, library type: paired-end
   orientation: fr
   left reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L002_R1_001.fastq']
   right reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L002_R2_001.fastq']
   interlaced reads: not specified
   single reads: not specified
Library number: 4, library type: paired-end
   orientation: fr
   left reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L001_R1_001.fastq']
   right reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L001_R2_001.fastq']
   interlaced reads: not specified
   single reads: not specified
Read error correction parameters:
Iterations: 1
PHRED offset will be auto-detected
Corrected reads will be compressed (with gzip)
Assembly parameters:
k: automatic selection based on read length
Mismatch careful mode is turned OFF
Repeat resolution is enabled
MismatchCorrector will be SKIPPED
Other parameters:
Dir for temp files: /Biofizyka/UGENE/Bakteriofagi/JD/R15011/tmp
Threads: 4
Memory limit (in Gb): 250

======= SPAdes pipeline started. Log can be found here: /Biofizyka/UGENE/Bakteriofagi/JD/R15011/spades.log

===== Read error correction started.

== Running read error correction tool: /Volumes/Unipro UGENE 1.16.0/Unipro UGENE.app/Contents/MacOS/tools/SPAdes-3.1.1/bin/hammer /Biofizyka/UGENE/Bakteriofagi/JD/R15011/corrected/configs/config.info

0:00:00.000 4M / 4M INFO General                (main.cpp                : 82) Loading config from /Biofizyka/UGENE/Bakteriofagi/JD/R15011/corrected/configs/config.info
0:00:00.001 4M / 4M INFO General                (memory_limit.hpp       : 42) Memory limit set to 250 Gb
0:00:00.001 4M / 4M INFO General                (main.cpp                : 91) Trying to determine PHRED offset
0:00:00.001 4M / 4M INFO General                (main.cpp                : 97) Determined value is 33
0:00:00.001 4M / 4M INFO General                (hammer_tools.cpp       : 36) Hamming graph threshold tau=1, k=21, subkmer positions = [ 0 10 ]
   === ITERATION 0 begins ===
0:00:00.001 4M / 4M INFO K-mer Index Building    (kmer_index.hpp          : 467) Building kmer index
0:00:00.001 4M / 4M INFO K-mer Splitting       (kmer_data.cpp          : 127) Splitting kmer instances into 64 buckets. This might take a while.
0:00:00.001 4M / 4M INFO General                (file_limit.hpp          : 29) Open file limit set to 7168
0:00:00.001 4M / 4M INFO K-mer Splitting       (kmer_data.cpp          : 145) Memory available for splitting buffers: 20.833 Gb
0:00:00.001 4M / 4M INFO K-mer Splitting       (kmer_data.cpp          : 153) Using cell size of 1048576
0:00:00.002 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L003_R1_001.fastq
0:00:15.702 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 960047 reads
0:00:29.729 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 1932674 reads
0:00:39.973 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 2686738 reads
0:00:39.973 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L004_R2_001.fastq
0:00:53.462 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 3639774 reads
0:01:07.661 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 4605240 reads
0:01:19.003 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 5398992 reads
0:01:19.003 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L004_R1_001.fastq
0:01:31.349 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 6357087 reads
0:01:43.646 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 7328546 reads
0:01:53.383 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L003_R2_001.fastq
0:02:06.050 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 9072191 reads
0:02:29.045 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L002_R1_001.fastq
0:03:05.231 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L002_R2_001.fastq
0:03:39.098 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L001_R1_001.fastq
0:03:51.803 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 16827403 reads
0:04:11.342 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L001_R2_001.fastq
0:04:45.876 3G / 3G INFO K-mer Splitting       (kmer_data.cpp          : 181) Processed 20718382 reads
0:04:45.951 16M / 3G INFO General                (kmer_index.hpp          : 345) Starting k-mer counting.
0:10:19.740 16M / 3G INFO General                (kmer_index.hpp          : 351) K-mer counting done. There are 398806740 kmers in total.
0:10:19.740 16M / 3G INFO General                (kmer_index.hpp          : 353) Merging temporary buckets.
0:11:56.680 16M / 3G INFO K-mer Index Building    (kmer_index.hpp          : 476) Building perfect hash indices
0:14:57.270 148M / 3G INFO General                (kmer_index.hpp          : 371) Merging final buckets.
0:15:34.227 148M / 3G INFO K-mer Index Building    (kmer_index.hpp          : 515) Index built. Total 137962246 bytes occupied (2.7675 bits per kmer).
0:15:34.464 148M / 3G INFO K-mer Counting          (kmer_data.cpp          : 266) Arranging kmers in hash map order
0:18:22.253 148M / 3G INFO K-mer Counting          (kmer_data.cpp          : 279) Done. Total swaps: 398806495
0:18:27.338 3G / 3G INFO General                (main.cpp                : 151) Clustering Hamming graph.
0:18:27.356 3G / 3G INFO Hamming Clustering    (hamcluster.cpp          : 115) Serializing sub-kmers.
0:18:27.356 3G / 3G INFO Hamming Clustering    (hamcluster.cpp          : 120) Serializing: [0, 10)
0:20:21.479 3G / 3G INFO Hamming Clustering    (hamcluster.cpp          : 120) Serializing: [10, 21)
0:22:02.104 3G / 3G INFO Hamming Clustering    (hamcluster.cpp          : 129) Splitting sub-kmers, pass 1.
0:32:11.949 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 134) Splitting done. Processed 2 blocks. Produced 5242822 blocks.
0:32:11.952 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 145) Merge sub-kmers, pass 1
0:52:47.891 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 170) Merge done, total 3618766 new blocks generated.
0:52:50.299 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 175) Spliting sub-kmers, pass 2.
1:08:02.025 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 180) Splitting done. Processed 7237532 blocks. Produced 850399815 blocks.
1:08:02.025 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 187) Merge sub-kmers, pass 2
1:42:50.713 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 205) Merge done, saw 440263 big blocks out of 850399815 processed.

== Error == system call for: "['/Volumes/Unipro UGENE 1.16.0/Unipro UGENE.app/Contents/MacOS/tools/SPAdes-3.1.1/bin/hammer', '/Biofizyka/UGENE/Bakteriofagi/JD/R15011/corrected/configs/config.info']" finished abnormally, err code: -9

In case you have troubles running SPAdes, you can write to spades.support@bioinf.spbau.ru
Please provide us with params.txt and spades.log files from the output directory.

and directly from the command line:

Quote:

MacBook-Pro-Dominik:R15011 Dominik$ python /Biofizyka/UGENE/ext_tools_mac_64-bit/SPAdes-3.1.1/bin/spades.py --dataset datasets.yaml -t 2 -o /Biofizyka/SPADES/Bakteriofagi/R15011
Command line: /Biofizyka/UGENE/ext_tools_mac_64-bit/SPAdes-3.1.1/bin/spades.py --dataset datasets.yaml -t 2 -o /Biofizyka/SPADES/Bakteriofagi/R15011

System information:
SPAdes version: 3.1.1
Python version: 2.7.6
OS: Darwin-14.0.0-x86_64-i386-64bit

Output dir: /Biofizyka/SPADES/Bakteriofagi/R15011
Mode: read error correction and assembling
Debug mode is turned OFF

Dataset parameters:
Multi-cell mode (you should set '--sc' flag if input data was obtained with MDA (single-cell) technology
Reads:
Library number: 1, library type: paired-end
   orientation: fr
   left reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L003_R1_001.fastq']
   right reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L004_R2_001.fastq']
   interlaced reads: not specified
   single reads: not specified
Library number: 2, library type: paired-end
   orientation: fr
   left reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L004_R1_001.fastq']
   right reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L003_R2_001.fastq']
   interlaced reads: not specified
   single reads: not specified
Library number: 3, library type: paired-end
   orientation: fr
   left reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L002_R1_001.fastq']
   right reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L002_R2_001.fastq']
   interlaced reads: not specified
   single reads: not specified
Library number: 4, library type: paired-end
   orientation: fr
   left reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L001_R1_001.fastq']
   right reads: ['/Biofizyka/BaseSpace/R15011/R15011_S11_L001_R2_001.fastq']
   interlaced reads: not specified
   single reads: not specified
Read error correction parameters:
Iterations: 1
PHRED offset will be auto-detected
Corrected reads will be compressed (with gzip)
Assembly parameters:
k: automatic selection based on read length
Mismatch careful mode is turned OFF
Repeat resolution is enabled
MismatchCorrector will be SKIPPED
Other parameters:
Dir for temp files: /Biofizyka/SPADES/Bakteriofagi/R15011/tmp
Threads: 2
Memory limit (in Gb): 250

======= SPAdes pipeline started. Log can be found here: /Biofizyka/SPADES/Bakteriofagi/R15011/spades.log

===== Read error correction started.

== Running read error correction tool: /Biofizyka/UGENE/ext_tools_mac_64-bit/SPAdes-3.1.1/bin/hammer /Biofizyka/SPADES/Bakteriofagi/R15011/corrected/configs/config.info

0:00:00.000 4M / 4M INFO General                (main.cpp                : 82) Loading config from /Biofizyka/SPADES/Bakteriofagi/R15011/corrected/configs/config.info
0:00:00.017 4M / 4M INFO General                (memory_limit.hpp       : 42) Memory limit set to 250 Gb
0:00:00.017 4M / 4M INFO General                (main.cpp                : 91) Trying to determine PHRED offset
0:00:00.033 4M / 4M INFO General                (main.cpp                : 97) Determined value is 33
0:00:00.033 4M / 4M INFO General                (hammer_tools.cpp       : 36) Hamming graph threshold tau=1, k=21, subkmer positions = [ 0 10 ]
   === ITERATION 0 begins ===
0:00:00.034 4M / 4M INFO K-mer Index Building    (kmer_index.hpp          : 467) Building kmer index
0:00:00.034 4M / 4M INFO K-mer Splitting       (kmer_data.cpp          : 127) Splitting kmer instances into 32 buckets. This might take a while.
0:00:00.034 4M / 4M INFO General                (file_limit.hpp          : 29) Open file limit set to 2560
0:00:00.034 4M / 4M INFO K-mer Splitting       (kmer_data.cpp          : 145) Memory available for splitting buffers: 41.666 Gb
0:00:00.034 4M / 4M INFO K-mer Splitting       (kmer_data.cpp          : 153) Using cell size of 2097152
0:00:00.034 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L003_R1_001.fastq
0:00:09.269 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 328870 reads
0:00:18.315 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 656668 reads
0:00:27.492 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 983813 reads
0:00:36.299 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 1314708 reads
0:00:45.175 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 1650229 reads
0:00:54.090 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 1983860 reads
0:01:02.950 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 2321472 reads
0:01:12.558 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L004_R2_001.fastq
0:01:57.690 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 4323327 reads
0:02:26.490 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L004_R1_001.fastq
0:03:40.680 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L003_R2_001.fastq
0:03:49.700 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 8438882 reads
0:04:53.694 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L002_R1_001.fastq
0:06:05.238 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L002_R2_001.fastq
0:07:16.456 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L001_R1_001.fastq
0:07:44.341 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 176) Processed 16849411 reads
0:08:24.308 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 167) Processing /Biofizyka/BaseSpace/R15011/R15011_S11_L001_R2_001.fastq
0:09:31.820 1G / 1G INFO K-mer Splitting       (kmer_data.cpp          : 181) Processed 20718382 reads
0:09:31.848 8M / 1G INFO General                (kmer_index.hpp          : 345) Starting k-mer counting.
0:14:34.247 8M / 1G INFO General                (kmer_index.hpp          : 351) K-mer counting done. There are 398806740 kmers in total.
0:14:34.247 8M / 1G INFO General                (kmer_index.hpp          : 353) Merging temporary buckets.
0:19:29.229 8M / 1G INFO K-mer Index Building    (kmer_index.hpp          : 476) Building perfect hash indices
0:24:23.249 144M / 1G INFO General                (kmer_index.hpp          : 371) Merging final buckets.
0:25:12.327 144M / 1G INFO K-mer Index Building    (kmer_index.hpp          : 515) Index built. Total 137962246 bytes occupied (2.7675 bits per kmer).
0:25:12.583 144M / 1G INFO K-mer Counting          (kmer_data.cpp          : 266) Arranging kmers in hash map order
0:30:51.874 144M / 1G INFO K-mer Counting          (kmer_data.cpp          : 279) Done. Total swaps: 398806450
0:30:54.280 3G / 3G INFO General                (main.cpp                : 151) Clustering Hamming graph.
0:30:54.312 3G / 3G INFO Hamming Clustering    (hamcluster.cpp          : 115) Serializing sub-kmers.
0:30:54.312 3G / 3G INFO Hamming Clustering    (hamcluster.cpp          : 120) Serializing: [0, 10)
0:32:52.293 3G / 3G INFO Hamming Clustering    (hamcluster.cpp          : 120) Serializing: [10, 21)
0:34:31.253 3G / 3G INFO Hamming Clustering    (hamcluster.cpp          : 129) Splitting sub-kmers, pass 1.
0:43:42.177 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 134) Splitting done. Processed 2 blocks. Produced 5242822 blocks.
0:43:42.190 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 145) Merge sub-kmers, pass 1
1:01:29.652 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 170) Merge done, total 3618766 new blocks generated.
1:01:31.586 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 175) Spliting sub-kmers, pass 2.
1:15:03.447 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 180) Splitting done. Processed 7237532 blocks. Produced 850399815 blocks.
1:15:03.474 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 187) Merge sub-kmers, pass 2
1:54:34.969 3G / 9G INFO Hamming Clustering    (hamcluster.cpp          : 205) Merge done, saw 440263 big blocks out of 850399815 processed.

== Error == system call for: "['/Biofizyka/UGENE/ext_tools_mac_64-bit/SPAdes-3.1.1/bin/hammer', '/Biofizyka/SPADES/Bakteriofagi/R15011/corrected/configs/config.info']" finished abnormally, err code: -9

In case you have troubles running SPAdes, you can write to spades.support@bioinf.spbau.ru
Please provide us with params.txt and spades.log files from the output directory.
MacBook-Pro-Dominik:R15011 Dominik$

So... problem still exist, maybe it is time to change dataset to another one.

Regards
L.

IP Logged

Reply #13 - Mar 4^th, 2015 at 7:41pm

Olga Golosova Offline
YaBB Administrator

Posts: 338

Leiga, thanks for testing!

IP Logged

Reply #14 - Mar 4^th, 2015 at 8:24pm

Leiga Offline
YaBB Newbies

Posts: 14

So, I will change fastq files which gives me nice contig in clc software, and will test them with UGENE/SPADES
I think I am not able to test it on windows, there is no tool for that. Am I correct?
L.

IP Logged

Pages: 1 2

Print

‹ Previous Topic | Next Topic ›

Top of this page

UGENE Forum » Powered by YaBB 2.5 AE!
YaBB Forum Software © 2000-2010. All Rights Reserved.

Valid XHTML

Valid CSS

Powered by Perl

Source Forge