GitLab

A group of us are trying to run the wolf tutorial and we all get an error trying to import the sequences into a DMS:

2023-09-08 15:03:44,255 [import : INFO ]  obi import: imports an object (file(s), obiview, taxonomy...) into a DMS
2023-09-08 15:03:44,258 [import : INFO ]  Opened file: wolf_tutorial/wolf_F.fastq
2023-09-08 15:03:44,300 [import : INFO ]  Importing 45276 entries
  72.4 % |####################################|              ] remain : 00:00:0StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/tdivoll/.pyenv/versions/3.8.10/bin/obi", line 62, in <module>
    config[root_config_name]['module'].run(config)
  File "python/obitools3/commands/import.pyx", line 333, in obitools3.commands.import.run
  File "python/obitools3/parsers/fastq.pyx", line 106, in fastqWithQualityIterator
RuntimeError: generator raised StopIteration``` 

I can get the seqs to import if I use the --only flag for one less than the total number of sequences:

2023-09-08 15:04:12,641 [import : INFO ]  obi import: imports an object (file(s), obiview, taxonomy...) into a DMS
2023-09-08 15:04:12,643 [import : INFO ]  Opened file: wolf_tutorial/wolf_F.fastq
2023-09-08 15:04:12,685 [import : INFO ]  Importing 45275 entries
 100.0 % |##################################################/] remain : 00:00:0
2023-09-08 15:04:13,115 [import : INFO ]  Imported 45275 entries
2023-09-08 15:04:13,131 [import : INFO ]  Done.

Could this be a bug? It seems like obi is looking for more sequences once it hits the end and then throws the error. We tested this locally on Mac M1 as well as on our HPC, with python versions 3.9.0 and 3.8.10. Interestingly, we get the same StopIteration error trying to import the wolf ngsfilter into the DMS, but the reference sequences import just fine.