Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

shutil.rmtree() gives FileNotFoundError when multiple processes are running #104

Open
ljmills opened this issue Jan 10, 2025 · 0 comments
Open

Comments

@ljmills
Copy link

ljmills commented Jan 10, 2025

When I run multiple instances of gtex_rnaseq_V10.sif on the same node I get the following error:
Jan 10 10:54:05 ..... started mapping
Jan 10 10:58:40 ..... finished mapping
Jan 10 10:58:45 ..... finished successfully
Traceback (most recent call last):
File "/src/run_STAR.py", line 135, in
shutil.rmtree(f'{args.prefix}._STARtmp')
File "/usr/lib/python3.10/shutil.py", line 725, in rmtree
_rmtree_safe_fd(fd, path, onerror)
File "/usr/lib/python3.10/shutil.py", line 681, in _rmtree_safe_fd
onerror(os.unlink, fullname, sys.exc_info())
File "/usr/lib/python3.10/shutil.py", line 679, in _rmtree_safe_fd
os.unlink(entry.name, dir_fd=topfd)
FileNotFoundError: [Errno 2] No such file or directory: '.nfs4659ceee90ac64b50000027d'
Mark Dups STAR mapping SRR15880878

This seems to be an issue with shutil.rmtree() that has been fixed in later versions of python. Would it be possible to update the version of python in gtex image? The image works fine if there is only 1 instance running on a node but as soon as I have multiple I get this error every time.

https://stackoverflow.com/questions/64687047/shutil-rmtree-filenotfounderror-errno-2-no-such-file-or-directory-xxx

Thanks,
-L

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant