Problem with large codebase

[chinyeungli]

Description

Scancode gives Timeout Error when I launched an info scans on a large codebase which consist of more than 1m files.

The last line's error message:

multiprocessing.TimeoutError

It seems to be scancode doesn't work very well in a huge codebase.

How To Reproduce

This is the command that I used

scancode -n2 -i <project> --json <output.json> --csv <output.csv>

[NoobSolver]

@chinyeungli It is showing not only this error but also run time error when I loaded some files in it.It is also a bug.

[pombredanne]

@Angi2412 @NoobSolver @chinyeungli this is a complex error to solve. I think there are several fixes that should help in the latest code, but there are likely a few gremlins in places. I will try to find a way that we do not fail.