RedHat importer is slow

[keshav-space]

There is scope for improvement in RedHat importer that could really speed up the process

We can proceed along these lines

• oval support for RedHat ( https://www.redhat.com/security/data/oval/ )
• reducing the number of network calls ( as of now RedHat Importer makes 3 network calls per advisory)
• doing some parallel processing?

[keshav-space]

This has been resolved in v2 redhat pipeline see #1971. New pipeline imports RHSA, RHEA and RHBA from https://security.access.redhat.com/data/csaf/v2/advisories/ run time of pipeline is ~7 hours which significantly faster compared to old importer which took ~18-20 hours.

INFO 2026-01-27 09:38:25.900760 UTC Pipeline [RedHatImporterPipeline] starting
INFO 2026-01-27 09:38:25.901007 UTC Step [fetch] starting
INFO 2026-01-27 09:38:51.138356 UTC Step [fetch] completed in 25 seconds
INFO 2026-01-27 09:38:51.138478 UTC Step [collect_and_store_advisories] starting
INFO 2026-01-27 09:38:51.200870 UTC Collecting 22,292 advisories
INFO 2026-01-27 09:48:24.575091 UTC Progress: 10% (2230/22292) ETA: 5160 seconds (1.4 hours)
INFO 2026-01-27 10:09:10.743322 UTC Progress: 20% (4459/22292) ETA: 7278 seconds (2.0 hours)
INFO 2026-01-27 10:35:18.435433 UTC Progress: 30% (6688/22292) ETA: 7904 seconds (2.2 hours)
INFO 2026-01-27 11:05:53.772163 UTC Progress: 40% (8917/22292) ETA: 7834 seconds (2.2 hours)
INFO 2026-01-27 11:35:51.662037 UTC Progress: 50% (11146/22292) ETA: 7020 seconds (1.9 hours)
INFO 2026-01-27 12:13:47.261362 UTC Progress: 60% (13376/22292) ETA: 6197 seconds (1.7 hours)
INFO 2026-01-27 13:14:50.422018 UTC Progress: 70% (15605/22292) ETA: 5554 seconds (1.5 hours)
INFO 2026-01-27 14:15:24.692672 UTC Progress: 80% (17834/22292) ETA: 4148 seconds (1.2 hours)
INFO 2026-01-27 15:17:37.087963 UTC Progress: 90% (20063/22292) ETA: 2258 seconds (37.6 minutes)
INFO 2026-01-27 16:19:52.428374 UTC Progress: 100% (22292/22292)
INFO 2026-01-27 16:19:52.643285 UTC Successfully collected 22,292 advisories
INFO 2026-01-27 16:19:52.643407 UTC Step [collect_and_store_advisories] completed in 24062 seconds (6.7 hours)
INFO 2026-01-27 16:19:52.643438 UTC Step [clean_download] starting
INFO 2026-01-27 16:19:52.643469 UTC Removing downloaded archive: csaf_advisories_2026-01-24.tar.zst
INFO 2026-01-27 16:19:53.125674 UTC Step [clean_download] completed in 0 seconds
INFO 2026-01-27 16:19:53.125804 UTC Pipeline completed in 24087 seconds (6.7 hours)