Skip to content

Check date before downloading data - #241

Merged
sbs2001 merged 2 commits into
aboutcode-org:developfrom
sbs2001:use_last_date
Aug 13, 2020
Merged

Check date before downloading data#241
sbs2001 merged 2 commits into
aboutcode-org:developfrom
sbs2001:use_last_date

Conversation

@sbs2001

@sbs2001 sbs2001 commented Aug 5, 2020

Copy link
Copy Markdown
Collaborator

Debian's json security tracker provides a last-modifed date. This PR checks when the data was last imported and compares it with last-modifed date and decides whether to continue or not.

sbs2001 added 2 commits August 5, 2020 13:19
Debian's security tracker provides a last-modified date in  response header.
This is leveraged by comparing it to date the importer was last ran. If
it is ran before the last-modified date we can proceed to do normal import,
otherwise stop since we already have the data.

Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
@sbs2001
sbs2001 merged commit 2a9f725 into aboutcode-org:develop Aug 13, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants