Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Notify before silence ends #268

Open
marcusboden opened this issue Jun 18, 2024 · 0 comments
Open

Notify before silence ends #268

marcusboden opened this issue Jun 18, 2024 · 0 comments

Comments

@marcusboden
Copy link

marcusboden commented Jun 18, 2024

Enhancement Proposal

When a silence expires, we will get the alert again. That makes sense and should be this way.
However, oftentimes the reason for the silence has still not been fixed. The alert itself does not contain any information about the expired silence, sending us down the rabbit hole of investigating this alert again.

I would like a notification before the silence expires so that the person responding to alerts will know what to expect and can extend the silence on time.

amtool has some features for that and I'm thinking about building that with a cron job running amtool silence query --within 1h and using the output to create a manual alert with amtool. But it would be nice for this to be integrated into cos.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant