Skip to content

Evict idle GroupByScheduler groups to reduce retained memory #12220

Description

@Kkartik14

Expected Behavior

Idle groups should be stopped and removed after a configurable timeout. Groups with running or queued work must remain active, and stale timers must not remove groups that have been reused.

Actual Behavior

GroupByScheduler retains one scheduler per group key for the lifetime of the process. High-cardinality outbound traffic can therefore retain idle groups and their resources after traffic stops.

Steps to Reproduce the Problem

  1. Submit tasks using many unique group keys.
  2. Stop submitting tasks for those keys.
  3. Observe that the group schedulers remain retained indefinitely.

Specifications

  • Version: main
  • Platform: Server-side behavior

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions