Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Telemetry scraping will fail when mozilla-central moves from hg to git #680

Open
chutten opened this issue Jan 12, 2024 · 0 comments
Open

Comments

@chutten
Copy link
Contributor

chutten commented Jan 12, 2024

mozilla-central is moving from hg to git sometime in the medium term. When that happens, we can expect hgweb to either stop or change, which will interfere with the Telemetry parts of probe-scraper (the pieces that fuel the automated intake of new or changed histograms, scalars, and events which in turn fuel tooling and the pipeline itself).

There are a couple things I can think of that we can do about this

  1. Nothing. Freeze the intake of new/changed Telemetry histograms, scalars, and events. Tools like probe dictionary will stop being updated, and columns will not be added for new probes without manual schema changes. This should probably only be the chosen solution if Firefox Desktop development decides to deprecate the use of Telemetry probes for instrumentation, or otherwise can be relied upon to keep the volume of such additions low enough that manual schema editing is acceptable.
  2. Migrate the scraper to become a git scraper. The crunchier parts of the code are mozparsers, and they don't care what the VCS is: the only parts to move are the bits that understand revisions, releases, and time (ohno.jpg). Shouldn't be too taxing, but as we're hoping to minimize the number of supported data collection systems in Mozilla projects going forward, it'd be likely that the migrated code wouldn't be useful for long.

No doubt there are other options.

As there is as-yet no specific date of hgweb's freezing or demise (or certainty of its fate), we can backburner this and use it more as a place to accumulate information and ideas until we hear more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant