Skip to content

feat(highwind): emit blobs conforming to the published results schema - #608

Merged
jaredlockhart merged 2 commits into
mozilla:mainfrom
JaredLockhart-Mozilla:highwind-blob-schema
Sep 28, 2026
Merged

jaredlockhart merged 2 commits into
mozilla:mainfrom
JaredLockhart-Mozilla:highwind-blob-schema

Conversation

@jaredlockhart

Copy link
Copy Markdown
Contributor

Because

  • Experimenter will load Highwind results against a shared schema in mozilla-nimbus-schemas.
  • Young experiments produced no blob, and the blob lacked per-branch values and run errors.

This commit

  • Builds the blob from the HighwindAnalysis model, so a shape error fails before upload.
  • Emits every metric for every segment from day one, with per-branch values and the run's errors.

Tracked by EXP-7605.

Checklist for reviewer:

  • Commits should reference a bug or github issue, if relevant (if a bug is referenced, the pull request should include the bug number in the title)

  • Scan the PR and verify that no changes (particularly to .circleci/config.yml) will cause environment variables (particularly credentials) to be exposed in test logs

  • Ensure the container image will be using permissions granted to telemetry-airflow responsibly.

Because

* Experimenter will load Highwind results against a shared schema in mozilla-nimbus-schemas.
* Young experiments produced no blob, and the blob lacked per-branch values and run errors.

This commit

* Builds the blob from the HighwindAnalysis model, so a shape error fails before upload.
* Emits every metric for every segment from day one, with per-branch values and the run's errors.

Tracked by [EXP-7605](https://mozilla-hub.atlassian.net/browse/EXP-7605).
@jaredlockhart
jaredlockhart requested a review from a team as a code owner September 25, 2026 15:31

@yashikakhurana yashikakhurana left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh so more intact, error prones too, thank you @jaredlockhart this looks good to me

Comment thread jobs/highwind/highwind/analysis.py Outdated
Comment on lines +337 to +339
else sql_running.count_branch_units(
client, sql_generation.branch_units_query(cohort_table)
)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should this be wrapped in its own try, otherwise this failing may affect the already computed cells

Because

* A failed unit-count query discarded every experiment's computed statistics

This commit

* Isolates the unit count so its failure is logged and branch units fall back to zero
@jaredlockhart
jaredlockhart merged commit 2becfb2 into mozilla:main Sep 28, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants