Skip to content

fix(integration-v2): let publish_handoff create the report notebook - #423

Merged
gewenyu99 merged 2 commits into
mainfrom
vincent/notebook-via-publish-handoff
Oct 12, 2026
Merged

gewenyu99 merged 2 commits into
mainfrom
vincent/notebook-via-publish-handoff

Conversation

@gewenyu99

@gewenyu99 gewenyu99 commented Oct 12, 2026 •

Copy link
Copy Markdown
Collaborator

Problem

The integration-v2 report agent requires a notebook mirror through notebooks-create-markdown, which the MCP only lists when revamped-py-notebooks is on, so for most orgs the agent marks the required task failed after the report was already delivered.

Changes

  • report succeeds once publish_handoff goes through; the notebook is best effort and never fails the task (integration-v2 and metrics).
  • New wizards create the notebook inside publish_handoff. When the result names no notebook (older wizards), the agent picks the MCP tool the catalog lists: notebooks-create-markdown, or notebooks-create with one markdown-notebook node. Same for the legacy integration conclude step.
  • The agent branches on the result: created or updated (done), not created (final, the wizard already retried), not updated (the earlier notebook stays linked), or no mention (older wizard, MCP fallback).
  • Spells out the exact [NOTEBOOK_URL] line, since a markdown link is not picked up.

Replaces #376, whose branch predates the history rewrite.

Test plan

Check Result
npm test 219 passed
npm run build ok
Local stack, new wizard (before the review fixes) notebook made by publish_handoff, no MCP notebook call
Local stack, wizard 2.81.0 fallback made the notebook via the catalog; 6/6 steps, report done

Release order

Release #423 first. It is safe alone, because older wizards get no notebook note from publish_handoff and take the MCP fallback. PostHog/wizard#1437 must not reach users before #423 is served, or orgs with the flag on get two notebooks per run.

Sources

  • Wizard side: PostHog/wizard vincent/handoff-notebook (linked PR)
  • MCP flag gate: PostHog/posthog services/mcp/tests/unit/tool-filtering.test.ts

🤖 Generated with Claude Code

New wizards create the notebook inside publish_handoff. Older wizards fall
back to the MCP tool the catalog lists. A missing notebook never fails the
report task.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown

🧙 Wizard CI

Run the Wizard CI and test your changes against wizard-workbench example apps by replying with a GitHub comment using one of the following commands:

Test all apps:

  • /wizard-ci all

Test all apps in a directory:

  • /wizard-ci ai-observability
  • /wizard-ci basic-integration
  • /wizard-ci feature-flags
  • /wizard-ci mcp-analytics
  • /wizard-ci replay-vision
  • /wizard-ci revenue
  • /wizard-ci self-driving
  • /wizard-ci warehouse
  • /wizard-ci warehouse-seeded

Test an individual app:

  • /wizard-ci ai-observability/anthropic
  • /wizard-ci ai-observability/google-adk
  • /wizard-ci ai-observability/groq
Show more apps
  • /wizard-ci ai-observability/manual-capture
  • /wizard-ci ai-observability/openai
  • /wizard-ci ai-observability/openai-agents
  • /wizard-ci ai-observability/opentelemetry
  • /wizard-ci ai-observability/vercel-ai
  • /wizard-ci basic-integration/android
  • /wizard-ci basic-integration/angular
  • /wizard-ci basic-integration/astro
  • /wizard-ci basic-integration/django
  • /wizard-ci basic-integration/fastapi
  • /wizard-ci basic-integration/flask
  • /wizard-ci basic-integration/flutter
  • /wizard-ci basic-integration/javascript-node
  • /wizard-ci basic-integration/javascript-web
  • /wizard-ci basic-integration/laravel
  • /wizard-ci basic-integration/next-js
  • /wizard-ci basic-integration/nuxt
  • /wizard-ci basic-integration/python
  • /wizard-ci basic-integration/rails
  • /wizard-ci basic-integration/react-native
  • /wizard-ci basic-integration/react-router
  • /wizard-ci basic-integration/sveltekit
  • /wizard-ci basic-integration/swift
  • /wizard-ci basic-integration/tanstack-router
  • /wizard-ci basic-integration/tanstack-start
  • /wizard-ci basic-integration/vue
  • /wizard-ci feature-flags/django
  • /wizard-ci feature-flags/next-js
  • /wizard-ci mcp-analytics/custom-dispatcher
  • /wizard-ci mcp-analytics/typescript-sdk
  • /wizard-ci replay-vision/javascript-node
  • /wizard-ci replay-vision/next-js
  • /wizard-ci replay-vision/react-vite
  • /wizard-ci revenue/stripe
  • /wizard-ci self-driving/astro
  • /wizard-ci self-driving/fastapi
  • /wizard-ci self-driving/nuxt
  • /wizard-ci self-driving/react-router
  • /wizard-ci self-driving/sveltekit
  • /wizard-ci warehouse/monorepo-env
  • /wizard-ci warehouse/multi-source-next
  • /wizard-ci warehouse/stripe-node
  • /wizard-ci warehouse/zero-source
  • /wizard-ci warehouse-seeded/next-stripe
  • /wizard-ci warehouse-seeded/next-stripe-declined

Test against a wizard branch:

  • /wizard-ci all wizard:my-branch

Add wizard:<branch> to any command above to pin the wizard branch. It defaults to main.

Results will be posted here when complete.

@edwinyjlim edwinyjlim left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i think we need to apply these changes to the audit programs too

Add the not-updated branch, give the true no-retry reason (the wizard
already retried), restore an escaped-quote example, carve the report
notebook out of the MCP skill, and say publish_handoff runs once.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@gewenyu99
gewenyu99 marked this pull request as ready for review October 12, 2026 18:01
@gewenyu99
gewenyu99 requested a review from a team as a code owner October 12, 2026 18:01
@gewenyu99
gewenyu99 merged commit 52283a8 into main Oct 12, 2026
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants