Skip to content

fix(ai-review): stop models wrapping the review in a code block#36303

Merged
wezell merged 1 commit into
mainfrom
fix-ai-review-markdown-fence
Jun 24, 2026
Merged

fix(ai-review): stop models wrapping the review in a code block#36303
wezell merged 1 commit into
mainfrom
fix-ai-review-markdown-fence

Conversation

@wezell

@wezell wezell commented Jun 24, 2026

Copy link
Copy Markdown
Member

Problem

The Qwen reviewer rendered its entire review inside a fenced code block — see example on #36076. The ## Output format section of gpt-auto-review.md showed the expected structure inside triple backticks as an example, and the model copied that fence literally around its whole output, so it rendered as raw text instead of markdown.

Fix

Remove the example fence and add an explicit instruction to reply in raw GitHub-flavored markdown, not wrapped in a code block. Model-agnostic — no change for models that were already formatting correctly (Opus, R1, etc.).

Fixes: #36131

🤖 Generated with Claude Code

The output-format section showed the expected structure inside a triple-backtick
fence as an example. Some models (e.g. qwen3-next-80b) copied that fence literally,
wrapping their entire review in a code block so it rendered as raw text instead of
markdown. Remove the example fence and instruct the model to reply in raw
GitHub-flavored markdown, not wrapped in a code block.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@wezell wezell requested a review from a team as a code owner June 24, 2026 02:39
@github-actions github-actions Bot added the Area : Documentation PR changes documentation files label Jun 24, 2026
@claude

claude Bot commented Jun 24, 2026

Copy link
Copy Markdown
Contributor

Claude finished @wezell's task in 49s —— View job


Rollback Safety Analysis

  • Read rollback-unsafe categories reference
  • Get full PR diff
  • Analyze diff against unsafe categories
  • Apply appropriate label

The single changed file is .github/prompts/gpt-auto-review.md. The diff:

  1. Removes the opening triple-backtick fence around the output format example
  2. Removes the closing triple-backtick fence
  3. Adds an explicit instruction to respond in raw GitHub-flavored markdown without wrapping in a code block

This is a documentation/prompt file change only — it touches no Java code, no database migrations, no Elasticsearch mappings, no REST API contracts, no OSGi interfaces, no VTL viewtools, no push-publishing bundle schemas, and no data model. It does not match any rollback-unsafe category (C-1 through C-4, H-1 through H-8, M-1 through M-4).

Label applied: AI: Safe To Rollback

@github-actions

github-actions Bot commented Jun 24, 2026

Copy link
Copy Markdown
Contributor

🤖 Bedrock Review — qwen.qwen3-next-80b-a3b

No issues found.


Run: #28071350376 · tokens: in: 1331 · out: 14 · total: 1345

@wezell wezell added this pull request to the merge queue Jun 24, 2026
@mergify

mergify Bot commented Jun 24, 2026

Copy link
Copy Markdown

Tick the box to add this pull request to the merge queue (same as @mergifyio queue).

  • Queue this pull request

Merged via the queue into main with commit 5b3d511 Jun 24, 2026
38 of 39 checks passed
@wezell wezell deleted the fix-ai-review-markdown-fence branch June 24, 2026 14:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

AI: Safe To Rollback Area : Documentation PR changes documentation files

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

feat: switch automatic PR code reviews to GPT-5.5 for model diversity

2 participants