Skip to content

Improve cleaning prompt with example to prevent LLM preamble#52

Merged
zachlatta merged 1 commit intozachlatta:mainfrom
JasperG134:improve-cleaning-prompt
Mar 31, 2026
Merged

Improve cleaning prompt with example to prevent LLM preamble#52
zachlatta merged 1 commit intozachlatta:mainfrom
JasperG134:improve-cleaning-prompt

Conversation

@JasperG134
Copy link
Copy Markdown

@JasperG134 JasperG134 commented Mar 24, 2026

Summary

  • Adds So NEVER output words like "Here is the cleaned transcript text:" to the output rules
  • Adds a realistic dictation example (following up on a meeting) showing raw STT input with typical errors and the expected cleaned output
  • This helps smaller LLMs understand they should return only the cleaned text, preventing unwanted preambles

Context

I've been using FreeFlow for a few weeks and recently noticed the transcription cleaning model sometimes prepends phrases like "Here is the cleaned transcript text:" to its output. Adding an explicit example to the system prompt should help prevent this, especially with smaller LLMs.

Test plan

  • Verify cleaned transcriptions no longer include preamble text
  • Test with small LLMs to confirm the example improves output consistency

Smaller LLMs sometimes prepend "Here is the cleaned transcript text:"
to their response instead of returning only the cleaned text. This adds
an explicit example to the system prompt showing the expected input/output
format, which helps prevent this behavior.
@JasperG134 JasperG134 force-pushed the improve-cleaning-prompt branch from 6af087e to a0824c1 Compare March 24, 2026 20:27
@zachlatta zachlatta merged commit f5dfa8d into zachlatta:main Mar 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants