Category
Inconsistent Behavior
Similar cases producing different results.
Primary Issues
Similar Cases Route to Different Outcomes
Similar inputs, cases, prompts, or workflow states are routed to different outcomes without a declared difference that explains the split.
Prompt Only Works After Retry
The prompt fails, misroutes, or produces an unusable response on one attempt but works after retry without a meaningful change to the input.
Validation Result Changes on Retry
A validation, grading, review, classification, or pass/fail result changes after retry even though the input and declared validation rules did not change.
Results Vary Too Much
Repeated or comparable runs produce outputs that vary more than the task, workflow, or user can tolerate.
Same Instructions Allow Different Outputs
The same instructions are broad or underspecified enough to allow materially different outputs that all appear compliant.
Also Related Issues
Retry Makes the Problem Worse
A retry, repair attempt, regeneration, or follow-up instruction increases the error, expands the failure, or creates additional breakage instead of narrowing the problem.
Prompt Behavior Changed Without Version Change
A prompt begins producing different behavior even though no prompt version, model version, workflow version, or declared dependency change is recorded.
Prompt Has Too Many Valid Interpretations
The prompt allows too many reasonable interpretations, causing the AI to choose among valid paths without enough guidance.