Inconsistent Behavior
Problems where similar inputs, repeated attempts, validations, prompts, routes, or cases produce different results without a clear reason.
Primary Issues
- Similar Cases Route to Different Outcomes
Similar inputs, cases, prompts, or workflow states are routed to different outcomes without a declared difference that explains the split.
- Prompt Only Works After Retry
The prompt fails, misroutes, or produces an unusable response on one attempt but works after retry without a meaningful change to the input.
- Validation Result Changes on Retry
A validation, grading, review, classification, or pass/fail result changes after retry even though the input and declared validation rules did not change.
- Results Vary Too Much
Repeated or comparable runs produce outputs that vary more than the task, workflow, or user can tolerate.
- Same Instructions Allow Different Outputs
The same instructions are broad or underspecified enough to allow materially different outputs that all appear compliant.
Also Related Issues
- Retry Makes the Problem Worse
A retry, repair attempt, regeneration, or follow-up instruction increases the error, expands the failure, or creates additional breakage instead of narrowing the problem.
- Prompt Behavior Changed Without Version Change
A prompt begins producing different behavior even though no prompt version, model version, workflow version, or declared dependency change is recorded.
- Prompt Has Too Many Valid Interpretations
The prompt allows too many reasonable interpretations, causing the AI to choose among valid paths without enough guidance.
Ontology Metadata
- Code
CAT-0090- Version
[email protected]- Ontology release
- 0.1.0
- Updated
- 2026-05-10T00:00:00Z
History
No public history entries recorded.