PENGO Workbench
Workbench / Categories / Output

Category

Output

Generated results that are malformed, unusable, or hard to verify.

Primary Issues

Output

Answer Has No Traceable Source Link

The answer makes a claim, recommendation, citation, or factual statement without a source link or trace path that allows the user to verify where it came from.

Output

Citation Points to Wrong Source

A citation, reference, link, or source pointer is present, but it points to the wrong source, wrong passage, wrong document, or unsupported evidence.

Output

Answer Has Too Many Paths

The answer presents too many possible paths, interpretations, options, or next steps without enough structure to choose among them.

Output

Invalid JSON Output

The AI returns malformed JSON or structured output that cannot be parsed.

Output

Missing Required Fields

The AI returns structured output that omits fields required by the schema, workflow, parser, form, or downstream consumer.

Output

Hallucinated Fields

The AI adds fields, keys, attributes, columns, or structured elements that were not declared, requested, or allowed by the expected schema.

Output

Wrong Field Types

The AI returns fields with values whose types do not match the expected schema, such as strings where numbers, booleans, arrays, objects, or enums are required.

Output

Nested Fields Do Not Match

The AI returns nested structured fields whose internal shape, hierarchy, parent-child relationship, or contained values do not match the expected structure.

Output

AI Output Breaks Parser

The AI output causes a parser, validator, importer, or structured-output consumer to fail.

Output

Output Exceeds Length Limit

The AI output exceeds a declared length, token, word, character, section, field, or size limit.

Also Related Issues

Showing 8 of 18 cross-listed issues.

Changes & Versions

Saved Reference No Longer Works

A saved source, citation, file reference, prompt reference, or workflow pointer previously worked but no longer resolves to the expected object or meaning.

Inconsistent Behavior

Validation Result Changes on Retry

A validation, grading, review, classification, or pass/fail result changes after retry even though the input and declared validation rules did not change.

MCP, Tools & Integrations

Tool Call Contract Mismatch

The AI or agent calls a tool with names, arguments, types, modes, or shapes that do not match the declared tool interface.

MCP, Tools & Integrations

Output Breaks the Next Step

The AI output looks acceptable by itself but cannot be used by the next tool, workflow step, parser, reviewer, or downstream consumer.

MCP, Tools & Integrations

Tool Result Not Integrated Correctly

The AI receives a tool result but misreads, ignores, overwrites, misplaces, or fails to incorporate it correctly into the final output or workflow state.

Duplication & Overload

Duplicate Fields With Same Meaning

The AI returns multiple fields, labels, sections, or structured elements that carry the same meaning and create ambiguity about which one should be used.

Coverage & Guidance

Format Rule Too Weak

The format instruction is too vague, incomplete, or optional to reliably produce output that satisfies the expected structure.

Scope & Boundaries

File-Bounded Task Uses Outside Content

The AI is asked to work only from a specific file or document but uses content, assumptions, or sources outside that file.