Handling Conflicting Data Sources

When multiple credible sources contain contradictory information, agents must handle the conflict appropriately rather than arbitrarily choosing one.

Correct Approach

1. Preserve both values: Include both conflicting figures in the analysis
2. Annotate explicitly: Mark the conflict with source attribution
3. Defer reconciliation: Let the appropriate authority (coordinator or human) decide
4. Complete the task: Don't halt analysis -- continue processing with the conflict noted

Temporal Awareness

Require publication/collection dates in structured outputs. What looks like a contradiction may actually be temporal change:

• Source A (2023): Revenue $10M
• Source B (2024): Revenue $15M

Without dates, these appear contradictory. With dates, they show growth.

Anti-Patterns

• Choosing one value: The agent lacks broader context for credibility judgments
• Halting analysis: Wastes completed work and blocks the pipeline
• Hiding the conflict: Downstream consumers can't assess reliability

Coverage Annotations

When operating with incomplete data (e.g., some sources timed out), annotate which findings are well-supported vs. which areas have gaps. This enables graceful degradation with transparency.