What SIS Does
consolidates contemplation/session episodes into lessons that influence future prompts.Failure Modes
Parse failure
Parse failure
Symptoms:
sis: no parseable JSON in responseconsolidation returned no patterns
- Verify selected provider/model for SIS path.
- Verify latest output is current issue (not stale historical log).
- Validate JSON contract and fallback parser behavior.
Empty consolidation with active episodes
Empty consolidation with active episodes
Symptoms: Many episodes but no new lessons.Impact: Weak adaptation over time.Operator response:
- Check thresholds (
episodesPerConsolidation, lesson confidence). - Verify contemplation episodes contain structured content.
Reliability Targets
| Metric | Target |
|---|---|
| Parse success rate | >= 95% |
| Consolidation cycle success | >= 99% |
| Fresh lesson update | At expected cadence |
Required Observability
Expose these in health UI:- Last successful consolidation time
- Parse failures in last 24h
- Lessons created in last 24h
- Last lesson injected time