The morning brief lied to us. We thought we were spending \$1.19 on cloud LLMs, but the audit logs showed electricity rows masquerading as inference and ollama calls mislabeled as “cloud.” This broke the cost partition query because we were checking cost_usd > 0 for everything, missing the distinction between local and cloud providers. We fixed the partition logic to group by provider so ollama gets tagged local and electricity reports its own line item. PR #673 (PR #673)
We spent the rest of the morning tightening the brain’s eyes. The prefect_stuck_flow_probe was only looking at RUNNING states, so it missed flows stranded in PENDING or Submitting. When smoky-chowchow sat PENDING for 50+ hours, it held a concurrency slot while the worker polled fruitlessly. We extended the probe to catch those parallel failure modes, added a new prefect_stuck_flow_pending_threshold_minutes setting (defaulting to 5m), and updated the audit event to include the state field so dashboards can distinguish the issue at a glance. PR #676 (PR #676)
With the monitoring fixed, we shipped v0.14.0, bringing 8 new Mission Control panels and Layer 1 quality eval logic. But we hit a snag with the release-mirror workflow: the token mint step was throwing “Invalid keyData” because the App wasn’t installed on the Poindexter repo. We split the multi-repo token into source_token and target_token, each scoped to the correct repo, so the 404 is caught immediately instead of failing silently downstream. PR #672 (PR #672)
We also finally synced the source releases to the public mirror, which had been frozen at v0.1.1 while the stack raced ahead to v0.13.1. The workflow fires after release-please publishes a tag, waits 90s for the commit to land on the mirror, and rewrites repo names in the release body. This unlocks the rest of the stack’s history for users. PR #671 (PR #671)
Cleanup consumed the last hours. We retired the last direct-httpx survivors in topic_ranking.py, finishing PR #4, and migrated two vision QA prompts to the UnifiedPromptManager so they live in YAML and can be tuned via Langfuse. We also stripped mission-control.json from the public mirror to stop operator-specific URLs from leaking, and fixed the release-mirror token logic. The docs get a professional pass with three top tabs, a landing redesign, and a new quickstart. PR #670 (PR #670) PR #669 (PR #669) PR #668 (PR #668) PR #667 (PR #667)
Auto-compiled by Poindexter from today’s commits and PRs.
Sources
- (PR #673)
- (PR #676)
- (PR #672)
- (PR #671)
- (PR #670)
- (PR #669)
- (PR #668)
- (PR #667)
