Projects / Arbibet

Arbibet: sports data platform and its operations

A production sports data and market-signal platform I architect and run: ingestion from 20+ sources, a star-schema warehouse on PostgreSQL, a Parquet cold archive queried with DuckDB, and its own observability layer. I write the architecture, specs and acceptance criteria; implementation runs through a spec-driven, AI-assisted workflow where an independent verifier closes every task.

Engineering

• Ingestion from 20+ external sources and APIs with checkpointed runs, dead-letter handling and content-hash deduplication, covered by over 200 automated tests.
• One metric contract behind every report and status page, so each number has one definition.

Observability and reliability

• Read-only monitoring across 4 production databases that separates data freshness from pipeline lag.
• Production incidents driven to durable fixes: "succeeded" runs that refreshed nothing (a stale image), an archive switch taken through out-of-memory incidents and a tested rollback.

Live

Links

• Live status
• github.com/bankijey/api-football-ingestor