HomeArenaGraphSignalTopics

/ The Arena

Prove your engineering skills.

GLOBAL+50 XP

Implement an Exactly-Once Stream Processing Deduplication & Checkpointing Engine

Landmark Capstone Challenge: Stream Processing Engine ⚔️

In this landmark capstone challenge, you will implement an Exactly-Once Stream Processing Engine featuring event deduplication, partition offset tracking, and state checkpointing.

Requirements:

  1. Message Ingestion & Deduplication:
    • Ingest stream records containing eventId, partition, offset, and numeric payloads.
    • If an eventId has already been processed, reject it (false) and discard state mutation.
  2. State Checkpointing & Restoration:
    • Generate atomic snapshot checkpoints of cumulative balances and per-partition offsets.
    • Restore internal state accurately from previous checkpoints to simulate crash recovery.

Join The Arena

Create an account to submit your implementation, test against our containerized CI suite, and climb the global leaderboard.

Create Account

ALREADY HAVE AN ACCOUNT? LOG IN