HomeArenaGraphSignalTopics

/ The Arena

Prove your engineering skills.

GLOBAL+50 XP

Parse Raw Kafka .index Binary Files and Implement Sparse Lookups

Problem Overview

Apache Kafka achieves disk seek performance by coupling each append-only .log file with a sparse binary .index file.

In this landmark capstone, you will:

  1. Parse raw Big-Endian binary Kafka .index byte buffers (8-byte entries: relative_offset (4 bytes) + physical_position (4 bytes)).
  2. Implement a high-performance Binary Search Nearest-Match Lookup to resolve any arbitrary Target Offset to its nearest starting byte position in the log segment.

Join The Arena

Create an account to submit your implementation, test against our containerized CI suite, and climb the global leaderboard.

Create Account

ALREADY HAVE AN ACCOUNT? LOG IN