---
answer: direct
beat: data-engineering
source: 1 article · updated: November 15, 2026
---

Why did Netflix use a separate Flink job for each Kafka topic?

The post says a single job was difficult to tune because topics had different volumes and throughput patterns. A one-to-one topic/job mapping made each job simpler to maintain and tune, at the cost of more jobs and topics to operate.

Answered in

Inside Netflix’s Real-Time Graph: Kafka-to-Flink Ingestion at Scale

Netflix’s graph ingestion pipeline turns member events into deduplicated node and edge updates with Kafka, Flink and Data Mesh.

Crashtech Editorial November 15, 2026 Data Engineering

Read the full analysis

Other questions this article answers

More data engineering questions

Every answer on Crashtech is written by the editor of the article it comes from — never auto-summarised. Browse all answers or the Data Engineering beat.