Does HyperLogLog work well with merging data from multiple servers?
Yes—one of its biggest advantages. Merge two HyperLogLog instances by taking the element-wise maximum of their registers. This enables exact-level accuracy while counting globally across a distributed cluster.
Answered in
Count Billions in 12 KilobytesHyperLogLog estimates cardinality by reading leading zeros in hashed values, trading 1% error for fixed memory.
Read the full analysisOther questions this article answers
More system design questions
- Why doesn't Google just run Dijkstra faster?
- What is a shortcut edge and when is it precomputed?
- How much space do shortcut edges take compared to the original graph?
- Can Contraction Hierarchies handle dynamic graphs like traffic or road closure?
- Why contract low-degree nodes first instead of high-degree ones?
- What is a CRDT and why does it matter for real-time collaboration?
- How do CRDTs handle concurrent edits without a central server referee?
- Why did Figma move from operational transforms to CRDTs?
Every answer on Crashtech is written by the editor of the article it comes from — never auto-summarised. Browse all answers or the System Design beat.