</> MAANG.io

Expert

Design landmark systems in depth, from Dynamo, GFS, Bigtable and Kafka to payments and ads pipelines.

0 of 232 solved 0%

Section 13: The Judges' Table - Final Summary & Candidate Scorecard

Executive Summary: This closing section turns the module into a way to grade yourself. It replays the arc as the signal each phase recorded, ledgers the eleven decisions with what would reverse each, and scores the interview on a 100-point card weighted toward architecture and deep dives, with readiness bands and the prompts that are this question in disguise.

The panel never graded the word "MapReduce." They listened for three things. Did "without knowing anything about distributed systems" become a restriction, two deterministic functions, that buys parallelism and fault tolerance? Did 32 GB/s of map demand against a 25 GB/s root, rather than the 10 TB input, force locality into the design? And when w-0417 died at minute 6, did you say "its ≈ 75 completed map tasks re-run, because their ≈ 500 MB of output sat on its dead disk," or just "we retry failed tasks"?

The Arc, Replayed as Signal

The interview arc replayed as signal: Framing (Sections 1-2) recorded two functions with the framework owning every failure; Estimation (Section 3) recorded 32 GB/s demand against a 25 GB/s root, making locality mandatory; API, data and architecture (Sections 4-6) recorded a narrow model, an O(M x R) master and local intermediate files; Deep dives (Sections 7-10) recorded re-execution, atomic commits, and backups versus salting; Gauntlet and lineage (Sections 11-12) recorded knowing which flip trigger each successor pulled.

  1. Framing (Sections 1–2): batch jobs over data already in GFS, trusted code, record-at-a-time transforms plus group-by-key. The NFR is ≤ 15 min end-to-end, including one machine failure, against a nominal ≈ 8 min.
  2. Estimation (Section 3): 1 B pages × 10 KB = 10 TB → M ≈ 156,000 splits → 39 waves × 8 s ≈ 5.2 min of map → 1 TB intermediate → R = 4,000 partitions of 250 MB. The network binds, not CPU or disk.
  3. API, data and architecture (Sections 4–6): reduce takes an iterator, not a list. The master holds one byte per (map, reduce) pair, ≈ 624 MB. Riya's record lands in /gfs/inlinks/part-01729.
  4. Deep dives (Sections 7–10): split 88,213 runs replica-local on w-0417. The shuffle averages ≈ 13% of the root. A dead worker's map re-runs cost at most ≈ 25 s (15 s detection plus one 8-s task, if it dies as the map phase ends), a rack lost at minute 4 re-runs ≈ 1,800 completed maps in about half a wave, and the hot portal key needs salting, not a backup task.
  5. Gauntlet and lineage (Sections 11–12): atomic rename covers GFS output only, and thirty PageRank iterations break Decision 1.

Key Insight: Not one of those signals is "has read the 2004 paper." Each checks which constraint a mechanism pays for. Locality pays for a 10:1 network. Local intermediate files pay for not writing a terabyte three times. Determinism pays for re-execution being safe.

Quick check before moving on:


Sign in to continue reading

The rest of this lesson is available with a free account. Signing in with Google or Microsoft is free.

Sign in to read the full lesson

Sign in to MAANG.io

Use your Google or Microsoft account — no password to remember.

Continue with Google Continue with Microsoft

Please accept the terms above to continue.