Knowledge
Engineering explanations you can verify — every guide links to the calculators that implement its formulas.
HPC
Amdahl's law and HPC cluster sizing
Why adding cores stops helping, how Gustafson's law changes the picture, and how to size a cluster from demand.
Quantum Computing
State-vector simulation: why each qubit doubles the memory
The classical memory needed to simulate n qubits, and when to distribute simulations or switch methods.
Comparisons
Ethernet vs InfiniBand for AI clusters
How the fabric affects gradient synchronisation, and the factors that decide between RDMA Ethernet and InfiniBand.
Cooling
Data centre cooling basics: heat load, airflow and PUE
Convert IT power into BTU/h and tons of refrigeration, size airflow for a rack, and understand power usage effectiveness.
Power
Sizing power supplies and racks for GPU systems
From component power to PSU wattage, wall power, rack current per phase and A/B feed design.
Storage
RAID levels explained: capacity, fault tolerance and write penalty
What RAID 0, 1, 5, 6, 10, 50 and 60 give you in usable space, drive failures survived and random-write performance.
GPU Computing
Training memory: why mixed-precision Adam needs about 16 bytes per parameter
Weights, gradients and optimizer states — and how tensor, pipeline and ZeRO/FSDP sharding divide them across GPUs.
AI Computing
How much GPU memory does an LLM need?
Inference memory is weights plus KV cache plus overhead. Here is the arithmetic, with worked numbers for Llama 3.1 8B and 70B.