C++ Low Latency: Multithreading and Hotpath Optimizations

by David Spuler

Run faster! This book is about speeding up C++ for low latency programming in multithreaded environments and sequential code in C++ backends.

Main AI LLM Inference BackendsHigh-Frequency Trading (HFT)Game Engines
Main optimization C++ Multithreading optimizationsGeneral C++ efficiency tweaks
Table of

Part Introduction to Low Latency
1. Low Latency Programming
2. Multithreading Optimizations
3. Hardware Acceleration
4. System Optimizations
Part Multithreading Optimizations
5. False Sharing
6. Branch Prediction
7. Lock Contention
8. Hotpath Optimizations
9. Slowpath Removal
10. Cache Warming
Part C++ Optimizations
11. Timing and Benchmarking
12. Bitwise Operations
13. Floating-Point Arithmetic
14. Arithmetic Optimizations
15. Compile-Time Optimizations
16. Pointer Arithmetic
17. Algorithm Speedups
18. Memory Optimizations
19. Loop Vectorization
20. AVX Intrinsics
21. Parallel Data Structures
22. Lookup Tables & Precomputation
Appendix 1: C++ Slug Catalog

304 pages, Kindle Edition

Published March 28, 2025