What do you think?
Rate this book
Understanding Distributed Systems: What every developer should know about large distributed applications
Learning to build distributed systems is hard, especially if they are large scale. It's not that there is a lack of information out there. You can find academic papers, engineering blogs, and even books on the subject. The problem is that the available information is spread out all over the place, and if you were to put it on a spectrum from theory to practice, you would find a lot of material at the two ends, but not much in the middle.
That is why I decided to write a book to teach the fundamentals of distributed systems so that you don’t have to spend countless hours scratching your head to understand how everything fits together. This is the guide I wished existed when I first started out, and it's based on my experience building large distributed systems that scale to millions of requests per second and billions of devices.
If you develop the back-end of web or mobile applications (or would like to!), this book is for you. When building distributed systems, you need to be familiar with the network stack, data consistency models, scalability and reliability patterns, and much more. Although you can build applications without knowing any of that, you will end up spending hours debugging and re-designing their architecture, learning lessons that you could have acquired in a much faster and less painful way.
That is why I decided to write a book to teach the fundamentals of distributed systems so that you don’t have to spend countless hours scratching your head to understand how everything fits together. This is the guide I wished existed when I first started out, and it's based on my experience building large distributed systems that scale to millions of requests per second and billions of devices.
If you develop the back-end of web or mobile applications (or would like to!), this book is for you. When building distributed systems, you need to be familiar with the network stack, data consistency models, scalability and reliability patterns, and much more. Although you can build applications without knowing any of that, you will end up spending hours debugging and re-designing their architecture, learning lessons that you could have acquired in a much faster and less painful way.
234 pages, ebook
Published January 1, 2021
267 people are currently reading
2698 people want to read
Ratings & Reviews
Friends & Following
Create a free account to discover what your friends think of this book!
Community Reviews
Displaying 1 - 30 of 75 reviews
April 4, 2021
An awesome book about distributed systems, intense yet easy to follow. If you found "Designing Data-Intensive Applications" too overwhelming, you might want to try this book instead.
July 30, 2021
A lot of overlap with "Designing Data-Intensive Applications", but shorter more focused on the theoretical and fundamental part.
November 4, 2021
Good Overview. The cover is exactly what's in the book. It's not deep, but that is the amount any web engineer should know about. I would suggest reading it to all junior to mid level professionals. Minus one star for the paper adaptation. Some colors became black and white, dangling curly braces here and there, the text stating the device I'm reading on has a battery (paper book).
January 29, 2023
This book feels like a breeze of fresh air after reading so many hype-driven books about large scale systems.
May 7, 2021
I wish I had this years ago, book covers partitioning (hash and range), sharding, functional decomposition, down-steam resiliency (rate limiting, load shedding), SPOF's design, load balancing based on CAP + CALM, consistency/replication, distributed locks, time (vector clocks, Lamport timestamps), on-call (SLA, error budgets, burn rate), observability and other good stuff.
Read
December 27, 2023As a Student with little to no experience, I have always heard terms like "microservices", "message Queues", and "Replication", etc... and I've always wondered what these are and what level of abstraction they are in until I read this book.
It was hard at some points, but very rewarding to get a bird-eye view of how things work in large systems.
I LIKE IT.
It was hard at some points, but very rewarding to get a bird-eye view of how things work in large systems.
I LIKE IT.
April 24, 2022
This book goes through a broad overview of a gamut of topics in Distributed Systems ranging from theoretical ones like logical clocks to more practical ones like SLAs, SLOs and SLIs.
This is a less dense read than DDIA. I went through this in a about 2-3 days. What I really liked were the innumerable references that the author provided which any reader can go deep into for further understanding. This is a different type of book than DDIA, much more approachable for beginners.
It is a great supplement to DDIA. In fact, I recommend reading this first so that DDIA becomes slightly easier. This is also suitable for preparing for System Design interviews although it is not geared towards readers looking for that type of material.
To conclude, highly recommend reading this book if you build real world computer systems. Supplement it by reading the references the author has provided and further your understanding of distributed systems.
P.S. This is one of those books that will stay on my shelf forever and I am going to come back to it time and again.
This is a less dense read than DDIA. I went through this in a about 2-3 days. What I really liked were the innumerable references that the author provided which any reader can go deep into for further understanding. This is a different type of book than DDIA, much more approachable for beginners.
It is a great supplement to DDIA. In fact, I recommend reading this first so that DDIA becomes slightly easier. This is also suitable for preparing for System Design interviews although it is not geared towards readers looking for that type of material.
To conclude, highly recommend reading this book if you build real world computer systems. Supplement it by reading the references the author has provided and further your understanding of distributed systems.
P.S. This is one of those books that will stay on my shelf forever and I am going to come back to it time and again.
August 21, 2021
I enjoyed this quite a bit. A lot of overlap with Designing Data-Intensive Applications in the first half, though without the exhaustingly in-depth coverage that isn't always relevant. The other half focuses on non-data specific details that were wonderful (though the foray into into TLA+ and PlusCalc left me a bit puzzled as a choice to include.) Overall, though, it's educational, easy to understand and pretty short.
I would definitely reach for this book as something to hand a Jr. dev that joins my team and needs to learn some concepts for working in a distributed world that they don't always focus on in school. Someone who knows how to code and the basics of a database, but doesn't know the work and considerations of making it maintainable and scalable.
I would definitely reach for this book as something to hand a Jr. dev that joins my team and needs to learn some concepts for working in a distributed world that they don't always focus on in school. Someone who knows how to code and the basics of a database, but doesn't know the work and considerations of making it maintainable and scalable.
May 12, 2022
Except for a few nuggets, this is a pretty mediocre book:
* not every distributed system is a web service, but the book pretty much assumes that;
* mentions a few specific algorithms and ideas, but is definitely not exhaustive;
* has a very wide selection of advice on all kinds of matters, and none of them has any depth.
All in all, useless for anyone who has done any other reading in the field, and really not a good starter for for someone who has not.
* not every distributed system is a web service, but the book pretty much assumes that;
* mentions a few specific algorithms and ideas, but is definitely not exhaustive;
* has a very wide selection of advice on all kinds of matters, and none of them has any depth.
All in all, useless for anyone who has done any other reading in the field, and really not a good starter for for someone who has not.
September 5, 2021
This book was my introduction to Distributed systems and the author has done an amazing job. The author covers the distributed system paradigm by starting with the communication, continuing with co-ordination, scalability, resilience and then ending up with testing. The material is top-notch and personally, I found the foot-notes provided to be very helpful. However, the material(esp. towards later chapters) is pretty intense, and if you are just looking for an introductory level book(like I was), then maybe this is best suited as a followup to the introductory material and not the introduction itself. Also, perhaps, it would have helped if the book had one of the earlier chapters introducing common patterns/jargons in distributed systems(eg - quorum, consensus, consistent hashing etc), however, this more reflects towards the expertise of the reader and less towards the author/book itself. All the above mentioned topics are still present in the book, however, they appear within their own context. To sum it up - A must read, and even better if you already have had some basic introduction to the distributed systems.
April 20, 2022
Такой книги мне не хватало на все протяжении карьеры разработчика. В ней емко рассмотрены принципы построения web-приложений. При этом затронуты абсолютно все аспекты жизненного пути ПО. В каждой главе десяток ссылок, которые позволяют погрузиться в интересующую тему.
---
I've been missing a book like this throughout my career as a developer. It succinctly discusses the principles of building web applications. It touches absolutely all aspects of software life cycle. Each chapter contains dozens of links which allow you to dive into the topic of interest.
---
I've been missing a book like this throughout my career as a developer. It succinctly discusses the principles of building web applications. It touches absolutely all aspects of software life cycle. Each chapter contains dozens of links which allow you to dive into the topic of interest.
September 29, 2021
I have mixed feelings about this book. On one hand it is an amazing collection of basic knowledge that are really important for developers working in and with distributed systems, it doesn't go into how each of the topics is intertwined with the other topics and how to get them together to build scalable, resilient, distributed systems.
July 23, 2022
For me, this is the first book on the subject of distributed systems. I think the presentation of the material is close to perfect. The system level chosen in the book simply and clearly explains the basic logic of components functioning as a "black box", and at the same time, through many references and recommendations, shows the way to look "under the hood" in one click.
February 1, 2023
I recently finished reading "Understanding Distributed Systems" and I must say, it was a thoroughly engaging and informative experience. The book presents the topic of distributed systems in a clear and concise manner, making it easy to follow even for those with little prior knowledge.
The most challenging part for me was the section on coordination and consistency in distributed systems, but the author does an excellent job of breaking down these complex concepts and explaining them in a way that is easy to understand.
I am planning on revisiting the section on coordination after reading the "Red Book" to gain a deeper understanding of these topics. Overall, I would highly recommend this book to anyone interested in learning about distributed systems.
The most challenging part for me was the section on coordination and consistency in distributed systems, but the author does an excellent job of breaking down these complex concepts and explaining them in a way that is easy to understand.
I am planning on revisiting the section on coordination after reading the "Red Book" to gain a deeper understanding of these topics. Overall, I would highly recommend this book to anyone interested in learning about distributed systems.
October 12, 2021
As someone who is new to distributed systems, this book was the perfect introduction that filled in all the gaps of my understanding and led me to "Designing Data Intensive Applications". Highly recommend to anyone getting into distributed systems.
August 16, 2022
Whoever wants to learn about the distributed system first clear some basic concepts. Recently I have started to work with distributed systems and I was overwhelmed that there is a lot to cover but have not found any single source which could give an index to refer to these concepts. In my opinion, this is the book where you should start
June 9, 2023
A very nice introduction to distributed systems, explaining well each bit. Totally recommend it for a novice.
This book could have been used in my masters courses about distributed systems (but sadly it did not, learnt nothing about high-scale during masters, even though the programmed was focused on this topic - end of rant).
This book could have been used in my masters courses about distributed systems (but sadly it did not, learnt nothing about high-scale during masters, even though the programmed was focused on this topic - end of rant).
January 3, 2022
This is the book I had wished that "Designing data-intensive applications" was.
A higher level more easily accessible view on the concepts surrounding distributed systems.
Well worth a read if you work anywhere near micro service based architecture.
A higher level more easily accessible view on the concepts surrounding distributed systems.
Well worth a read if you work anywhere near micro service based architecture.
November 25, 2021
This book is trying to cover too much - from the whole content of "DDIA" to microservices/DevOps.
So, in result, all topics are covered very cursory.
There are some interesting parts, specifically about scaling and resiliency.
So, in result, all topics are covered very cursory.
There are some interesting parts, specifically about scaling and resiliency.
September 17, 2022
The book is not as comprehensive as i expected it to be, but fine in all
December 17, 2021
An excellent book that gives a quick overview of the landscape of large distributed systems design. It doesn't go into too much depth but rather gives you a good starting point to dig deeper while still giving a solid foundation. There is some overlap with "Designing Data-Intensive Applications" but it feels like this books is way more focused and follows the 80/20 rule. I still recommend reading DDIA but this book might give you a quick refresher or serve as a solid alternative if you are preparing for a System Design interview and don't have a lot of time on your hands.
December 12, 2021
Honestly this was the first book I’ve seen that took an approachable overview of distributed systems & made it interesting. Some of the concepts were a bit hard to grasp, but I’m sure that re-reading a few chapters will do me good. Overall I learned a LOT from this book and I think it’s one that I will go back to many times for reference.
July 9, 2023
I recently had the pleasure of reading this book, and I must say it was a valuable resource for anyone interested in this complex field. The book not only provided a clear and concise overview of the subject but also offered a wealth of content that allowed me to delve deeper into the underlying concepts.
One aspect that immediately caught my attention was how remarkably easy the book was to read. The author's writing style struck a perfect balance between being informative and engaging, making it accessible to both beginners and those already familiar with the topic. This accessibility greatly contributed to my overall understanding and enjoyment of the material.
Moreover, I appreciated the book's ability to serve as a "gateway" :) to discovering new resources. Throughout its pages, the author references various methodologies, practices, and tools that are commonly used in distributed systems. These references not only provided practical insights but also piqued my curiosity, prompting me to explore these concepts further on my own. It truly opened up a whole world of possibilities for further research and learning.
The book covers a wide range of topics related to distributed systems, explaining the methodologies and practices commonly employed in the field. However, it is important to note that this is not an exhaustive treatment of each concept. While the book offers a solid foundation, it does leave room for readers to conduct their own research and delve deeper into specific areas of interest. Consequently, readers should be prepared to supplement their knowledge with additional resources.
In summary, this book serves as an excellent introduction to distributed systems. Its accessibility, coupled with the wealth of content provided, ensures that readers can grasp the fundamental concepts and gain a holistic understanding of the subject matter. Moreover, the book acts as a springboard for further exploration, guiding readers towards additional resources and encouraging them to pursue deeper research. I highly recommend this book to anyone seeking to enhance their understanding of distributed systems.
One aspect that immediately caught my attention was how remarkably easy the book was to read. The author's writing style struck a perfect balance between being informative and engaging, making it accessible to both beginners and those already familiar with the topic. This accessibility greatly contributed to my overall understanding and enjoyment of the material.
Moreover, I appreciated the book's ability to serve as a "gateway" :) to discovering new resources. Throughout its pages, the author references various methodologies, practices, and tools that are commonly used in distributed systems. These references not only provided practical insights but also piqued my curiosity, prompting me to explore these concepts further on my own. It truly opened up a whole world of possibilities for further research and learning.
The book covers a wide range of topics related to distributed systems, explaining the methodologies and practices commonly employed in the field. However, it is important to note that this is not an exhaustive treatment of each concept. While the book offers a solid foundation, it does leave room for readers to conduct their own research and delve deeper into specific areas of interest. Consequently, readers should be prepared to supplement their knowledge with additional resources.
In summary, this book serves as an excellent introduction to distributed systems. Its accessibility, coupled with the wealth of content provided, ensures that readers can grasp the fundamental concepts and gain a holistic understanding of the subject matter. Moreover, the book acts as a springboard for further exploration, guiding readers towards additional resources and encouraging them to pursue deeper research. I highly recommend this book to anyone seeking to enhance their understanding of distributed systems.
September 18, 2023
The best way to describe this book is "practical theory". It doesn't exhaustively cover the theory of distributed systems (which would be impossible in one book). Instead, it covers a wide range of concepts at the level required to build the kind of distributed systems that most developers would build in practice. Personally, it has helped me design a (relatively simple) distributed system at work.
The first part of the book gives an overview of networking concepts, highlighting the leaks in the lower level abstractions that we need to be aware of when building on them. For example, when covering TCP, it focusses on the connection lifecycle, flow control, and congestion control, which can be important when building systems that communicate using this protocol.
The second part of the book builds on these basic technical concepts, explaining how we can achieve some level of coordination despite unreliable networks and applications. Raft leader election and state machine replication are particularly interesting. The CAP and PACELC theorems are useful ways of thinking about trade-offs in distributed systems. On the other hand, the CALM theorem states that a monotonic system doesn't require any of this complicated coordination.
The third and fourth parts of the book explain various tactics to achieve scalability and resilience in distributed applications, while the fifth and final part of the book briefly touches on how to develop and operate a distributed system: testing, continuous delivery, and monitoring.
The first part of the book gives an overview of networking concepts, highlighting the leaks in the lower level abstractions that we need to be aware of when building on them. For example, when covering TCP, it focusses on the connection lifecycle, flow control, and congestion control, which can be important when building systems that communicate using this protocol.
The second part of the book builds on these basic technical concepts, explaining how we can achieve some level of coordination despite unreliable networks and applications. Raft leader election and state machine replication are particularly interesting. The CAP and PACELC theorems are useful ways of thinking about trade-offs in distributed systems. On the other hand, the CALM theorem states that a monotonic system doesn't require any of this complicated coordination.
The third and fourth parts of the book explain various tactics to achieve scalability and resilience in distributed applications, while the fifth and final part of the book briefly touches on how to develop and operate a distributed system: testing, continuous delivery, and monitoring.
February 7, 2021
As a data scientist with a background in Physics, the word distributed systems sounded odd to me. But I knew that it could help me understand how AWS services I use in my day-to-day work under the hood. So I decided to read the book even without a comp-sci background, and I don't regret it. The book walks you through different major steps needed to build distributed systems from first principles in a simple and understandable way. Lots of pictures and references are provided to explain the topic, which I found really valuable. After reading the book, I have a much better understanding of how large scale databases are implemented and what their tradeoffs are.
September 2, 2022
Aimed to provide an overview of various facets of building distributed systems, but a great high level overview for experts that can be used as quick reference.
Covers communication, coordination, scalability, resiliency, and maintainability. Uncluttered by implementation details, just a list of various ways to solve challenges with distributed systems, with a footnote here and there with a link to a research paper, or wiki page for more details.
Covers communication, coordination, scalability, resiliency, and maintainability. Uncluttered by implementation details, just a list of various ways to solve challenges with distributed systems, with a footnote here and there with a link to a research paper, or wiki page for more details.
March 25, 2021
I really like the book , I am both new to read books , and to the subject. It does what the title says Understanding , this book aim is not to make me a pro , it's to make me make the first step. I really enjoy reading the book!
Read
July 19, 2022Good read to get an understanding of building distributed systems. It cover high-level overview of each challenges such as replications, time, and transactions and many more. I enjoy the 2nd section the most which span from Failure detection, to time in distributed systems, to replication.
September 2, 2023
The book gives you a good understanding of almost every aspect of the distributed systems in a pretty small number of pages; then you can selectively deep dive into each individual topic as you fave new challenges in your systems.
April 9, 2021
The author does a great job with an excellent explanation about distributed systems.
Displaying 1 - 30 of 75 reviews