Architecting at Scale: A Practical Guide to Large-Scale System Design: From Monolith to AI-Native, Beyond Scaling Servers

“Architecting at Scale makes a compelling case that experimentation is not a process layered on top of architecture, but a property the architecture itself must support.” - Scott Hanselman, VP/Member of Technical Staff, Microsoft/GitHub

“You understand not only what a pattern does, but why you would choose it—and when you should not. That is the architectural judgment Architecting at Scale teaches.” - Dick Hardt, Creator of OAuth, Founder/CEO of Hello

“It is a practical guide to evolving production systems for the AI era, and it will be useful to many people.” - Perraju Bendapudi, Senior Technical Fellow/Founding Member, Typeface

Book Description

Scale systems confidently by knowing when to simplify instead of adding complexity. You'll learn to distinguish temporary demand spikes from sustained growth, align architecture with business goals, and make decisions that improve reliability, cost efficiency, and delivery speed using measurable ROI.

Following the evolution of ShopFlow from startup MVP to a global AI-native platform, you'll tackle real-world trade-offs in application design, data, security, infrastructure, and operations. Through practical scenarios, you'll determine when to scale vertically or horizontally, decouple services, shard databases, implement Zero Trust security, and introduce AI-driven automation. Along the way, you'll apply the Scale by Subtraction framework to eliminate unnecessary complexity, reduce operational overhead, and improve system resilience without overengineering.

By the end of this book, you'll be able to make evidence-based architectural decisions and design distributed systems that scale sustainably without unnecessary cost or complexity.

What you will learn

Apply Scale by Subtraction to reduce system complexity Distinguish temporary traffic spikes from sustained growth Use tipping-point metrics to guide service decoupling Shard databases while preserving data integrity Secure distributed systems with Zero Trust and mTLS Balance delivery velocity, availability, and FinOps Design AI-native infrastructure with autonomous agents Who this book is for

Software architects, engineering directors, CTOs, and senior/staff engineers who need to scale systems, teams, and operational practices without unnecessary complexity. A basic understanding of cloud computing and familiarity with AI applications are recommended; no specific language, vendor, or technology stack is required.

Table of Contents

The Scalability Mindset - When and Why to Scale Core Principles of Scalable Architecture Security-First and Compliance-First Architecture Scaling the Global Delivery Layer – Edge, CDNs, and Beyond Scaling the Modern Web Application – State, Performance, and Micro-Frontends Architecting Scalable Services – Decomposition and API Design Scaling Service Infrastructure – Resilience, Mesh, and Compute Event-Driven Scaling – Decoupling with Messaging Caching Strategies - Faster and Cheaper Scaling Scaling Data and Databases – Storage, Queries, and Beyond Observability - Seeing and Understanding Your System Resilience and High Availability – Designing for Failure Performance Tuning and Capacity Planning Cost Optimization and Efficiency (FinOps) AI-First Architecture: Pragmatism Over Hype Continuous Experimentation and the Future-Proof System