In the previous subchapter, we saw event-driven architectures where a process is split into many independent steps. But this creates a delicate problem: what happens if a process has several steps and one of them fails halfway? For example, in an order, the payment is charged but then the stock reservation fails. You end up with a customer who has paid but has no product: an inconsistent state. The Saga pattern is the solution to coordinate multi-step processes that can fail, keeping everything consistent. We briefly mentioned it in subchapter 15.4; here we’ll look at it in depth.
The problem: transactions spread across services
In a monolithic system with a database, there’s a classic mechanism for this: transactions. A transaction says “either all steps are done, or none are”; if something fails halfway, everything is undone automatically (rollback) and it goes back to the initial state. It’s the “all or nothing” principle.
But in a microservices architecture (Chapter 17) or serverless (Chapter 28), each step is performed by a different service, each with its own database. There is no single transaction that covers them all. If step 3 of 5 fails, steps 1 and 2 have already been executed in other services and are not undone automatically:
Order process (each step in a different service):
Step 1: charge payment ✓ done
Step 2: reserve stock ✓ done
Step 3: assign shipping ✗ FAILS
Step 4: notify (not reached)
→ problem: payment has already been charged and stock reserved,
but the order cannot be completed. Inconsistent state!You need a way to maintain consistency when an operation is spread across several services and something fails halfway. That’s what the Saga is for.
What is the Saga pattern
The Saga pattern manages an operation of multiple steps spread across services, so that if a step fails, the previous steps are undone through compensating actions (operations that cancel what has already been done). Instead of an “automatic rollback” (which doesn’t exist across services), you define how to undo each step, and the Saga executes them in reverse order if something fails.
Order Saga:
Step 1: charge payment → compensation: refund payment
Step 2: reserve stock → compensation: release stock
Step 3: assign shipping ✗ FAILS
→ the Saga executes the compensations for the steps already done, in reverse order:
release stock (undoes step 2)
refund payment (undoes step 1)
→ the system returns to a consistent state (as if nothing had happened)Analogy: a Saga is like booking a vacation in parts (flight, hotel, and rental car, each on a different website). You book the flight ✓, you book the hotel ✓... and when you go to rent the car, there’s no availability ✗. Since you can’t go without a car, you have to cancel the previous bookings: you cancel the hotel (and get your money back) and cancel the flight. Each cancellation is a compensating action that undoes a booking. In the end, you’re back to the beginning, with no partial bookings. The Saga automates exactly that logic of “if something fails, undo the previous steps one by one.”
The key idea: compensate instead of magically undoing
The essential difference from a traditional transaction: in a Saga, there is no automatic rollback. Instead, you explicitly define how to undo each step (its compensating action), and the Saga executes them when needed. This requires you to think, for each step, “how do I cancel this if something fails later?”
Traditional transaction: AUTOMATIC rollback (the database does it) Saga: compensations that YOU define (undo step by step)
That’s why, when designing a Saga, for each action you also think of its opposite action: charge ↔ refund, reserve ↔ release, create ↔ delete.
How to implement a Saga in AWS
There are two common ways to coordinate a Saga, connected to what you already know:
- By choreography (with events): each service reacts to events (event-driven style from subchapter 28.1) and, if something fails, emits a failure event that triggers compensations. There is no “director”; services coordinate with each other via events.
- By orchestration (with a coordinator): a central component directs the steps and, if one fails, orders the compensations. In AWS, the ideal tool for this is Step Functions, which we’ll see in the next subchapter (28.3): it allows you to define the flow of steps and what to do if each one fails, visually and in a controlled way.
When to use the Saga pattern
- When you have a multi-step process spread across multiple services (microservices, serverless) and you need it to be consistent even if something fails halfway.
- Critical business processes like orders, payments, reservations, where leaving something “half-done” would be a serious problem.
⚠️ If your operation fits in a single service with a database, use a normal transaction (it’s simpler). The Saga is for when the operation crosses multiple services and no common transaction is possible.
Real-world example: a travel platform processes the booking of a complete package: flight, hotel, and transfer, each managed by a different service (sometimes from external providers). They implement a Saga: they book the flight, then the hotel, then the transfer. If in the last step the transfer is not available, the Saga executes the compensations: cancels the hotel and cancels the flight automatically, returning the customer to a clean state (no partial bookings or undue charges). The customer receives a “the booking could not be completed” message instead of being left with a flight and hotel but no way to get there. The Saga guarantees that the process is all or nothing, even though internally there are many independent services.
What you should remember
- In microservices/serverless, a multi-step operation is spread across multiple services without a common transaction; if a step fails halfway, the previous ones have already been executed and you end up with an inconsistent state.
- The Saga pattern manages these processes so that, if a step fails, the previous ones are undone through compensating actions (operations that cancel what has already been done), returning to a consistent state. Like canceling parts of a vacation booking if something doesn’t work out.
- The key: there is no automatic rollback as in a database; you define how to undo each step (charge↔refund, reserve↔release).
- It’s implemented by choreography (events, style 28.1) or by orchestration (a coordinator like Step Functions, subchap. 28.3).
- Use it for critical multi-service processes (orders, payments, reservations). ⚠️ If everything fits in a service with a database, use a normal transaction (simpler).
In the next subchapter, we’ll look at AWS’s ideal tool for orchestrating these multi-step flows visually and in a controlled way: Step Functions.
Cloud, AWS & Terraform — From Zero to Expert
Chapter 1 · What is cloud computing
- 1.1 The traditional client-server model
- 1.2 Problems the cloud came to solve
- 1.3 On-premise vs cloud vs hybrid
- 1.4 The three service models: IaaS, PaaS, SaaS
- 1.5 The five pillars of cloud (according to NIST)
- 1.6 Real advantages: elasticity, pay-as-you-go, global availability
Chapter 2 · The cloud market and major providers
- 2.1 AWS, Azure and GCP: differences and market share
- 2.2 Why learn AWS first
- 2.3 Concepts that are universal among providers
Chapter 3 · Regions, availability zones and edge
- 3.1 What is an AWS region and how to choose it
- 3.2 Availability Zones: high availability by design
- 3.3 Edge locations and CloudFront
- 3.4 Latency, resilience and data sovereignty
Chapter 4 · Compute: EC2
- 4.1 Instances: types, families and when to choose each
- 4.2 AMIs, key pairs and Security Groups
- 4.3 Instance lifecycle
- 4.4 Elastic IPs and Placement Groups
- 4.5 Savings Plans vs Reserved vs On-Demand vs Spot
Chapter 5 · Storage: S3
- 5.1 Buckets, objects and keys
- 5.2 Storage classes (Standard, IA, Glacier…)
- 5.3 Versioning and object lifecycle
- 5.4 Bucket policies and ACLs
- 5.5 Static website hosting
Chapter 6 · Networking: VPC
- 6.1 What is a VPC and why you need it
- 6.2 Public and private subnets
- 6.3 Internet Gateway and NAT Gateway
- 6.4 Route Tables and Network ACLs
- 6.5 VPC Peering and endpoints
Chapter 7 · Identity and access: IAM
- 7.1 Users, groups, roles and policies
- 7.2 The principle of least privilege
- 7.3 Identity-based vs resource-based policies
- 7.4 MFA and temporary credentials (STS)
- 7.5 IAM security best practices
Chapter 8 · Managed databases
- 8.1 RDS: engines, Multi-AZ and read replicas
- 8.2 Aurora and its advantages over vanilla RDS
- 8.3 DynamoDB: key-value / document model
- 8.4 ElastiCache for in-memory cache
- 8.5 When to use each type of database
Chapter 9 · Why Infrastructure as Code
- 9.1 Problems with manual provisioning
- 9.2 Declarative vs imperative IaC
- 9.3 Terraform vs CloudFormation vs Pulumi vs CDK
- 9.4 The plan → apply → destroy cycle
Chapter 10 · HCL: the Terraform language
- 10.1 Resource, variable, output, locals blocks
- 10.2 Data types: string, number, bool, list, map, object
- 10.3 Expressions, references and built-in functions
- 10.4 Conditionals and loops (count, for_each, for)
Chapter 11 · Providers and state
- 11.1 How the AWS provider works
- 11.2 The terraform.tfstate file and its importance
- 11.3 Local state vs remote state (S3 + DynamoDB)
- 11.4 Essential commands: init, plan, apply, destroy, fmt, validate
Chapter 12 · Your first real infrastructure in Terraform
- 12.1 Create a VPC with subnets from scratch
- 12.2 Launch a public EC2 instance
- 12.3 Associate a Security Group and an Elastic IP
- 12.4 Outputs and references between resources
- 12.5 Team workflow: PR review of plans
Chapter 13 · Load balancing and auto scaling
- 13.1 Application Load Balancer vs Network Load Balancer
- 13.2 Target Groups, listeners and rules
- 13.3 Auto Scaling Groups: policies and metrics
- 13.4 Warm pools and lifecycle hooks
Chapter 14 · Serverless with Lambda
- 14.1 The Lambda execution model
- 14.2 Triggers: API Gateway, S3, DynamoDB Streams, SQS
- 14.3 Dependency management and layers
- 14.4 Cold starts and strategies to reduce them
- 14.5 Limits and anti-patterns
Chapter 15 · Messaging and events
- 15.1 SQS: standard vs FIFO queues, DLQ
- 15.2 SNS: topics, subscriptions, fan-out
- 15.3 EventBridge: event buses and rules
- 15.4 Patterns: pub/sub, decoupling, saga
Chapter 16 · Content delivery and DNS
- 16.1 Route 53: record types and routing policies
- 16.2 CloudFront: distributions, caches and origins
- 16.3 ACM: free SSL/TLS certificates
- 16.4 WAF integrated with CloudFront
Chapter 17 · Containers on AWS
- 17.1 Docker: quick review of key concepts
- 17.2 ECR: private image registry
- 17.3 ECS: task definitions, services, Fargate vs EC2
- 17.4 EKS: when Kubernetes and when not
Chapter 18 · Modules: reuse and composition
- 18.1 Anatomy of a Terraform module
- 18.2 Input variables, outputs and dependencies
- 18.3 Local modules vs Terraform Registry modules
- 18.4 Module versioning with Git tags
- 18.5 Design of generic vs domain-specific modules
Chapter 19 · Workspaces and environment management
- 19.1 Terraform workspaces: use cases and limitations
- 19.2 Directory strategy per environment (dev/stg/prod)
- 19.3 Terragrunt: DRY for environment configurations
- 19.4 Environment variables and .tfvars files
Chapter 20 · Remote backends and locking
- 20.1 Configure S3 + DynamoDB as backend
- 20.2 State locking: avoiding team corruption
- 20.3 State migration between backends
- 20.4 terraform import: bring existing resources into state
Chapter 21 · Infrastructure testing
- 21.1 Terraform validate and fmt in CI
- 21.2 Checkov and tfsec: static security analysis
- 21.3 Terratest: integration tests in Go
- 21.4 Contract testing between modules
Chapter 22 · Terraform in CI/CD
- 22.1 Basic pipeline: lint → plan → apply in GitHub Actions
- 22.2 Atlantis: GitOps for Terraform
- 22.3 Terraform Cloud / HCP Terraform
- 22.4 Drift detection and automatic reconciliation
Chapter 23 · Defense in depth
- 23.1 AWS Organizations and Service Control Policies
- 23.2 AWS Config: continuous compliance
- 23.3 GuardDuty: threat detection
- 23.4 Security Hub: centralized view
- 23.5 KMS: key management and rotation
- 23.6 Secrets Manager vs Parameter Store
Chapter 24 · Observability: logs, metrics and traces
- 24.1 CloudWatch Logs, metrics and alarms
- 24.2 CloudWatch Dashboards and Contributor Insights
- 24.3 X-Ray: distributed tracing
- 24.4 OpenTelemetry on AWS
- 24.5 Managed Grafana and Managed Prometheus
Chapter 25 · Cost optimization
- 25.1 AWS Cost Explorer and budgets with alerts
- 25.2 Trusted Advisor and Compute Optimizer
- 25.3 Rightsizing: how to detect overprovisioning
- 25.4 Savings Plans vs Reserved Instances: strategic decision
- 25.5 FinOps: culture and processes to control spending
Chapter 26 · High availability and disaster recovery
- 26.1 RTO and RPO: defining objectives
- 26.2 Strategies: backup/restore, pilot light, warm standby, multi-site
- 26.3 Route 53 health checks and automatic failover
- 26.4 AWS Backup: centralized backup policy
Chapter 27 · AWS Well-Architected Framework
- 27.1 The six pillars: operational excellence, security, reliability, performance efficiency, cost optimization, sustainability
- 27.2 Well-Architected Tool: formal reviews
- 27.3 How to apply the framework in design decisions
Chapter 28 · Serverless architectures at scale
- 28.1 Event-driven architecture with Lambda + EventBridge
- 28.2 Saga pattern for distributed transactions
- 28.3 Step Functions: orchestration of complex workflows
- 28.4 Lambda@Edge and CloudFront Functions
Chapter 29 · Data platforms on AWS
- 29.1 Data Lake with S3, Glue and Athena
- 29.2 Kinesis Data Streams and Firehose for streaming
- 29.3 Redshift: data warehousing at scale
- 29.4 Lake Formation: data governance
Chapter 30 · Multi-account and landing zones
- 30.1 Why separate workloads into different accounts
- 30.2 AWS Control Tower and Account Factory
- 30.3 Centralized log and security management
- 30.4 Terraform at multi-account scale with shared modules
Chapter 31 · Platform Engineering and Internal Developer Platform
- 31.1 Golden paths and abstractions over Terraform
- 31.2 AWS Service Catalog
- 31.3 Backstage as a developer portal
- 31.4 Terraform modules as internal product
Chapter 32 · Relevant AWS certifications
- 32.1 Cloud Practitioner: is it worth it?
- 32.2 Solutions Architect Associate → Professional
- 32.3 DevOps Engineer Professional
- 32.4 Specialty: Security, Database, Networking
- 32.5 HashiCorp Terraform Associate
Chapter 33 · Projects to consolidate what you've learned
- 33.1 Project 1: serverless blog (S3 + CloudFront + Lambda + DynamoDB)
- 33.2 Project 2: REST API with ECS Fargate + RDS + ALB
- 33.3 Project 3: data platform with Glue + Athena + Redshift
- 33.4 Project 4: multi-account landing zone with Terraform and Control Tower
