We close the messaging chapter by putting the pieces together (SQS, SNS, EventBridge) into the major architecture patterns they enable. More than specific services, here we talk about ways to design systems that are robust, flexible, and scalable. Understanding these patterns makes you an architect, not just a service user.
Pattern 1: Publisher/Subscriber (pub/sub)
We already saw this with SNS (subchapter 15.2): a publisher emits a message and many subscribers receive it, without the publisher knowing who they are.
The underlying idea: whoever emits the event does not know nor care who will receive it. This allows you to add new subscribers without touching the publisher.
Example: today, when there’s a new order, you notify billing and inventory. Tomorrow, marketing also wants to know to send offers. With pub/sub, you just add a subscriber to the topic; the order service remains untouched. The system grows without breaking what already exists.
It’s implemented with SNS (simple broadcast) or EventBridge (smart routing).
Pattern 2: Decoupling
This is perhaps the most important pattern in the whole chapter. Decoupling means that the components of a system do not depend directly on each other: they communicate through an intermediary (a queue or a bus), not by “calling” each other.
Coupled (fragile) vs decoupled (robust) system
COUPLED (fragile): Service A ──calls directly──► Service B If B is down or slow, A gets blocked or fails. DECOUPLED (robust): Service A ──► [SQS Queue] ──► Service B A leaves the message and moves on. If B is down, the message waits.
The advantages of decoupling (which we already saw with SQS, subchapter 15.1):
- Resilience: if one component fails, the others keep working; messages wait.
- Independent scaling: you can scale each component separately according to its load.
- Maintainability: you can change, update, or replace a component without affecting the others (as long as it respects the message format).
- Peak smoothing: the queue absorbs traffic spikes.
Analogy: a coupled system is like a phone conversation: both have to be available at the same time; if one doesn’t answer, there’s no communication. A decoupled system is like sending a WhatsApp message: you send it and move on; the other person reads it when they can. Much more flexible and resilient.
Decoupling is achieved with queues (SQS), notifications (SNS), and event buses (EventBridge): all the pieces from this chapter.
Pattern 3: Saga (distributed transactions)
This one is more advanced, but it’s good to know. It arises from a real problem: how do you coordinate an operation that affects several services, when one might fail halfway through?
The problem
Imagine a purchase that involves three steps in three different services:
1. Charge the customer (payment service) 2. Reserve the product (inventory service) 3. Schedule the shipment (logistics service)
What happens if step 1 (charge) succeeds, but step 2 (inventory) fails because there’s no stock? You’ve charged the customer for a product you can’t deliver. In a single system you’d use a “transaction” that undoes everything at once, but here they are separate services: there’s no single transaction that covers them all.
The solution: the saga pattern
A saga breaks the operation into a sequence of steps, where each step has a defined compensating action (how to undo it). If a step fails, the compensations for the previous steps are executed in reverse order, leaving the system consistent.
Step 1: Charge ✓ → compensation: Refund
Step 2: Reserve stock ✗ ← FAILS HERE
Saga’s reaction:
→ executes the compensation for step 1: REFUND the customer
→ the system remains consistent (no one paid for nothing)Analogy: a saga is like a travel reservation with flight, hotel, and car. If you book the flight and hotel, but there are no cars available, you don’t end up with a useless flight and hotel: the system cancels (compensates) the flight and hotel to leave you as you were. Each reservation knows how to cancel itself.
In AWS, sagas are often orchestrated with Step Functions (we’ll see this in Chapter 28), which coordinates the steps and compensations, relying on queues and events to communicate between services.
Pattern summary table
| Pattern | What it solves | Implemented with |
|---|---|---|
| Pub/Sub | Notify many without the sender knowing them | SNS, EventBridge |
| Decoupling | Services don’t depend directly on each other | SQS, SNS, EventBridge |
| Saga | Coordinate operations across multiple services with possible failure | Step Functions + queues/events |
The event-driven architecture mindset
All these patterns share the same philosophy, that of event-driven architectures: instead of a big monolithic system where everything is intertwined, you build small, independent components that communicate via messages and events. The result: more resilient systems (a failure doesn’t bring down everything), more scalable (each piece scales on its own), and easier to evolve (you add pieces without breaking the others).
What you should remember
- Pub/Sub: the sender publishes and many receive, without knowing them; allows you to add subscribers without touching the publisher. Done with SNS or EventBridge.
- Decoupling (the most important pattern): services communicate via queues/buses, not directly. Brings resilience, independent scaling, maintainability, and peak smoothing. Like moving from a phone call to WhatsApp.
- Saga: coordinates an operation across multiple services by defining, for each step, a compensating action that undoes it if something fails, keeping the system consistent. Orchestrated with Step Functions (Chapter 28).
- All share the event-driven philosophy: small, independent components communicating via events, more resilient, scalable, and evolvable.
You’ve finished Chapter 15! You now know how to connect and decouple services. In Chapter 16 we change topics to content delivery and DNS: how users reach your application quickly and securely (Route 53, CloudFront, SSL certificates, and WAF).
Cloud, AWS & Terraform — From Zero to Expert
Chapter 1 · What is cloud computing
- 1.1 The traditional client-server model
- 1.2 Problems the cloud came to solve
- 1.3 On-premise vs cloud vs hybrid
- 1.4 The three service models: IaaS, PaaS, SaaS
- 1.5 The five pillars of cloud (according to NIST)
- 1.6 Real advantages: elasticity, pay-as-you-go, global availability
Chapter 2 · The cloud market and major providers
- 2.1 AWS, Azure and GCP: differences and market share
- 2.2 Why learn AWS first
- 2.3 Concepts that are universal among providers
Chapter 3 · Regions, availability zones and edge
- 3.1 What is an AWS region and how to choose it
- 3.2 Availability Zones: high availability by design
- 3.3 Edge locations and CloudFront
- 3.4 Latency, resilience and data sovereignty
Chapter 4 · Compute: EC2
- 4.1 Instances: types, families and when to choose each
- 4.2 AMIs, key pairs and Security Groups
- 4.3 Instance lifecycle
- 4.4 Elastic IPs and Placement Groups
- 4.5 Savings Plans vs Reserved vs On-Demand vs Spot
Chapter 5 · Storage: S3
- 5.1 Buckets, objects and keys
- 5.2 Storage classes (Standard, IA, Glacier…)
- 5.3 Versioning and object lifecycle
- 5.4 Bucket policies and ACLs
- 5.5 Static website hosting
Chapter 6 · Networking: VPC
- 6.1 What is a VPC and why you need it
- 6.2 Public and private subnets
- 6.3 Internet Gateway and NAT Gateway
- 6.4 Route Tables and Network ACLs
- 6.5 VPC Peering and endpoints
Chapter 7 · Identity and access: IAM
- 7.1 Users, groups, roles and policies
- 7.2 The principle of least privilege
- 7.3 Identity-based vs resource-based policies
- 7.4 MFA and temporary credentials (STS)
- 7.5 IAM security best practices
Chapter 8 · Managed databases
- 8.1 RDS: engines, Multi-AZ and read replicas
- 8.2 Aurora and its advantages over vanilla RDS
- 8.3 DynamoDB: key-value / document model
- 8.4 ElastiCache for in-memory cache
- 8.5 When to use each type of database
Chapter 9 · Why Infrastructure as Code
- 9.1 Problems with manual provisioning
- 9.2 Declarative vs imperative IaC
- 9.3 Terraform vs CloudFormation vs Pulumi vs CDK
- 9.4 The plan → apply → destroy cycle
Chapter 10 · HCL: the Terraform language
- 10.1 Resource, variable, output, locals blocks
- 10.2 Data types: string, number, bool, list, map, object
- 10.3 Expressions, references and built-in functions
- 10.4 Conditionals and loops (count, for_each, for)
Chapter 11 · Providers and state
- 11.1 How the AWS provider works
- 11.2 The terraform.tfstate file and its importance
- 11.3 Local state vs remote state (S3 + DynamoDB)
- 11.4 Essential commands: init, plan, apply, destroy, fmt, validate
Chapter 12 · Your first real infrastructure in Terraform
- 12.1 Create a VPC with subnets from scratch
- 12.2 Launch a public EC2 instance
- 12.3 Associate a Security Group and an Elastic IP
- 12.4 Outputs and references between resources
- 12.5 Team workflow: PR review of plans
Chapter 13 · Load balancing and auto scaling
- 13.1 Application Load Balancer vs Network Load Balancer
- 13.2 Target Groups, listeners and rules
- 13.3 Auto Scaling Groups: policies and metrics
- 13.4 Warm pools and lifecycle hooks
Chapter 14 · Serverless with Lambda
- 14.1 The Lambda execution model
- 14.2 Triggers: API Gateway, S3, DynamoDB Streams, SQS
- 14.3 Dependency management and layers
- 14.4 Cold starts and strategies to reduce them
- 14.5 Limits and anti-patterns
Chapter 15 · Messaging and events
- 15.1 SQS: standard vs FIFO queues, DLQ
- 15.2 SNS: topics, subscriptions, fan-out
- 15.3 EventBridge: event buses and rules
- 15.4 Patterns: pub/sub, decoupling, saga
Chapter 16 · Content delivery and DNS
- 16.1 Route 53: record types and routing policies
- 16.2 CloudFront: distributions, caches and origins
- 16.3 ACM: free SSL/TLS certificates
- 16.4 WAF integrated with CloudFront
Chapter 17 · Containers on AWS
- 17.1 Docker: quick review of key concepts
- 17.2 ECR: private image registry
- 17.3 ECS: task definitions, services, Fargate vs EC2
- 17.4 EKS: when Kubernetes and when not
Chapter 18 · Modules: reuse and composition
- 18.1 Anatomy of a Terraform module
- 18.2 Input variables, outputs and dependencies
- 18.3 Local modules vs Terraform Registry modules
- 18.4 Module versioning with Git tags
- 18.5 Design of generic vs domain-specific modules
Chapter 19 · Workspaces and environment management
- 19.1 Terraform workspaces: use cases and limitations
- 19.2 Directory strategy per environment (dev/stg/prod)
- 19.3 Terragrunt: DRY for environment configurations
- 19.4 Environment variables and .tfvars files
Chapter 20 · Remote backends and locking
- 20.1 Configure S3 + DynamoDB as backend
- 20.2 State locking: avoiding team corruption
- 20.3 State migration between backends
- 20.4 terraform import: bring existing resources into state
Chapter 21 · Infrastructure testing
- 21.1 Terraform validate and fmt in CI
- 21.2 Checkov and tfsec: static security analysis
- 21.3 Terratest: integration tests in Go
- 21.4 Contract testing between modules
Chapter 22 · Terraform in CI/CD
- 22.1 Basic pipeline: lint → plan → apply in GitHub Actions
- 22.2 Atlantis: GitOps for Terraform
- 22.3 Terraform Cloud / HCP Terraform
- 22.4 Drift detection and automatic reconciliation
Chapter 23 · Defense in depth
- 23.1 AWS Organizations and Service Control Policies
- 23.2 AWS Config: continuous compliance
- 23.3 GuardDuty: threat detection
- 23.4 Security Hub: centralized view
- 23.5 KMS: key management and rotation
- 23.6 Secrets Manager vs Parameter Store
Chapter 24 · Observability: logs, metrics and traces
- 24.1 CloudWatch Logs, metrics and alarms
- 24.2 CloudWatch Dashboards and Contributor Insights
- 24.3 X-Ray: distributed tracing
- 24.4 OpenTelemetry on AWS
- 24.5 Managed Grafana and Managed Prometheus
Chapter 25 · Cost optimization
- 25.1 AWS Cost Explorer and budgets with alerts
- 25.2 Trusted Advisor and Compute Optimizer
- 25.3 Rightsizing: how to detect overprovisioning
- 25.4 Savings Plans vs Reserved Instances: strategic decision
- 25.5 FinOps: culture and processes to control spending
Chapter 26 · High availability and disaster recovery
- 26.1 RTO and RPO: defining objectives
- 26.2 Strategies: backup/restore, pilot light, warm standby, multi-site
- 26.3 Route 53 health checks and automatic failover
- 26.4 AWS Backup: centralized backup policy
Chapter 27 · AWS Well-Architected Framework
- 27.1 The six pillars: operational excellence, security, reliability, performance efficiency, cost optimization, sustainability
- 27.2 Well-Architected Tool: formal reviews
- 27.3 How to apply the framework in design decisions
Chapter 28 · Serverless architectures at scale
- 28.1 Event-driven architecture with Lambda + EventBridge
- 28.2 Saga pattern for distributed transactions
- 28.3 Step Functions: orchestration of complex workflows
- 28.4 Lambda@Edge and CloudFront Functions
Chapter 29 · Data platforms on AWS
- 29.1 Data Lake with S3, Glue and Athena
- 29.2 Kinesis Data Streams and Firehose for streaming
- 29.3 Redshift: data warehousing at scale
- 29.4 Lake Formation: data governance
Chapter 30 · Multi-account and landing zones
- 30.1 Why separate workloads into different accounts
- 30.2 AWS Control Tower and Account Factory
- 30.3 Centralized log and security management
- 30.4 Terraform at multi-account scale with shared modules
Chapter 31 · Platform Engineering and Internal Developer Platform
- 31.1 Golden paths and abstractions over Terraform
- 31.2 AWS Service Catalog
- 31.3 Backstage as a developer portal
- 31.4 Terraform modules as internal product
Chapter 32 · Relevant AWS certifications
- 32.1 Cloud Practitioner: is it worth it?
- 32.2 Solutions Architect Associate → Professional
- 32.3 DevOps Engineer Professional
- 32.4 Specialty: Security, Database, Networking
- 32.5 HashiCorp Terraform Associate
Chapter 33 · Projects to consolidate what you've learned
- 33.1 Project 1: serverless blog (S3 + CloudFront + Lambda + DynamoDB)
- 33.2 Project 2: REST API with ECS Fargate + RDS + ALB
- 33.3 Project 3: data platform with Glue + Athena + Redshift
- 33.4 Project 4: multi-account landing zone with Terraform and Control Tower
