We close Part V with a very real problem that affects all infrastructure managed with code: drift. It occurs when the real infrastructure no longer matches what your code says. In this subchapter, you’ll understand why it happens, why it’s dangerous, and how to detect and correct it automatically. It’s the cherry on top of a mature Infrastructure as Code workflow.
What is drift
Remember Terraform’s central idea: your code describes how the infrastructure should be, and Terraform makes reality match it (Chapter 9). Drift is when the real infrastructure deviates from what the code says, without the code having changed.
Your code says: server with 2 CPUs, port 443 open
Reality is now: server with 4 CPUs, port 22 also open
↑ someone changed it outside = DRIFTThe code and reality no longer match. That difference is drift.
Why drift occurs
Drift appears when someone or something modifies the infrastructure outside of Terraform:
- Manual changes: someone logs into the AWS console and modifies a resource “quickly” to solve an emergency (opens a port, changes a size...), without updating the code.
- Other tools or scripts that touch the same resources.
- Automatic AWS processes that modify something (rare, but possible).
- Autoscaling or other systems that change the number of resources.
The most common and dangerous case: a manual “emergency” change. At 3 a.m. there’s an incident, someone logs into the AWS console and changes something by hand to put out the fire, and then forgets to reflect it in the code. From then on, the code lies: it no longer describes reality.
Analogy: drift is like having blueprints of a house that no longer match the real house because someone knocked down a wall without updating the blueprints. If later a builder works guided by the old blueprints, it can cause a disaster, because reality is different.
Why drift is dangerous
Drift undermines all trust in your Infrastructure as Code:
- The code stops being the source of truth: you can no longer trust that the code describes what’s really there.
- Surprises in the next
apply: when someone applies Terraform again, it will try to “correct” the manual change (revert it to what the code says), which can break what was fixed by hand, or remove a security patch! - Hidden security risks: if the manual change opened a dangerous port, the code doesn’t reflect it, so security reviews (Chapter 21) won’t detect it. The hole remains hidden.
- Loss of reproducibility: if you recreate the infrastructure from the code, you won’t get what was really there, because the code is outdated.
How to detect drift
The good news is that detecting drift is simple, because Terraform already knows how to compare code with reality. Remember that terraform plan (subchapter 11.4) does exactly that: it compares code, state, and reality. If there’s drift, the plan shows it:
terraform plan
→ if NO drift → "No changes" ✓ (code and reality match)
→ if THERE IS drift → shows the differences:
~ aws_security_group.web: port 22 open (not in the code) ⚠️Automatic and periodic detection
The key is not to wait for someone to run a plan by chance. Automatic drift detection consists of running terraform plan periodically (for example, every night) automatically, and alerting if it detects differences:
Every night, automatically:
terraform plan
→ are there unexpected changes?
→ YES → ALERT the team (Slack, email...): "there is drift in production"
→ NO → all good, nothing to reportThis way, if someone made a manual change, the team finds out the next day, not weeks later when it’s already caused a problem. Platforms like HCP Terraform (subchapter 22.3) offer this integrated drift detection; you can also set it up with a scheduled pipeline (remember EventBridge schedules, subchapter 15.3, or a cron in your CI).
Reconciliation: correcting drift
Detecting drift is only half the battle; then you have to reconcile (realign code and reality). There are two ways, depending on which change is the “correct” one:
Option A: code is the truth → revert the manual change
If the manual change shouldn’t have been made, you run terraform apply so that Terraform returns the infrastructure to what the code says, eliminating the deviation.
Option B: the manual change was necessary → update the code
If the manual change was correct (an adjustment that needs to be kept), then you update the code to reflect that change, and submit it via a PR (subchapter 12.5). Now the code is the truth again.
Automatic reconciliation: some teams configure that, for certain drifts, the system automatically reverts to the state of the code (option A) without intervention. This is powerful to enforce that all changes go through code, but it must be used with care: automatically reverting a change that was a legitimate emergency patch could reopen a problem. That’s why many prefer automatic detection + human decision on how to reconcile.
The underlying lesson: every change, through code
Drift reinforces the central message of all Infrastructure as Code: all changes must be made through code, never by hand. Drift detection is the watchdog that enforces that rule, alerting when someone breaks it.
Real-world example: a company runs drift detection every night in production. One morning, the alert says: “the database Security Group has port 5432 open to the internet, and it’s not in the code.” They investigate: a developer opened it by hand the previous afternoon for a test and forgot to close it. Thanks to drift detection, they discover it within hours (not when an attacker finds it) and fix it. Without that vigilance, that hole could have gone unnoticed for months.
What you should remember
- Drift is when the real infrastructure no longer matches the code, usually due to manual changes made outside of Terraform (the classic emergency patch not reflected in the code).
- It’s dangerous: the code stops being the source of truth, the next
applycan revert important changes, it hides security risks, and breaks reproducibility. Like blueprints that no longer match the house. - It’s detected with
terraform plan(compares code and reality); ideally with automatic and periodic detection (e.g. every night) that alerts the team to differences. - It’s reconciled in two ways: revert the manual change with
apply(if the code is the truth) or update the code via PR (if the manual change was valid). - The underlying lesson: all changes must be made through code; drift detection is the watchdog that enforces that rule.
You’ve finished Chapter 22 and Part V! You now master Terraform at an advanced level: modules, environments, state, testing, and CI/CD. In Part VI we shift focus to the transversal aspects of AWS that set a professional apart: we’ll start with defense-in-depth security.
Cloud, AWS & Terraform — From Zero to Expert
Chapter 1 · What is cloud computing
- 1.1 The traditional client-server model
- 1.2 Problems the cloud came to solve
- 1.3 On-premise vs cloud vs hybrid
- 1.4 The three service models: IaaS, PaaS, SaaS
- 1.5 The five pillars of cloud (according to NIST)
- 1.6 Real advantages: elasticity, pay-as-you-go, global availability
Chapter 2 · The cloud market and major providers
- 2.1 AWS, Azure and GCP: differences and market share
- 2.2 Why learn AWS first
- 2.3 Concepts that are universal among providers
Chapter 3 · Regions, availability zones and edge
- 3.1 What is an AWS region and how to choose it
- 3.2 Availability Zones: high availability by design
- 3.3 Edge locations and CloudFront
- 3.4 Latency, resilience and data sovereignty
Chapter 4 · Compute: EC2
- 4.1 Instances: types, families and when to choose each
- 4.2 AMIs, key pairs and Security Groups
- 4.3 Instance lifecycle
- 4.4 Elastic IPs and Placement Groups
- 4.5 Savings Plans vs Reserved vs On-Demand vs Spot
Chapter 5 · Storage: S3
- 5.1 Buckets, objects and keys
- 5.2 Storage classes (Standard, IA, Glacier…)
- 5.3 Versioning and object lifecycle
- 5.4 Bucket policies and ACLs
- 5.5 Static website hosting
Chapter 6 · Networking: VPC
- 6.1 What is a VPC and why you need it
- 6.2 Public and private subnets
- 6.3 Internet Gateway and NAT Gateway
- 6.4 Route Tables and Network ACLs
- 6.5 VPC Peering and endpoints
Chapter 7 · Identity and access: IAM
- 7.1 Users, groups, roles and policies
- 7.2 The principle of least privilege
- 7.3 Identity-based vs resource-based policies
- 7.4 MFA and temporary credentials (STS)
- 7.5 IAM security best practices
Chapter 8 · Managed databases
- 8.1 RDS: engines, Multi-AZ and read replicas
- 8.2 Aurora and its advantages over vanilla RDS
- 8.3 DynamoDB: key-value / document model
- 8.4 ElastiCache for in-memory cache
- 8.5 When to use each type of database
Chapter 9 · Why Infrastructure as Code
- 9.1 Problems with manual provisioning
- 9.2 Declarative vs imperative IaC
- 9.3 Terraform vs CloudFormation vs Pulumi vs CDK
- 9.4 The plan → apply → destroy cycle
Chapter 10 · HCL: the Terraform language
- 10.1 Resource, variable, output, locals blocks
- 10.2 Data types: string, number, bool, list, map, object
- 10.3 Expressions, references and built-in functions
- 10.4 Conditionals and loops (count, for_each, for)
Chapter 11 · Providers and state
- 11.1 How the AWS provider works
- 11.2 The terraform.tfstate file and its importance
- 11.3 Local state vs remote state (S3 + DynamoDB)
- 11.4 Essential commands: init, plan, apply, destroy, fmt, validate
Chapter 12 · Your first real infrastructure in Terraform
- 12.1 Create a VPC with subnets from scratch
- 12.2 Launch a public EC2 instance
- 12.3 Associate a Security Group and an Elastic IP
- 12.4 Outputs and references between resources
- 12.5 Team workflow: PR review of plans
Chapter 13 · Load balancing and auto scaling
- 13.1 Application Load Balancer vs Network Load Balancer
- 13.2 Target Groups, listeners and rules
- 13.3 Auto Scaling Groups: policies and metrics
- 13.4 Warm pools and lifecycle hooks
Chapter 14 · Serverless with Lambda
- 14.1 The Lambda execution model
- 14.2 Triggers: API Gateway, S3, DynamoDB Streams, SQS
- 14.3 Dependency management and layers
- 14.4 Cold starts and strategies to reduce them
- 14.5 Limits and anti-patterns
Chapter 15 · Messaging and events
- 15.1 SQS: standard vs FIFO queues, DLQ
- 15.2 SNS: topics, subscriptions, fan-out
- 15.3 EventBridge: event buses and rules
- 15.4 Patterns: pub/sub, decoupling, saga
Chapter 16 · Content delivery and DNS
- 16.1 Route 53: record types and routing policies
- 16.2 CloudFront: distributions, caches and origins
- 16.3 ACM: free SSL/TLS certificates
- 16.4 WAF integrated with CloudFront
Chapter 17 · Containers on AWS
- 17.1 Docker: quick review of key concepts
- 17.2 ECR: private image registry
- 17.3 ECS: task definitions, services, Fargate vs EC2
- 17.4 EKS: when Kubernetes and when not
Chapter 18 · Modules: reuse and composition
- 18.1 Anatomy of a Terraform module
- 18.2 Input variables, outputs and dependencies
- 18.3 Local modules vs Terraform Registry modules
- 18.4 Module versioning with Git tags
- 18.5 Design of generic vs domain-specific modules
Chapter 19 · Workspaces and environment management
- 19.1 Terraform workspaces: use cases and limitations
- 19.2 Directory strategy per environment (dev/stg/prod)
- 19.3 Terragrunt: DRY for environment configurations
- 19.4 Environment variables and .tfvars files
Chapter 20 · Remote backends and locking
- 20.1 Configure S3 + DynamoDB as backend
- 20.2 State locking: avoiding team corruption
- 20.3 State migration between backends
- 20.4 terraform import: bring existing resources into state
Chapter 21 · Infrastructure testing
- 21.1 Terraform validate and fmt in CI
- 21.2 Checkov and tfsec: static security analysis
- 21.3 Terratest: integration tests in Go
- 21.4 Contract testing between modules
Chapter 22 · Terraform in CI/CD
- 22.1 Basic pipeline: lint → plan → apply in GitHub Actions
- 22.2 Atlantis: GitOps for Terraform
- 22.3 Terraform Cloud / HCP Terraform
- 22.4 Drift detection and automatic reconciliation
Chapter 23 · Defense in depth
- 23.1 AWS Organizations and Service Control Policies
- 23.2 AWS Config: continuous compliance
- 23.3 GuardDuty: threat detection
- 23.4 Security Hub: centralized view
- 23.5 KMS: key management and rotation
- 23.6 Secrets Manager vs Parameter Store
Chapter 24 · Observability: logs, metrics and traces
- 24.1 CloudWatch Logs, metrics and alarms
- 24.2 CloudWatch Dashboards and Contributor Insights
- 24.3 X-Ray: distributed tracing
- 24.4 OpenTelemetry on AWS
- 24.5 Managed Grafana and Managed Prometheus
Chapter 25 · Cost optimization
- 25.1 AWS Cost Explorer and budgets with alerts
- 25.2 Trusted Advisor and Compute Optimizer
- 25.3 Rightsizing: how to detect overprovisioning
- 25.4 Savings Plans vs Reserved Instances: strategic decision
- 25.5 FinOps: culture and processes to control spending
Chapter 26 · High availability and disaster recovery
- 26.1 RTO and RPO: defining objectives
- 26.2 Strategies: backup/restore, pilot light, warm standby, multi-site
- 26.3 Route 53 health checks and automatic failover
- 26.4 AWS Backup: centralized backup policy
Chapter 27 · AWS Well-Architected Framework
- 27.1 The six pillars: operational excellence, security, reliability, performance efficiency, cost optimization, sustainability
- 27.2 Well-Architected Tool: formal reviews
- 27.3 How to apply the framework in design decisions
Chapter 28 · Serverless architectures at scale
- 28.1 Event-driven architecture with Lambda + EventBridge
- 28.2 Saga pattern for distributed transactions
- 28.3 Step Functions: orchestration of complex workflows
- 28.4 Lambda@Edge and CloudFront Functions
Chapter 29 · Data platforms on AWS
- 29.1 Data Lake with S3, Glue and Athena
- 29.2 Kinesis Data Streams and Firehose for streaming
- 29.3 Redshift: data warehousing at scale
- 29.4 Lake Formation: data governance
Chapter 30 · Multi-account and landing zones
- 30.1 Why separate workloads into different accounts
- 30.2 AWS Control Tower and Account Factory
- 30.3 Centralized log and security management
- 30.4 Terraform at multi-account scale with shared modules
Chapter 31 · Platform Engineering and Internal Developer Platform
- 31.1 Golden paths and abstractions over Terraform
- 31.2 AWS Service Catalog
- 31.3 Backstage as a developer portal
- 31.4 Terraform modules as internal product
Chapter 32 · Relevant AWS certifications
- 32.1 Cloud Practitioner: is it worth it?
- 32.2 Solutions Architect Associate → Professional
- 32.3 DevOps Engineer Professional
- 32.4 Specialty: Security, Database, Networking
- 32.5 HashiCorp Terraform Associate
Chapter 33 · Projects to consolidate what you've learned
- 33.1 Project 1: serverless blog (S3 + CloudFront + Lambda + DynamoDB)
- 33.2 Project 2: REST API with ECS Fargate + RDS + ALB
- 33.3 Project 3: data platform with Glue + Athena + Redshift
- 33.4 Project 4: multi-account landing zone with Terraform and Control Tower
