rsz_1dc_secreu_5

Data Center Security

Data Center Security — Engineering Guide

Modern data centers are no longer simple collections of physical servers connected to a small number of network segments.

They host business-critical applications, databases, APIs, virtual machines, containers, distributed platforms, cloud-connected services, and increasingly dynamic workloads.

As application architectures have become more distributed, the security model has had to evolve with them.

Traditional security architectures often relied heavily on perimeter firewalls, VLANs, IP addressing, and manually maintained access-control lists. These mechanisms remain important, but they are no longer sufficient by themselves.

Modern applications generate large amounts of east-west traffic between workloads inside the data center.

A web application may communicate with application services.

Application services may communicate with databases.

Microservices may communicate with dozens of other services.

Containers may appear and disappear dynamically.

Cloud workloads may communicate with on-premises infrastructure.

Management, monitoring, backup, identity, and security systems create additional communication relationships.

The result is a highly interconnected environment in which the traditional concept of a single security perimeter becomes increasingly difficult to apply.

From Network Security to Workload Security

Modern data center security therefore needs to answer a different question.

Instead of asking:

Which network is this server connected to?

we increasingly need to ask:

Which workload is this, what does it need to communicate with, and why?

This is the foundation of application-centric security.

Security policy can be associated with applications, workloads, identities, relationships, and risk rather than being permanently tied to physical network locations.

Cisco Application Centric Infrastructure (ACI) provides one example of this approach.

ACI allows application requirements to become part of the network policy model. Endpoint groups, contracts, filters, micro-segmentation, and Layer 4–Layer 7 service integration can be used to express and enforce communication relationships across the fabric.

Security as a Layered Architecture

Modern data center security should not be treated as a single technology.

It is better understood as a series of complementary layers:

Security architecture

↓

Segmentation

↓

Policy

↓

Enforcement

↓

Deep inspection

↓

Telemetry

↓

Detection

↓

Response

Each layer addresses a different problem.

Physical and infrastructure controls protect the underlying environment.

Segmentation reduces the size of security boundaries.

Policy defines authorised relationships.

Distributed enforcement prevents unauthorised communication.

Firewalls and other Layer 4–Layer 7 services provide deeper inspection.

Telemetry provides visibility into what is actually happening.

Analytics identify abnormal behaviour.

Response mechanisms allow compromised workloads to be contained.

The Data Center Security Engineering Model

This guide develops that model across four sections.

Section 1 — Security Architecture

Examines the different security layers that protect modern data centers, including physical, network, compute, storage, application, cloud, identity, observability, and resilience controls.

Section 2 — Segmentation and Policy

Explores how security requirements become enforceable communication relationships using concepts such as EPGs, ESGs, contracts, filters, and micro-segmentation.

Section 3 — Enforcement and L4–L7 Services

Examines how authorised and unauthorised traffic is enforced within the fabric and how deeper inspection can be integrated through firewalls, IPS, load balancers, service graphs, and policy-based redirect.

Section 4 — Visibility, Detection and Adaptive Defence

Moves beyond preventative controls into telemetry, behavioural analysis, security analytics, incident investigation, risk-based enforcement, containment, and adaptive security.

The Core Principle

The objective is not simply to prevent every possible connection.

The objective is to create an environment where:

Required communication is explicitly permitted, unnecessary communication is restricted, abnormal behaviour is visible, and compromised workloads can be contained before they become a larger incident.

That is the foundation of a modern, policy-driven data center security architecture.


Engineering Guide Structure

1. Security Architecture

Understand the layers that protect the modern data center.

2. Segmentation and Policy

Define which workloads should communicate and under what conditions.

3. Enforcement and L4–L7 Services

Enforce those relationships and introduce deeper inspection where required.

4. Visibility, Detection and Adaptive Defence

Observe the environment, identify abnormal behaviour, investigate incidents, and respond to changing risk.

The Complete Security Loop

Understand → Segment → Enforce → Inspect → Observe → Detect → Respond

Data Center Security Architecture

Engineering Guide · Data Center Security Interactive Contents

From Segmentation to Adaptive Defense

Use the four engineering sections below to move from security foundations and policy design through distributed enforcement, visibility, incident response and adaptive defense.

01
ARCHITECT
Build the security foundation
02
SEGMENT
Define workload relationships
03
ENFORCE
Apply distributed security policy
04
DETECT & RESPOND
Investigate and contain threats
Engineering path: Architect the environment → segment workloads → enforce policy → detect, contain and recover.
SECTION 01 · SECURITY FOUNDATIONS
Engineering Guide
Data Center Security Techniques
Build Security as a Layered Control System

Data center security is not a single firewall, ACL or security product. It is a layered engineering model spanning physical infrastructure, network segmentation, workloads, applications, identity, telemetry and incident response.

01
Protect
Physical infrastructure and critical assets
02
Segment
Reduce unnecessary workload communication
03
Verify
Use identity, context and behaviour
04
Observe
Detect, investigate and respond
What You Will Learn

How modern data center security combines segmentation, least privilege, identity, workload protection, observability and resilience rather than relying on a single perimeter control.

Engineering Focus

The objective is to make every communication path intentional, observable and enforceable — from physical infrastructure through application workloads.

Engineering Question
If a workload is compromised inside the data center, what prevents the attacker from moving laterally to the next application, database or security boundary?

1. Data Center Security Architecture

Data center security is not a single control or appliance.

A modern data center requires multiple security layers working together to protect physical infrastructure, networks, workloads, applications, data, identities, and operational processes.

The objective is to prevent unauthorised access, reduce the attack surface, detect abnormal behaviour, limit lateral movement, and maintain resilience when security controls fail or an incident occurs.

A useful way to approach data center security is to consider the environment as a series of interconnected security domains.

1.1 The Security Layers

A modern data center can include:

  • Physical security

  • Network security

  • Segmentation

  • Compute security

  • Storage security

  • Application security

  • Cloud and hybrid security

  • Identity and access control

  • Observability

  • Threat detection

  • Incident response

  • Resilience and recovery

These layers should not operate independently.

A compromised workload may generate network traffic.

Network telemetry may identify the behaviour.

Identity telemetry may identify the associated user or service.

Endpoint security may provide additional evidence.

Security analytics can correlate the events.

A response system can then contain the workload.

This is the basis of layered defence.

1.2 Physical Security

The physical environment remains the first security boundary.

Controls can include:

  • Controlled facility access

  • Badge authentication

  • Biometrics

  • Surveillance

  • Security personnel

  • Restricted data center areas

  • Rack security

  • Tamper detection

  • Secure cabling

  • Environmental monitoring

Physical security is particularly important because compromise of the physical infrastructure can undermine otherwise strong logical controls.

An attacker who gains direct access to infrastructure may be able to bypass network-based assumptions.

1.3 Network Security

The network provides the communication foundation for the data center.

Traditional controls include:

  • VLAN segmentation

  • VRF isolation

  • ACLs

  • Firewalls

  • Routing policy

  • Network security zones

  • IDS/IPS

  • VPNs

  • Encryption

  • Network telemetry

However, modern applications increasingly require security controls that understand workloads and application relationships rather than only addresses and interfaces.

1.4 East-West Security

Traditional perimeter security focuses heavily on north-south traffic.

Modern data centers also require strong east-west security.

For example:

WEB → APP

APP → DB

APP → CACHE

SERVICE → SERVICE

MONITORING → WORKLOAD

If an attacker compromises one workload, east-west controls determine how easily that attacker can move to other systems.

This makes internal segmentation a fundamental security requirement.

1.5 Compute Security

The compute layer introduces additional security boundaries.

Virtualisation platforms such as:

  • VMware ESXi

  • Microsoft Hyper-V

  • KVM

can provide workload isolation, but the hypervisor itself must also be protected.

Important controls include:

  • Secure boot

  • Host hardening

  • Patch management

  • Hypervisor security

  • VM isolation

  • Privileged-access controls

  • Host monitoring

Containerised environments introduce additional controls.

These can include:

  • Container image security

  • Runtime protection

  • Namespace isolation

  • Kubernetes network policy

  • Workload identity

  • Runtime behaviour monitoring

The objective is to ensure that compromise of one workload does not automatically provide unrestricted access to others.

1.6 Storage Security

Storage frequently contains the most valuable information in the environment.

Security controls can include:

  • Encryption at rest

  • Encryption in transit

  • Access control

  • Storage segmentation

  • Immutable backups

  • Protected snapshots

  • Replication

  • Backup isolation

  • Recovery testing

Ransomware resilience is particularly important.

A backup that is accessible through the same credentials and security boundaries as production systems may be vulnerable to the same compromise.

Security therefore needs to extend into the recovery architecture.

1.7 Application Security

Applications introduce another security layer.

Controls can include:

  • Web Application Firewalls

  • API gateways

  • Application authentication

  • Secret management

  • Secure CI/CD

  • Dependency scanning

  • Code security testing

  • Runtime protection

  • Application logging

Application security and network security should complement one another.

A secure network cannot compensate for an insecure application, and an application security control cannot replace appropriate network segmentation.

1.8 Cloud and Hybrid Security

Modern data centers increasingly operate across:

On-premises infrastructure

  •  

Private cloud

  •  

Public cloud

  •  

Kubernetes

  •  

SaaS

Security policy therefore has to extend beyond the physical data center.

Cloud environments introduce controls such as:

  • VPC/VNet segmentation

  • Security groups

  • Cloud firewalls

  • IAM

  • Workload identity

  • Private connectivity

  • Cloud logging

  • Cloud security posture management

  • Service-to-service policy

The important principle is consistency.

A workload should not become significantly less protected simply because it has moved from an on-premises environment into a cloud environment.

1.9 Zero Trust

Zero Trust changes the assumption that internal network location automatically implies trust.

Instead of:

Internal network = trusted

the model becomes:

Access must be explicitly authorised.

Important principles include:

  • Least privilege

  • Explicit authentication

  • Continuous verification

  • Identity-aware policy

  • Device posture

  • Workload identity

  • Encryption

  • Deny-by-default principles

Zero Trust therefore complements segmentation.

Segmentation limits communication.

Identity determines who or what is requesting access.

Risk determines whether the communication should remain trusted.

1.10 Identity-Driven Security

Identity provides context that IP addresses cannot.

A network address tells us where traffic is coming from.

Identity can tell us:

  • Which user is involved

  • Which workload is involved

  • Which service account is involved

  • Which device is involved

  • Which application is involved

  • What privileges are associated with the request

This enables more contextual security decisions.

For example:

User identity

  •  

Device posture

  •  

Application

  •  

Network location

  •  

Risk

can produce a much stronger security decision than IP address alone.

1.11 Observability

Security requires visibility.

Important telemetry sources include:

  • NetFlow

  • IPFIX

  • Packet capture

  • Firewall logs

  • DNS logs

  • Authentication logs

  • Endpoint telemetry

  • Application logs

  • Cloud logs

  • Kubernetes telemetry

  • Distributed tracing

Tools and platforms can include:

  • SIEM

  • SOAR

  • EDR/XDR

  • Prometheus

  • Grafana

  • OpenTelemetry

The objective is not to collect every possible event.

The objective is to collect enough meaningful evidence to understand:

What happened?

Who or what was involved?

What changed?

What was affected?

What should happen next?

1.12 Incident Response and Resilience

Prevention will never be perfect.

A mature security architecture therefore assumes that incidents will occur and prepares for them.

Important capabilities include:

  • Incident response plans

  • Security runbooks

  • Automated containment

  • Backup and recovery

  • Disaster recovery

  • Tabletop exercises

  • Recovery testing

  • Crisis communication

  • Forensic evidence collection

The architecture should allow security teams to move from:

Detection

to

Investigation

to

Containment

to

Recovery

without requiring the network to be redesigned during the incident.

1.13 Security Analytics

Modern environments generate too many events for manual analysis alone.

Analytics can identify:

  • Unexpected communication

  • Lateral movement

  • Privilege escalation

  • Abnormal traffic

  • Unusual authentication

  • Misconfiguration

  • Excessive permissions

  • Unused policy

  • Shadow workloads

  • Unexpected exposure

The value comes from correlation.

A single unusual connection may be harmless.

The same connection combined with:

  • unusual authentication

  • abnormal process activity

  • unexpected DNS queries

  • increased traffic

may become a high-value security signal.

1.14 Adaptive Security

Modern security architectures increasingly need to respond to changing conditions.

For example:

Normal workload

→ normal policy

Suspicious workload

→ increased monitoring

High-risk workload

→ restricted communication

Compromised workload

→ quarantine

This introduces a feedback loop between security telemetry and enforcement.

1.15 Engineering Model

A useful architecture is:

Physical security

↓

Network security

↓

Segmentation

↓

Workload security

↓

Application security

↓

Identity

↓

Observability

↓

Detection

↓

Response

↓

Recovery

No individual layer is sufficient.

The strength of the architecture comes from how these controls work together.

1.16 Section 1 Engineering Principle

The modern data center should therefore be treated as a distributed security system, not simply a collection of network devices.

The architecture must understand:

  • Where workloads are located

  • What those workloads represent

  • Who or what can access them

  • Which services they require

  • How they communicate

  • What normal behaviour looks like

  • How abnormal behaviour will be detected

  • How compromised workloads will be contained

This provides the foundation for the next stage:

How do we turn these security requirements into enforceable communication policy?

ENGINEERING EXPLORER · DATA CENTER SECURITY
Trace a Workload Through the Security Architecture
Follow a workload from identity and segmentation through policy enforcement, inspection, telemetry and response. Step through the architecture to see where each security decision is made.
Security Control Path
Stage 1 of 8
01
Workload
The application workload generates traffic toward another service.
ACTIVE
02
Identity
Workload identity, role and contextual attributes establish who is communicating.
WAITING
03
Segmentation
The workload is classified into the appropriate security boundary or group.
WAITING
04
Policy
Application relationship, contract, rule or security policy determines whether communication is permitted.
WAITING
05
Inspection
Selected traffic can be redirected through firewall, IDS/IPS, WAF or other security services.
WAITING
06
Telemetry
Flow, packet, endpoint, identity and application signals provide evidence about the communication.
WAITING
07
Detection & Decision
Correlation and analytics determine whether the observed behaviour remains trusted.
WAITING
08
Response
The architecture can allow, monitor, block, isolate or quarantine the workload.
WAITING
Current Security Layer
Workload

The workload is the starting point for the security decision. Modern data-center security begins by understanding what is communicating, rather than relying only on its IP address or VLAN.

Control
Workload classification
Security Question
What is this workload?
Evidence
Workload attributes
Decision
Identify
Architecture Progress 12%
Live Security Readout
Source WEB-01
Destination APP-01
Traffic HTTPS / TCP 443
Trust State Unknown
Action Classify
Security Decision Timeline
Live execution
Workload
Identity
Segmentation
Policy
Inspection
Telemetry
Decision
Response
NORMAL TRAFFIC

WEB-01 is making an expected HTTPS request to APP-01. The security architecture evaluates the communication progressively.

Anomalous east-west behaviour detected. The architecture must now evaluate risk and determine whether the workload should be monitored, blocked or isolated.

Segmentation and Security Policy

SECTION 02 · POLICY & SEGMENTATION
Engineering Guide
Segmentation, Policy and Security Enforcement
Turn Application Relationships into Security Policy

Modern data center security increasingly moves beyond the question of which subnet or VLAN a workload occupies. The engineering problem is to define which workloads should communicate, under which conditions, and what happens when that relationship is not permitted.

01 · CLASSIFY
Identify Workloads
Group endpoints according to application, role, identity and security context.
02 · DEFINE
Define Relationships
Specify the communication paths an application actually requires.
03 · ENFORCE
Apply Policy
Permit, restrict, inspect or isolate traffic according to explicit policy.
What You Will Learn

How EPGs, contracts, filters, security groups, micro-segmentation and cloud security boundaries translate application requirements into enforceable policy.

Engineering Focus

Good segmentation is not about creating as many zones as possible. It is about creating clear security boundaries with explicit communication relationships that can be understood, tested and maintained.

Engineering Question
If WEB, APP and DB workloads belong to different security groups, what explicit policy should allow — or prevent — each communication path between them?

2. Segmentation and Security Policy

Once the security architecture has been established, the next engineering question is:

Which workloads should be allowed to communicate, and why?

Traditional data center security often relied on VLANs, IP subnets, interfaces and ACLs.

These mechanisms remain useful, but modern applications require a more expressive model.

An application may contain multiple workload types, and those workloads may move across the infrastructure.

Security policy therefore needs to follow the application relationship, rather than simply the physical location of a server.

2.1 From Network Segmentation to Policy Segmentation

Traditional segmentation might look like:

VLAN 10 → Web

VLAN 20 → Application

VLAN 30 → Database

This creates useful boundaries, but it does not automatically define which communication is permitted.

A more complete model is:

WEB

↓

Application policy

↓

APP

↓

Application policy

↓

DB

The important question becomes:

What relationship exists between these workloads?

2.2 Designing Segmentation Around Application Relationships

Consider a three-tier application:

Web

↓

Application

↓

Database

The security policy may require:

  • Web can communicate with application services

  • Application can communicate with databases

  • Web cannot directly access databases

  • Management systems can access approved administrative interfaces

  • Monitoring systems can collect telemetry

  • Backup systems can access protected storage

This is much more precise than simply defining three VLANs.

The security architecture is now based on relationships.

2.3 Micro-Segmentation

Large security zones can create excessive trust.

If hundreds of workloads share the same security boundary, compromise of one workload may provide an attacker with many possible lateral-movement paths.

Micro-segmentation reduces these trust relationships.

Instead of:

Production → Production

we can define:

WEB → APP

APP → DB

MONITORING → WORKLOAD

BACKUP → STORAGE

Each relationship can be independently controlled.

2.4 Policy as the Security Contract

A useful way to think about security policy is as a contract between workloads.

The policy states:

This workload is allowed to communicate with that workload using these services.

For example:

APP → DB

Allowed:

TCP/5432

Not automatically allowed:

SSH

RDP

SMB

Other unnecessary services

This produces a least-privilege communication model.

2.5 Cisco ACI and Policy-Based Segmentation

Cisco ACI provides an application-centric policy framework.

Rather than configuring every security rule independently on physical interfaces, administrators can define groups of endpoints and relationships between those groups.

Important constructs include:

  • Endpoint Groups

  • Contracts

  • Filters

  • Endpoint Security Groups

  • Micro-segmentation

  • L3Out policy

  • Layer 4–Layer 7 service integration

These constructs allow policy to be represented in terms of applications and workloads.

2.6 Endpoint Groups

An Endpoint Group, or EPG, provides a mechanism for grouping endpoints that share common policy requirements.

An EPG can represent a logical application tier such as:

WEB-EPG

APP-EPG

DB-EPG

Security policy can then be applied to the relationships between these groups.

This provides a more scalable model than individually managing every endpoint.

2.7 Contracts

Contracts define communication relationships between EPGs.

For example:

WEB-EPG

↓

WEB-TO-APP contract

↓

APP-EPG

The contract can reference filters describing the traffic that is permitted.

This allows the policy to express both:

  • Who may communicate

  • What traffic is allowed

2.8 Filters and Least Privilege

A filter defines traffic characteristics such as protocol and ports.

For example:

TCP/443

or:

TCP/5432

The security model can therefore become:

Group

→ Contract

→ Filter

→ Permitted traffic

This is more meaningful than simply allowing an entire subnet to communicate.

2.9 EPGs, Contracts and the Security Boundary

The relationship between the endpoint group and contract becomes the security boundary.

For example:

WEB-EPG

can communicate with:

APP-EPG

because a contract exists.

However:

WEB-EPG

cannot directly communicate with:

DB-EPG

unless an appropriate policy relationship exists.

This creates an explicit application communication model.

2.10 Endpoint Security Groups

Endpoint Security Groups, or ESGs, provide an additional security-oriented abstraction within ACI.

They allow security classification to be separated from some of the forwarding relationships that historically constrained EPG-based designs.

This can provide greater flexibility when applying security policy across workloads.

The important concept is:

Security classification does not always have to map directly to a traditional network segment.

This becomes increasingly valuable in environments containing dynamic workloads.

2.11 Micro-Segmentation Across Distributed Workloads

Micro-segmentation becomes particularly useful when workloads that appear similar from a network perspective require different security treatment.

For example:

Production APP

and

Development APP

may share infrastructure but should not necessarily share identical security policy.

Similarly:

Windows workloads

and

Linux workloads

may require different treatment during a security incident.

Micro-segmentation provides additional classification mechanisms that can support these requirements.

2.12 L4–L7 Security Service Integration

Segmentation determines whether communication should occur.

Sometimes that is not enough.

A security architecture may also require:

  • Firewall inspection

  • IPS

  • Load balancing

  • Application security

  • Other L4–L7 services

This introduces a second question:

If the traffic is permitted, does it also require deeper inspection?

That distinction becomes the focus of Section 3.

2.13 Cloud Security Perimeters

Segmentation is not limited to the physical data center.

Cloud environments require similar principles.

For example, Google Cloud VPC Service Controls can establish security perimeters around supported cloud resources to help reduce the risk of unauthorised data movement.

The important principle is that cloud security boundaries should complement:

  • IAM

  • Network controls

  • Workload identity

  • Logging

  • Application security

No single cloud perimeter replaces identity or application-level authorisation.

2.14 Cloud Edge Protection

Cloud environments may also require edge protection.

Cloud security services can provide capabilities such as:

  • DDoS protection

  • WAF

  • Security policy

  • Threat detection

  • Edge traffic controls

These controls protect applications before traffic reaches the workload environment.

2.15 Hybrid Security

Hybrid architectures may contain:

Data center

↓

Cloud connectivity

↓

Cloud VPC

↓

Managed services

↓

Internet-facing applications

The security model therefore has to remain consistent across these boundaries.

Security policy should identify:

  • Which workloads communicate

  • Which services are exposed

  • Which identities are trusted

  • Which traffic is permitted

  • Where deeper inspection is required

2.16 Private Service Connectivity

Private connectivity mechanisms such as Private Service Connect can provide private access to supported services without requiring workloads to use public IP paths for that service relationship.

However, private connectivity should not be confused with authorisation.

A private connection answers:

How does the traffic reach the service?

Security policy still needs to answer:

Is this workload authorised to use the service?

Connectivity and authorisation are separate security concerns.

2.17 Traditional ACL-Based Security

Traditional ACLs remain useful.

They are particularly appropriate for:

  • Infrastructure filtering

  • Management-plane protection

  • Simple protocol restrictions

  • Layer 2 controls

  • Specific interface requirements

The problem occurs when ACLs become the only mechanism used to represent complex application security.

At that point, the configuration can become difficult to understand and maintain.

2.18 MAC ACLs

MAC-based filtering can be useful for Layer 2 security requirements.

It can control traffic based on source or destination MAC information.

This is a more granular mechanism than simply trusting an entire VLAN, but it remains a relatively low-level security control.

2.19 VLAN ACLs

VLAN-based access controls can provide filtering for traffic associated with particular VLANs.

They remain useful for specific infrastructure requirements, but they do not provide the same application-centric abstraction as workload groups and contracts.

2.20 Policy as a Layered Enforcement Model

A mature security architecture can therefore combine:

Traditional ACLs

  •  

EPGs

  •  

ESGs

  •  

Contracts

  •  

Filters

  •  

Micro-segmentation

  •  

L4–L7 services

The controls are complementary.

The objective is not to eliminate traditional networking controls.

The objective is to place each control at the appropriate architectural layer.

2.21 Engineering Design Principles

A modern segmentation architecture should follow several principles.

Start with communication requirements

Determine which workloads actually need to communicate.

Apply least privilege

Permit only the protocols and services required.

Minimise security zones

Avoid unnecessarily large trust boundaries.

Make policy application-centric

Express policy in terms of workloads and application relationships where possible.

Separate segmentation from deep inspection

A communication relationship being permitted does not mean that the traffic requires no further inspection.

Design for mobility

Policy should remain meaningful as workloads move.

Build quarantine capability

Compromised workloads should be capable of being isolated.

2.22 The Result: Policy-Driven Segmentation

The traditional security model can be represented as:

Interface → ACL → IP address → Rule

The application-centric model becomes:

Workload → Group → Contract → Filter → Enforcement

This allows the security architecture to follow the workload rather than simply following the physical topology.

The key engineering question becomes:

Who should communicate, what should they communicate with, and which traffic is actually required?

Once that policy has been established, the next challenge is enforcing it and introducing deeper inspection where necessary.

ENGINEERING LAB · MICRO-SEGMENTATION
Build the Security Policy
Select the workload relationship, application context and security controls. The policy engine evaluates the resulting communication and explains why traffic should be allowed, denied, inspected or quarantined.
Policy Builder
Construct communication intent
Source Workload
WEB-01
EPG: WEB
Role: Front-End
→
Destination Workload
APP-01
EPG: APP
Role: Application Tier
APP-WEB-CONTRACT
ACTIVE
Source classification WEB EPG
Application relationship HTTPS
Security context Trusted
Enforcement Permit
Policy Engine Decision
ALLOW
Expected WEB → APP HTTPS communication matches the security policy.
Risk Score 18 / 100
Decision Evidence
Source Group WEB
Destination APP
Application HTTPS
Identity Web Role
Context Trusted
Policy Path

The communication is evaluated against identity, segmentation, application relationship and risk before the final action is applied.

IDENTITY
→
SEGMENT
→
CONTRACT
→
RISK
→
DECISION
Security policy has detected a communication pattern that does not match the expected workload relationship.
Engineering Principle

Micro-segmentation is not simply creating more VLANs. The objective is to express which workloads may communicate, under which conditions, and with which security controls.

Data Center Security with Cisco ACI

SECTION 03 · ENFORCEMENT & INSPECTION
Engineering Guide
Data Center Security with Cisco ACI
From Security Policy to Distributed Enforcement

Once security relationships have been defined, the next engineering challenge is enforcement. Cisco ACI provides a policy-driven fabric model for segmentation and communication control, while dedicated security services can provide deeper inspection where required.

01 · CLASSIFY
Endpoint Groups
Represent workloads according to application and security role.
02 · AUTHORISE
Contracts
Define which communication relationships are permitted.
03 · ENFORCE
Fabric Policy
Apply distributed policy close to the relevant endpoints.
04 · INSPECT
Security Services
Steer selected traffic through firewalls or inspection services.
What You Will Learn

How EPGs, contracts, filters, micro-segmentation, uSeg/µEPG concepts and service graphs can be combined to enforce application-aware security policy.

Engineering Focus

ACI segmentation should not be treated as a replacement for every security appliance. Use the fabric for segmentation and policy enforcement, and dedicated security services when deeper inspection is required.

Engineering Question
Which traffic should be controlled directly by the fabric, and which traffic should be deliberately redirected through a firewall, IDS/IPS or other L4–L7 security service?

3. Data Center Security with Cisco ACI

Cisco ACI provides a policy-driven framework for implementing segmentation and security enforcement across the data center fabric.

Sections 1 and 2 established the architecture and policy model.

This section moves to the next question:

How is that policy actually enforced, and when do we need deeper security inspection?

ACI can enforce communication relationships between groups of endpoints through constructs such as EPGs, ESGs, contracts, and filters.

However, segmentation and policy enforcement should not be confused with complete deep-packet or application security inspection.

A modern architecture can therefore combine:

Workload identity → Segmentation → Contract → Filter → Traffic steering → Security service → Application

3.1 Application-Centric Security

Traditional security often begins with the physical or logical location of a device.

Application-centric security begins with the workload.

Instead of asking:

Which VLAN is this server connected to?

we ask:

What workload is this, what application does it belong to, and what should it communicate with?

ACI allows these application relationships to become part of the infrastructure policy model.

3.2 The ACI Allowlist Model

ACI uses an allowlist-oriented policy model.

Communication between endpoint groups requires appropriate policy.

For example:

WEB → APP

Allowed:

TCP/443

The existence of a policy relationship does not mean that all traffic between the workloads should be permitted.

Filters can restrict the relationship to the services actually required.

This supports least-privilege communication.

3.3 Segmentation Is Not a Next-Generation Firewall

This distinction is important.

ACI provides distributed policy enforcement inside the fabric.

It can determine:

  • Which endpoint groups are communicating

  • Whether a policy relationship exists

  • Which traffic is permitted

  • Which protocols and ports are allowed

However, deeper security functions may require dedicated services.

These can include:

  • Next-generation firewalls

  • IPS

  • Application security

  • Load balancers

  • Other L4–L7 services

Therefore:

ACI segmentation ≠ complete security inspection

Instead:

ACI segmentation + security services = layered enforcement

3.4 Contracts as Enforcement Policy

A contract establishes the policy relationship between endpoint groups.

For example:

APP-EPG

↓

APP-TO-DB

↓

DB-EPG

The contract can reference filters that define the permitted traffic.

This separates:

Relationship

from

Traffic definition

The policy therefore becomes easier to understand and reuse.

3.5 The Challenge with Static ACLs

Traditional ACLs can become increasingly complex as applications grow.

Rules may contain:

  • Source addresses

  • Destination addresses

  • Protocols

  • Ports

  • Interfaces

  • Exceptions

  • Temporary rules

As the environment changes, administrators may add additional rules without removing old ones.

This creates policy accumulation.

Over time, the ACL may still function but become difficult to understand.

A security policy that cannot be easily understood is difficult to audit and maintain.

3.6 Topology-Independent Policy

One of the important advantages of an application-centric policy model is that security relationships are not permanently tied to individual interfaces.

The conceptual model becomes:

Endpoint → Group → Policy → Contract → Filter

rather than:

Interface → ACL → Address → Rule

This allows policy to remain meaningful as workloads move within the fabric.

3.7 Micro-Segmentation

Large security zones can create excessive trust.

If hundreds of workloads share the same broad security boundary, compromise of one workload can provide an attacker with opportunities for lateral movement.

Micro-segmentation reduces these trust relationships.

Instead of:

Production → Production

we can define:

WEB → APP

APP → DB

MONITORING → WORKLOAD

BACKUP → STORAGE

3.8 EPGs and ESGs

EPGs provide a fundamental mechanism for grouping endpoints and applying common policy.

ESGs provide an additional security-oriented abstraction that can offer greater flexibility when classifying workloads for security policy.

The important engineering principle is that security classification does not always need to map directly onto a single traditional network segment.

3.9 Micro-Segmentation with Additional Endpoint Attributes

ACI micro-segmentation capabilities can provide more granular classification of endpoints.

This can be useful when workloads inside the same broader application environment require different security treatment.

For example:

Production APP

and

Development APP

may require different security policies.

Similarly:

Windows workloads

and

Linux workloads

may require different treatment during an incident.

3.10 Example: Workload Quarantine

Imagine an application environment containing both Windows and Linux workloads.

A security team identifies a vulnerability affecting the Windows workload population.

Instead of manually modifying policies for every individual host, the affected workloads can be classified into a more restrictive security policy where the architecture supports the required classification.

The resulting model is:

Normal workload

↓

Normal application policy

After compromise:

Affected workload

↓

Restricted communication

↓

Security / remediation services

This demonstrates an important security principle:

Containment should reduce the blast radius without requiring the entire application architecture to be redesigned.

3.11 L4–L7 Security Services

Segmentation determines whether communication should occur.

Deep inspection determines whether permitted traffic is safe or appropriate according to additional security criteria.

Potential security services include:

  • Firewalls

  • IPS

  • Load balancers

  • Application security platforms

  • Other L4–L7 services

This introduces the next layer of the architecture.

3.12 Cisco Secure Firewall Integration

Cisco security platforms can be integrated into ACI-based architectures where deeper inspection is required.

A dedicated firewall can provide capabilities beyond distributed fabric policy, depending on the platform and deployment.

These may include:

  • Stateful firewalling

  • Intrusion prevention

  • Threat inspection

  • Application-aware security

  • VPN services

  • Security logging

The architectural principle is:

ACI determines which traffic requires additional policy enforcement.

The security service performs the deeper inspection.

3.13 Policy-Based Redirect

Policy-based redirect provides a mechanism for steering selected traffic towards a service node.

Conceptually:

WEB → APP

Normal flow:

WEB → APP

Traffic requiring inspection:

WEB → Firewall → APP

This means that not every communication flow necessarily has to traverse the same security appliance.

Inspection can be applied according to application and security policy.

3.14 ACI L4–L7 Services

ACI can integrate Layer 4–Layer 7 services into the application policy model.

Potential services include:

  • Firewalls

  • IPS

  • Load balancers

  • Application delivery services

  • Other supported security appliances

This allows security functions to become part of the traffic-processing architecture.

3.15 Service Graphs

A service graph represents a logical processing path through integrated services.

For example:

Consumer

↓

Firewall

↓

IPS

↓

Load Balancer

↓

Provider

Each service can perform a different function.

The graph therefore describes the intended service chain rather than simply representing a physical sequence of network devices.

3.16 Selective Traffic Inspection

Not every flow necessarily requires the same level of inspection.

For example:

TrafficSecurity approach
WEB → APPApplication-aware inspection
APP → DBRestricted database traffic
Monitoring → WorkloadPermit required telemetry
Backup → StoragePermit approved backup services
Unknown → ProductionDeny
Quarantined → ApplicationRestrict

Inspection should therefore be based on:

  • Application requirements

  • Security risk

  • Performance

  • Capacity

  • Compliance

  • Operational requirements

3.17 Distributed Enforcement and Centralised Policy

ACI combines:

Centralised policy definition

with:

Distributed enforcement

This allows policy to be centrally managed while enforcement occurs within the fabric.

Dedicated L4–L7 services can then provide deeper inspection where required.

The architecture becomes:

APIC

↓

Policy

↓

ACI Fabric

↓

Distributed enforcement

↓

L4–L7 Security Services

↓

Inspection

This separation makes the overall security architecture easier to reason about.

3.18 Security Enforcement as a Layered Model

A complete enforcement architecture can therefore be represented as:

Endpoint classification

↓

Segmentation

↓

Contract

↓

Filter

↓

Traffic steering

↓

Deep inspection

↓

Telemetry

Each layer answers a different question.

LayerQuestion
EndpointWhat is communicating?
GroupWhat security class does it belong to?
ContractAre these groups allowed to communicate?
FilterWhich traffic is permitted?
RedirectDoes the flow require a service?
InspectionDoes deeper security analysis occur?
TelemetryWhat actually happened?

3.19 Example: Web Application Security

Consider:

WEB → APP → DB

The security policy may be:

WEB → APP

TCP/443 permitted.

APP → DB

Only required database traffic permitted.

WEB → DB

No direct communication.

Management → Workloads

Restricted to approved management systems.

Unknown → Production

Denied.

Selected application traffic can then be steered through appropriate security services.

3.20 Security Enforcement and Lateral Movement

Suppose an attacker compromises a web server.

Without effective segmentation:

WEB

↓

APP

↓

DB

↓

Management

↓

Backup

The attacker may have multiple paths to additional systems.

With application-centric segmentation:

WEB

↓

APP

↓

Policy boundary

↓

DB

Each relationship becomes another security decision.

If the workload is later identified as compromised, its policy can be restricted further.

3.21 Enforcement as Part of a Feedback Loop

Security enforcement should not operate independently of visibility.

A policy may state:

WEB can communicate with APP using TCP/443.

Telemetry may later show:

WEB has started communicating with unexpected destinations.

That behaviour becomes a security signal.

The architecture can then move towards:

Observe → Analyse → Restrict → Investigate

This connects directly with Section 4.

3.22 Engineering Design Principles

A modern enforcement architecture should:

  • Start with application relationships

  • Use least privilege

  • Separate segmentation from deep inspection

  • Use micro-segmentation where required

  • Steer appropriate traffic through security services

  • Avoid unnecessary inspection paths

  • Design for workload mobility

  • Provide quarantine capability

  • Collect telemetry from enforcement points

3.23 The Result: Policy-Driven Enforcement

The traditional model is:

Interface → ACL → Address → Rule

The application-centric model becomes:

Workload → Group → Contract → Filter → Service → Inspection

The network fabric enforces the communication relationship.

Dedicated security services provide deeper inspection.

Telemetry validates what actually occurred.

The result is a layered security architecture in which each technology performs a specific role.

ENGINEERING SIMULATOR · CISCO ACI · L4–L7 SERVICES
Trace Traffic Through a Service Graph
Select the services required by the security architecture, then step the application flow through the ACI fabric. The simulator shows where policy-based redirection inserts inspection services into the forwarding path.
Traffic Service Path
Stage 1 of 7
W
WEB
Source Workload
A
ACI FABRIC
Policy / Fabric
F
FIREWALL
Security Service
I
IDS / IPS
Inspection
L
LOAD BALANCER
L4–L7 Service
A
APP
Destination
Policy-Based Redirect: selected traffic can be classified by policy and redirected through an appropriate service node rather than requiring every traffic flow to traverse the same security appliance.
Service Controls
Click / tap to change
Security Contract
Permit the application relationship
Policy Redirect
Steer matching traffic into services
Firewall
Stateful security inspection
IDS / IPS
Threat detection / prevention
Load Balancer
Application delivery function
Forwarding Decision
FORWARD
WEB traffic is entering the ACI fabric and the selected service chain will determine its next hop.
Live Readout
Source WEB-01
Destination APP-01
Protocol HTTPS / 443
Current Node WEB
Next Function ACI Fabric
Service Chain Timeline
Packet execution
WEB workload generates HTTPS request
ACI policy classifies the traffic
Policy-based redirect selects service path
Firewall inspection
IDS / IPS inspection
Load-balancing function
APP workload receives traffic
Engineering Principle

ACI provides policy-driven traffic classification and can steer selected flows toward integrated L4–L7 services. The fabric's segmentation policy and dedicated inspection functions solve different security problems.

Inspection has been removed from the selected path. The traffic can still be forwarded when policy permits it, but the security architecture has lost a layer of inspection.

Visibility, Detection and Adaptive Defence

SECTION 04 · VISIBILITY & RESPONSE
Engineering Guide
Visibility, Detection, Response and Adaptive Defense
Detect the Anomaly, Decide the Risk, Contain the Threat

Segmentation and enforcement reduce the available attack surface, but security does not end when a policy is deployed. Modern data centers also need continuous visibility, correlated evidence, incident investigation and a controlled path from detection to containment and recovery.

01 · OBSERVE
Collect Evidence
Flow, endpoint, identity, application and security telemetry.
02 · DETECT
Correlate Signals
Identify unusual behaviour and changes from the expected baseline.
03 · RESPOND
Contain Risk
Block, isolate or quarantine affected workloads when justified.
04 · RECOVER
Validate & Restore
Remediate, restore services and verify the security boundary.
What You Will Learn

How flow telemetry, packet visibility, SIEM/SOAR, EDR/XDR, identity context and behavioural analysis can be combined to investigate east-west security events.

Engineering Focus

The objective is not simply to generate more alerts. It is to build a measurable control loop where evidence leads to a decision, the decision drives enforcement, and the result is verified.

Engineering Question
When a normally trusted workload suddenly communicates with an unexpected system, how quickly can the environment detect the change, determine its significance and contain the risk?

4. Visibility, Detection and Adaptive Defence

Sections 1–3 established the security architecture:

Security architecture → segmentation → policy → enforcement → inspection

However, preventative controls alone are not enough.

A policy can define what should happen.

Telemetry tells us what actually happened.

A firewall may permit a connection.

A workload may still behave abnormally.

A correctly segmented server may still become compromised.

Modern data center security therefore requires a continuous feedback loop:

Observe → Analyse → Detect → Investigate → Respond → Validate

4.1 From Security Policy to Security Observability

Consider a simple policy:

WEB → APP

Allowed:

TCP/443

From a policy perspective, the relationship is correct.

But telemetry might reveal:

  • A sudden increase in connections

  • Unexpected traffic volumes

  • Repeated failed connections

  • Communication with previously unused endpoints

  • Unusual connection timing

  • Unexpected external destinations

  • A workload communicating outside its normal application relationship

The policy has not necessarily changed.

The behaviour has changed.

This is why security architecture requires both policy enforcement and continuous observation.

4.2 The Security Telemetry Pipeline

A modern environment can generate telemetry from many layers:

Workload

↓

Network flow

↓

Packet / protocol

↓

Identity

↓

Application

↓

Infrastructure

↓

Security platform

↓

Analytics

No single telemetry source provides the complete picture.

4.3 Network Flow Visibility

Flow telemetry such as NetFlow and IPFIX can provide information about communication patterns including:

  • Source

  • Destination

  • Protocol

  • Ports

  • Volume

  • Packet counts

  • Timing

  • Direction

For example:

APP-01 → DB-01

TCP/5432

Normal

versus:

APP-01 → DB-17

TCP/5432

Unexpected

The second event may become a security investigation even if the network technically permits the traffic.

4.4 Packet-Level Visibility

Flow telemetry tells us that communication occurred.

Packet-level analysis can provide additional information about the communication itself.

Depending on the deployment, packet analysis can help identify:

  • Protocol behaviour

  • Application exchanges

  • Suspicious traffic patterns

  • Malformed packets

  • Unexpected protocols

  • Attack indicators

  • Session behaviour

Packet capture is particularly useful during incident investigation.

4.5 Identity-Aware Security

Network addresses are not sufficient security identities.

An IP address can represent one workload today and another tomorrow.

Modern environments therefore associate network activity with additional context.

Useful information can include:

  • User identity

  • Workload identity

  • Device identity

  • Application identity

  • Namespace

  • Kubernetes service

  • VM identity

  • Cloud resource identity

  • Security group

  • Endpoint classification

This allows security teams to move from:

10.10.20.15 connected to 10.10.30.20

towards:

Production application APP-01 attempted to access database service DB-01.

The second statement provides substantially more useful security context.

4.6 Security Analytics

Telemetry becomes more valuable when it is correlated.

Consider:

Event 1

Authentication succeeded.

Event 2

The user accessed a server.

Event 3

The server established a new outbound connection.

Event 4

The workload contacted an unusual destination.

Event 5

Traffic volume increased dramatically.

Each event might be harmless in isolation.

Together they may describe a potential compromise.

Security analytics attempts to identify these relationships.

The objective is to move from:

Thousands of independent events

to:

A smaller number of meaningful security stories.

4.7 Behavioural Baselines

Security systems need to understand normal behaviour.

An application server may normally:

  • Communicate with three application services

  • Use HTTPS

  • Connect to a known database

  • Generate predictable traffic

  • Operate continuously

  • Use known DNS services

This creates a behavioural baseline.

If the same workload suddenly:

  • Scans hundreds of hosts

  • Attempts SSH connections

  • Contacts an unfamiliar external service

  • Generates significantly more traffic

  • Attempts unexpected database access

the behaviour becomes anomalous.

An anomaly does not automatically mean compromise.

It means:

The workload’s behaviour requires investigation.

4.8 Detecting Lateral Movement

Lateral movement occurs when an attacker attempts to move from an initial compromised workload to additional systems.

A simplified attack path is:

Initial compromise

↓

Credential acquisition

↓

Discovery

↓

Service enumeration

↓

Additional connections

↓

Second workload

Segmentation can reduce these paths.

Telemetry can reveal them.

Analytics can correlate them.

Response mechanisms can attempt to contain them.

The resulting model is:

Prevent → Detect → Contain

4.9 East-West Traffic Analytics

Modern applications generate significant east-west traffic.

Examples include:

WEB → APP

APP → DB

APP → CACHE

SERVICE → SERVICE

MONITORING → WORKLOAD

Security analytics can model these relationships.

Normal:

APP-01 → DB-01

Abnormal:

APP-01 → DB-01

APP-01 → DB-02

APP-01 → DB-03

APP-01 → hundreds of hosts

The final pattern could indicate:

  • Scanning

  • Discovery

  • Malware propagation

  • Misconfiguration

  • Legitimate operational activity

Context determines the conclusion.

4.10 Security Graphs

A useful way to understand modern security is as a graph.

Nodes represent:

  • Users

  • Workloads

  • Applications

  • Databases

  • Services

  • Devices

  • Security systems

Edges represent:

  • Network communication

  • Authentication

  • Application dependencies

  • Policy relationships

  • Administrative access

This model can answer questions such as:

Which systems can this compromised workload reach?

or:

Which applications depend on this database?

or:

Which systems would be affected if this workload were quarantined?

Security therefore becomes a relationship-analysis problem rather than simply a log-analysis problem.

4.11 SIEM Integration

A SIEM can aggregate security events from multiple systems.

Potential sources include:

  • Firewalls

  • IDS/IPS

  • Network infrastructure

  • Servers

  • Identity platforms

  • Cloud platforms

  • Kubernetes

  • Endpoint security

  • Applications

The SIEM can provide:

  • Search

  • Correlation

  • Alerting

  • Investigation

  • Historical analysis

  • Reporting

The SIEM does not replace the underlying security controls.

It provides a central analytical layer.

4.12 SOAR and Automated Response

Detection becomes more valuable when it can trigger an appropriate response.

A response workflow might be:

High-risk alert

↓

Verify evidence

↓

Identify workload

↓

Check identity

↓

Review communications

↓

Apply containment

↓

Notify security team

↓

Record incident

Possible actions include:

  • Isolating a workload

  • Restricting communication

  • Disabling an identity

  • Blocking a destination

  • Increasing inspection

  • Opening an incident

  • Collecting forensic evidence

Automation must be carefully controlled.

A false positive that automatically isolates a critical production system can itself create an operational incident.

4.13 Dynamic Segmentation

Security state can change over time.

A workload that is healthy at 09:00 may become suspicious at 09:15.

The security architecture should therefore be capable of changing its posture.

4.14 Risk-Based Enforcement

A useful model is:

RiskExampleResponse
LowNormal behaviourAllow
MediumUnusual destinationMonitor
HighRepeated scanningRestrict
CriticalConfirmed compromise indicatorsQuarantine

This introduces a more flexible model than simply:

Allow / Deny

Security becomes increasingly risk-aware.

4.15 Identity, Device and Workload Context

Risk decisions become more useful when multiple dimensions are considered.

A security system can evaluate:

Identity

Who is requesting access?

Device

Is the device trusted and compliant?

Workload

Which application is generating the traffic?

Network

Where is the communication occurring?

Behaviour

Is the activity normal?

Threat intelligence

Is the destination or behaviour associated with known threats?

This creates contextual security decisions.

4.16 Continuous Verification

Authentication should not be treated as permanent trust.

An entity may initially be trusted and later become risky.

Security can therefore continuously evaluate:

  • Identity

  • Context

  • Policy

  • Behaviour

  • Device posture

  • Risk

This creates a feedback loop rather than a one-time access decision.

4.17 Threat Intelligence

Threat intelligence can add external context to security analysis.

Examples include intelligence relating to:

  • Malware infrastructure

  • Command-and-control systems

  • Phishing

  • Suspicious domains

  • Known malicious addresses

Threat intelligence becomes more valuable when combined with internal evidence.

For example:

Threat intelligence

  •  

DNS activity

  •  

Network flow

  •  

Endpoint telemetry

  •  

Identity context

can create a much stronger security signal.

4.18 Cloud Security Visibility

Cloud environments introduce additional security telemetry.

Security platforms can provide visibility into:

  • Resources

  • Identities

  • Configuration

  • Network exposure

  • Policy violations

  • Threat findings

  • Vulnerabilities

Hybrid environments are particularly challenging because a workload may communicate across:

Data Center

↓

Cloud VPC

↓

Managed service

↓

Internet-facing API

Network telemetry alone may not provide sufficient context.

Cloud security telemetry therefore needs to become part of the broader security architecture.

4.19 Kubernetes and Container Security

Containerised environments introduce additional security dimensions:

  • Namespace

  • Pod

  • Service

  • Service account

  • Network policy

  • Container image

  • Runtime behaviour

  • Cluster identity

A workload may therefore be represented as:

User

↓

Kubernetes workload

↓

Service

↓

Pod

↓

Container

↓

Network destination

Traditional IP-based monitoring alone can lose important application context because containers are often short-lived and addresses can change.

4.20 Runtime Security

Network controls cannot explain everything happening inside a workload.

Runtime security can provide visibility into:

  • Unexpected processes

  • File access

  • Privilege changes

  • Suspicious system calls

  • Unexpected network connections

  • Container escape indicators

  • Abnormal process behaviour

This complements network telemetry.

The resulting evidence becomes:

Network behaviour

  •  

Identity

  •  

Application behaviour

  •  

Runtime behaviour

4.21 Detection Engineering

Security detection should be engineered rather than simply enabled.

A detection might begin with:

Can we detect a production workload scanning a large number of internal hosts?

The engineering process becomes:

Define expected behaviour

↓

Identify telemetry

↓

Create detection logic

↓

Test against normal traffic

↓

Test against simulated abnormal behaviour

↓

Measure false positives

↓

Tune

↓

Deploy

↓

Monitor

This turns security analytics into an engineering discipline.

4.22 Measuring Security Effectiveness

Security should be measurable.

Useful questions include:

Coverage

Can we see the important workloads?

Policy coverage

Are critical workloads protected by appropriate segmentation?

Detection coverage

Can important attack behaviours be detected?

Response time

How quickly can a security event be investigated?

Containment time

How quickly can a compromised workload be isolated?

False positives

How many alerts require no action?

Recovery

How quickly can the affected service return to normal?

4.23 Incident Investigation Workflow

A repeatable investigation process can be:

1. Identify

Which workload, identity, or device generated the event?

2. Establish baseline

What normally happens?

3. Identify deviation

What changed?

4. Determine scope

What else communicated with the affected workload?

5. Determine impact

What systems or data may be affected?

6. Contain

Can the workload be isolated?

7. Investigate

What evidence explains the event?

8. Remediate

Remove the underlying cause.

9. Validate

Confirm that the environment has returned to an expected state.

10. Improve

Update policy, detection, architecture, or operational processes.

4.24 Example: Compromised Application Server

Consider the application architecture developed throughout this guide:

WEB → APP → DB

APP-01 normally communicates with:

  • WEB services

  • DB services

  • Monitoring

  • Approved infrastructure services

Security analytics detects that APP-01 has started scanning internal hosts.

The investigation identifies:

APP-01 → DB-01

Normal

APP-01 → Monitoring

Normal

APP-01 → Hundreds of internal addresses

Abnormal

The security team correlates:

  • Network flow

  • Endpoint telemetry

  • Authentication activity

  • DNS activity

  • Firewall events

The combined evidence increases the risk score.

The response becomes:

APP-01

↓

High-risk state

↓

Restricted policy

↓

Security investigation

If compromise is confirmed:

APP-01

↓

Quarantine

↓

Remediation

The complete lifecycle is now:

Prevent → Observe → Detect → Investigate → Contain → Recover

4.25 Adaptive Security

The final evolution is adaptive security.

Instead of treating policy as permanently static, the architecture can respond to changing conditions.

Normal

Risk = Low

Standard application policy.

Suspicious

Risk = Medium

Additional monitoring and inspection.

High Risk

Risk = High

Restrict communication.

Compromised

Risk = Critical

Quarantine workload.

This does not mean every decision should be automated.

It means the architecture has mechanisms capable of changing security posture when evidence justifies it.

4.26 The Complete Data Center Security Architecture

The four sections can now be combined.

Layer 1 — Security Architecture

Physical, network, compute, storage, application, cloud and identity controls.

↓

Layer 2 — Segmentation and Policy

EPGs, ESGs, contracts, filters and micro-segmentation.

↓

Layer 3 — Enforcement and Inspection

Distributed enforcement, policy-based redirect, service graphs, firewalls, IPS and other L4–L7 services.

↓

Layer 4 — Visibility and Adaptive Defence

Flow telemetry, packet visibility, identity, analytics, SIEM, detection, response and dynamic containment.

The complete architecture becomes:

Workload

↓

Identity / Classification

↓

Segmentation

↓

Policy

↓

Enforcement

↓

Inspection

↓

Telemetry

↓

Analytics

↓

Risk

↓

Response

↓

Policy adjustment

This is the modern data center security feedback loop.

4.27 Engineering Principles

A mature security architecture should:

  • Know the workload

  • Minimise trust

  • Enforce least privilege

  • Inspect according to risk

  • Observe continuously

  • Correlate context

  • Detect behaviour

  • Prepare containment

  • Automate carefully

  • Measure effectiveness

4.28 Final Engineering Perspective

Modern data center security is no longer a single firewall positioned at the network perimeter.

Applications are distributed.

Workloads move.

Users and services are increasingly identity-driven.

Cloud and on-premises infrastructure coexist.

East-west communication can be as important as north-south traffic.

Security must therefore become an architectural capability rather than a single appliance.

The model developed throughout this guide is:

Understand the workload

↓

Define its security relationships

↓

Segment the environment

↓

Enforce least privilege

↓

Inspect higher-risk traffic

↓

Observe actual behaviour

↓

Detect deviations

↓

Respond to changing risk

↓

Continuously improve policy

The objective is not simply to prevent every possible connection.

It is to create an environment where:

Required communication is explicitly permitted, unnecessary communication is restricted, abnormal behaviour is visible, and compromised workloads can be contained before they become a larger incident.

That is the foundation of a modern, policy-driven data center security architecture.

INCIDENT LAB · LATERAL MOVEMENT · RESPONSE
Investigate a Compromised Workload
Follow a realistic east-west security incident from normal application traffic through anomaly detection, risk escalation, policy enforcement and workload quarantine.
East-West Traffic Investigation
Stage 1 of 8
W
WEB-01
Front-End
Expected Role
A
APP-01
Application Tier
Expected Target
D
DB-01
Database Tier
Restricted Target
Incident Scenario
WEB-01 normally communicates with APP-01 over HTTPS. The investigation begins with an expected application flow.
Current Risk Score
18
LOW · Expected workload behaviour
Investigation Evidence
Source WEB-01
Destination APP-01
Protocol HTTPS / 443
Identity Web Role
Behaviour Expected
Incident Timeline
Detection → Response
T+00:00 Normal WEB → APP traffic
T+00:18 New east-west behaviour observed
T+00:24 WEB → DB connection attempted
T+00:27 Identity / behaviour mismatch detected
T+00:31 Risk score crosses investigation threshold
T+00:34 Security policy blocks lateral movement
T+00:38 Incident response initiated
T+00:42 WEB-01 quarantined
Analyst Investigation

Begin with the baseline. WEB-01 has an expected role and is communicating with APP-01 over HTTPS.

Expected Path
WEB → APP
Observed Path
WEB → APP
Policy State
Normal
Response
Monitor
Security posture: NORMAL — no containment required.
```
☕
Support Network Insight
Help support independent engineering guides, interactive networking tools, and future learning labs.
Support Network Insight ```
SD WAN Overlay

SD WAN Overlay

Modern enterprise WANs rarely depend on a single type of connection. Organisations may combine MPLS, broadband Internet, dedicated connectivity, 4G/5G, and cloud access across a large number of sites. The challenge is no longer simply connecting locations; it is building a WAN that can adapt to changing application requirements while maintaining predictable performance, security, and operational control. SD-WAN addresses this challenge by separating the logical network and its policies from the physical transport services underneath it.

An SD-WAN overlay is a virtual networking layer built across one or more physical WAN transports. Traffic can be encapsulated and carried across different underlying networks while the SD-WAN control plane determines how that traffic should be forwarded. This allows organisations to treat different transport services as components of a broader WAN rather than designing the entire architecture around one physical circuit type.

The distinction between the underlay and overlay is fundamental. The underlay provides the physical or IP connectivity between locations, while the overlay provides logical connectivity, routing, policy, and often encryption across those transports. A broadband connection, MPLS circuit, or 5G connection can therefore form part of the underlay while SD-WAN creates a consistent logical network across them.

One of the major benefits is dynamic path selection. Instead of relying exclusively on static routing decisions, SD-WAN can evaluate characteristics such as latency, packet loss, jitter, link availability, and application requirements when selecting a path. Business-critical traffic can therefore be steered towards an appropriate transport while less sensitive traffic may use another available path.

Scalability is another important advantage. New branches, cloud connections, and WAN transports can be incorporated into the SD-WAN architecture without requiring every location to be designed around a completely different physical network. Centralised policy and orchestration can reduce repetitive configuration and provide greater consistency as the environment expands.

The overlay can also provide an important security boundary. SD-WAN deployments commonly use encrypted tunnels between sites or security enforcement points, protecting traffic as it crosses shared or untrusted transport networks. However, encryption should not be confused with complete security: traffic inside an encrypted tunnel may still require firewalling, segmentation, identity controls, threat inspection, and monitoring.

Application awareness is particularly valuable in modern WAN environments. An organisation may have voice and video traffic, SaaS applications, business-critical databases, cloud workloads, and ordinary Internet traffic sharing the same physical transports. SD-WAN policy can classify traffic and apply different forwarding or quality requirements according to the application’s needs.

Operational visibility is equally important. A functioning SD-WAN overlay should make it possible to understand which paths are being used, how transport conditions are changing, whether tunnels are healthy, and how application performance is affected. Monitoring both the underlay and overlay helps distinguish a physical connectivity problem from a policy, tunnel, routing, or application issue.

The result is a WAN architecture in which physical connectivity becomes the foundation rather than the complete design. The underlay supplies transport, while the SD-WAN overlay provides logical connectivity, policy, traffic steering, encryption, and operational control. This separation gives organisations greater flexibility to combine different connectivity options while adapting the WAN to the requirements of distributed applications and users.

SD WAN Overlay

Highlights: SD WAN Overlay

SD-WAN • Interactive Learning

SD-WAN Overlay Explorer

Explore the difference between the physical WAN underlay and the logical SD-WAN overlay.

LOGICAL OVERLAY Branch A SD-WAN Edge Branch B SD-WAN Edge PHYSICAL TRANSPORTS MPLS Private transport Broadband Internet transport LTE / 5G Wireless transport TRANSPORT ABSTRACTION Multiple physical transports can support one logical WAN Physical WAN below • Logical WAN above
Learning Focus

One logical WAN over many transports

SD-WAN separates the logical WAN service from the physical networks that carry it. The underlay provides connectivity while the overlay provides the logical network between SD-WAN edges.

1. Underlay MPLS, broadband and LTE/5G provide the physical connectivity.
2. Overlay SD-WAN creates logical connectivity across those transports.
3. Independence Applications use the logical WAN without needing to understand the underlying transport.
Core idea: The underlay carries traffic. The overlay defines the logical WAN.

Underlay

The physical connectivity layer. Different WAN transports can coexist underneath the SD-WAN fabric.

Overlay

The logical network created between SD-WAN edges across the available physical connectivity.

Transport Independence

The logical WAN does not have to depend on a single physical transport technology.

SD-WAN principle: separate the logical WAN from the physical WAN.

Understanding Overlay Networking

Overlay networking is a revolutionary approach to network design that enables the creation of virtual networks on top of existing physical networks. By abstracting the underlying infrastructure, overlay networks provide a flexible and scalable solution to meet the dynamic demands of modern applications and services. Whether in cloud environments, data centers, or even across geographically dispersed locations, overlay networking opens up a world of possibilities.

Overlay networks act as a virtual layer on the physical network infrastructure. They enable the creation of logical connections independent of the physical network topology. In the context of SD-WAN, overlay networks facilitate the seamless integration of multiple network connections, including MPLS, broadband, and LTE, into a unified and efficient network.

The advantages of overlay networking are manifold:

– First, it allows for seamless network segmentation, enabling different applications or user groups to operate in isolation while sharing the same physical infrastructure. This enhances security and simplifies network management.

– Secondly, overlay networks facilitate deploying advanced network services such as load balancing, firewalling, and encryption without complex changes to the underlying network infrastructure. This abstraction level empowers organizations to adapt and respond rapidly to evolving business needs.

SD‑WAN Overlay — A Virtual WAN Built on Top of Any Transport

An SD‑WAN overlay is the virtual WAN that SD‑WAN creates on top of whatever physical links an enterprise already has. Instead of relying on a single underlay like MPLS, SD‑WAN builds encrypted tunnels across broadband, fiber, LTE/5G, satellite, or MPLS and treats them as one unified logical network. This overlay is where SD‑WAN applies application‑aware routing, dynamic path selection, QoS, and security policies. It is the “software‑defined” part of SD‑WAN — a virtual fabric that abstracts away the complexity of the physical WAN.

Overlay vs Underlay — Clear Separation of Roles

The underlay is the physical transport: broadband, MPLS, LTE/5G, fiber, satellite.

The overlay is the virtual network SD‑WAN builds on top of these transports.

The overlay provides:

  • encrypted tunnels (IPsec or DTLS) between SD‑WAN edges
  • centralized policy enforcement
  • application‑aware routing
  • dynamic failover and load balancing
  • unified QoS across all links

This separation allows SD‑WAN to steer traffic based on real‑time link health (latency, jitter, packet loss) rather than static routing.

Encrypted Tunnels — The Foundation of the Overlay

SD‑WAN overlays are built using encrypted tunnels that run across any IP‑based transport. These tunnels:

  • secure traffic regardless of the underlying link
  • allow consistent routing and segmentation
  • enable full‑mesh or hub‑and‑spoke topologies
  • carry application‑aware metadata for steering decisions

The overlay hides the complexity of the underlay, making broadband or LTE behave like enterprise‑grade WAN circuits.

Dynamic Path Selection — Real‑Time Steering Inside the Overlay

Inside the overlay, SD‑WAN edges continuously measure link performance and steer traffic accordingly. This includes:

  • selecting the best path per application
  • automatic failover when a link degrades
  • load distribution across multiple transports
  • tunnel bonding or packet duplication for critical apps

This dynamic steering is what makes the overlay “intelligent,” ensuring optimal performance for SaaS, VoIP, ERP, and cloud workloads.

Overlay Topologies — Hub‑and‑Spoke, Full‑Mesh, Hybrid

SD‑WAN overlays support multiple topologies depending on business needs:

  • Hub‑and‑spoke — simple, centralized breakout
  • Full‑mesh — direct site‑to‑site tunnels for low‑latency east‑west traffic
  • Hybrid — MPLS for critical apps + broadband/LTE for best‑effort or cloud access

These topologies can be changed centrally without touching individual routers, thanks to the overlay’s software‑defined control plane.

Security Inside the Overlay

Many SD‑WAN platforms embed security directly into the overlay, including:

  • segmentation
  • NGFW functions
  • secure internet breakout
  • integration with CASB, SWG, ZTNA, and SSE stacks

This ensures that the overlay is not just a transport mechanism but a secure, policy‑driven fabric.

Why the SD‑WAN Overlay Matters

The overlay is the reason SD‑WAN delivers:

  • better SaaS and cloud performance
  • reduced MPLS dependency
  • simplified operations
  • improved uptime
  • centralized policy control
  • consistent security across all sites

It transforms WAN management from a hardware problem into a software‑defined architecture.

**So, what exactly is an SD-WAN overlay?**

In simple terms, it is a virtual layer added to the existing network infrastructure. These network overlays connect different locations, such as branch offices, data centers, and the cloud, by creating a secure and reliable network.

1. Tunnel-Based Overlays:

One of the most common types of SD-WAN overlays is tunnel-based overlays. This approach encapsulates network traffic within a virtual tunnel, allowing it to traverse multiple networks securely. Tunnel-based overlays are typically implemented using IPsec or GRE (Generic Routing Encapsulation) protocols. They offer enhanced security through encryption and provide a reliable connection between the SD-WAN edge devices.

Example Technology: IPSec and GRE

Organizations can achieve enhanced network security and improved connectivity by combining GRE and IPSec. The integration allows for creating secure tunnels between networks, ensuring that data transmitted between them remains protected from potential threats. This combination also enables the establishment of Virtual Private Networks (VPNs), enabling secure remote access and seamless connectivity for geographically dispersed teams.

By encrypting GRE tunnels, IPsec provides secure VPN tunnels. This approach offers many benefits, including support for dynamic IGP routing protocols, non-IP protocols, and IP multicast. Furthermore, the headend IPsec termination points can support QoS policies and deterministic routing metrics.

There is built-in redundancy due to the pre-established primary and backup GRE over IPsec tunnels. Static IP addresses are required for the headend site, but dynamic IP addresses are permitted for the remote sites. To differentiate primary tunnels from backup tunnels, routing metrics can be modified slightly to favor one or the other.

GRE with IPsec ipsec plus GRE

2. Segment-Based Overlays:

Segment-based overlays are designed to segment the network traffic based on specific criteria such as application type, user group, or location. This allows organizations to prioritize critical applications and allocate network resources accordingly. By segmenting the traffic, SD-WAN can optimize the performance of each application and ensure a consistent user experience. Segment-based overlays are particularly beneficial for businesses with diverse network requirements.

3. Policy-Based Overlays:

Policy-based overlays enable organizations to define rules and policies that govern the behavior of the SD-WAN network. These overlays use intelligent routing algorithms to dynamically select the most optimal path for network traffic based on predefined policies. By leveraging policy-based overlays, businesses can ensure efficient utilization of network resources, minimize latency, and improve overall network performance.

4. Hybrid Overlays:

Hybrid overlays combine the benefits of both public and private networks. This overlay allows organizations to utilize multiple network connections, including MPLS, broadband, and LTE, to create a robust and resilient network infrastructure. Hybrid overlays intelligently route traffic through the most suitable connection based on application requirements, network availability, and cost. Businesses can achieve high availability, cost-effectiveness, and improved application performance by leveraging mixed overlays.

5. Cloud-Enabled Overlays:

As more businesses adopt cloud-based applications and services, seamless connectivity to cloud environments becomes crucial. Cloud-enabled overlays provide direct and secure connectivity between the SD-WAN network and cloud service providers. These overlays ensure optimized performance for cloud applications by minimizing latency and providing efficient data transfer. Cloud-enabled overlays simplify the management and deployment of SD-WAN in multi-cloud environments, making them an ideal choice for businesses embracing cloud technologies.

**Challenge: The traditional network**

The networks we depend on for business are sensitive to many factors that can result in a slow and unreliable experience. Latency, which refers to the time between a data packet being sent and received, or round-trip time, which is the time it takes for the packet to be sent and for it to get a reply, can be experienced.

We can also experience jitter, the variance in the time delay between data packets in the network, which is a “disruption” in the sending and receiving packets. We have fixed-bandwidth networks that can experience congestion. For example, with five people sharing the same Internet link, each could experience a stable and swift network. Add another 20 or 30 people onto the same link, and the experience will be markedly different.

Google Cloud & SD WAN

SD WAN Cloud Hub

Google Cloud is renowned for its robust infrastructure, scalability, and advanced services. By integrating SD-WAN with Google Cloud, businesses can tap into this powerful ecosystem. They gain access to Google’s global network, enabling optimized routing and lower latency. Additionally, the scalability and flexibility of Google Cloud allow organizations to adapt to changing network demands seamlessly.

Key Advantages:

When SD-WAN Cloud Hub is integrated with Google Cloud, it unlocks a host of advantages. Firstly, it enables organizations to seamlessly connect their branch offices, data centers, and cloud resources, providing a unified network fabric. This integration optimizes traffic flow and enhances application performance, ensuring a consistent user experience.

Key Features and Benefits:

Intelligent Traffic Steering: SD-WAN Cloud Hub with Google Cloud allows organizations to intelligently steer traffic based on application requirements, network conditions, and security policies. This dynamic traffic routing ensures optimal performance and minimizes latency.

Simplified Network Management: The centralized management platform of SD-WAN Cloud Hub simplifies network configuration, monitoring, and troubleshooting. Integration with Google Cloud provides a unified view of the entire network infrastructure, streamlining operations and reducing complexity.

Enhanced Security: SD-WAN Cloud Hub leverages Google Cloud’s security features, such as Cloud Armor and Cloud Identity-Aware Proxy, to protect network traffic and ensure secure communication between branches, data centers, and the cloud.

VPN and Overlay technologies

  • Performance-Based Routing & DMVPN 

Performance-based routing is a dynamic routing technique beyond traditional static routing protocols. It leverages real-time data and network monitoring to make intelligent routing decisions based on latency, bandwidth availability, and network congestion. By constantly analyzing network conditions, performance-based routing algorithms can adapt and reroute traffic to the most efficient paths, ensuring speedy and reliable data transmission.

  • DMVPN Phase 3

DMVPN Phase 3 is the latest iteration of the DMVPN technology, designed to address the limitations of its predecessors. It introduces significant improvements in scalability, routing protocol support, and encryption capabilities. By utilizing multipoint GRE tunnels, DMVPN Phase 3 enables efficient and dynamic communication between multiple sites securely and efficiently.

One of DMVPN Phase 3’s key advantages is its scalability. The introduction of the NHRP (Next Hop Resolution Protocol) redirect allows for the dynamic and efficient allocation of network resources, making it an ideal solution for large-scale deployments. Additionally, DMVPN Phase 3 supports a wide range of routing protocols, including OSPF, EIGRP, and BGP, providing network administrators with flexibility and ease of integration.

Multipoint GRE (mGRE) is an underlying technology that plays a crucial role in DMVPN’s functionality. It enables the establishment of multiple tunnels over a single GRE interface, maximizing network resource utilization. Encapsulating packets in GRE headers, mGRE facilitates traffic routing between remote sites, creating a secure and efficient communication path.

Configuring spokes to terminate multiple headends at one or more hub locations can achieve redundancy. Cryptographic attributes are typically mapped to the tunnel initiated by the remote peer through IPsec tunnel protection..

FlexVPN Site-to-Site Smart Defaults

FlexVPN Site-to-Site Smart Defaults is a feature designed to simplify and streamline the configuration process of site-to-site VPN connections. It provides a set of predefined default values for various parameters, eliminating the need for complex manual configurations. Network administrators can save time and effort by leveraging these smart defaults while ensuring robust security.

One key advantage of FlexVPN Site-to-Site Smart Defaults is its ease of use. Network administrators can quickly deploy secure site-to-site VPN connections without extensive knowledge of complex VPN configurations. The predefined defaults ensure that essential security features are automatically enabled, minimizing the risk of misconfigurations and vulnerabilities.

FlexVPN IKEv2 Routing

FlexVPN IKEv2 routing is a robust routing protocol that combines the flexibility of FlexVPN with the security of IKEv2. It allows for dynamic routing between different sites and simplifies the management of complex network infrastructures. By utilizing the power of cryptographic security and advanced routing techniques, FlexVPN IKEv2 routing ensures secure and efficient communication across networks.

FlexVPN IKEv2 routing offers numerous benefits, making it a preferred choice for network administrators. Firstly, it provides enhanced scalability, allowing networks to grow and adapt to changing requirements quickly. Additionally, the protocol ensures end-to-end security by encapsulating data within secure tunnels, protecting it from unauthorized access. Moreover, FlexVPN IKEv2 routing supports multipoint connectivity, enabling seamless communication between multiple sites.

**Transport Fabric Technology**

SD-WAN leverages transport-independent fabric technology to connect remote locations. This is achieved by using overlay technology. The SDWAN overlay works by tunneling traffic over any transport between destinations within the WAN environment.

This gives authentic flexibility to routing applications across any network portion regardless of the circuit or transport type. This is the definition of transport independence. Having a fabric SDWAN overlay network means that every remote site, regardless of physical or logical separation, is always a single hop away from another. DMPVN works based on transport agnostic design.

SD-WAN vs Traditional WAN

SD-WAN overlays offer several advantages over traditional WANs, including improved scalability, reduced complexity, and better control over traffic flows. They also provide better security, as each site is protected by its dedicated security protocols. Additionally, SD-WAN overlays can improve application performance and reliability and reduce latency.

Key Point: SD-WAN abstracts the underlay

With SD-WAN, the virtual WAN overlays are abstracted from the physical device’s underlay. Therefore, the virtual WAN overlays can take on topologies independent of each other without being pinned to the configuration of the underlay network. SD-WAN changes how you map application requirements to the network, allowing for the creation of independent topologies per application.

For example, mission-critical applications may use expensive leased lines, while lower-priority applications can use inexpensive best-effort Internet links. This can all change on the fly if specific performance metrics are unmet.

Previously, the application had to match and “fit” into the network with the legacy WAN, but with an SD-WAN, the application now controls the network topology. Multiple independent topologies per application are a crucial driver for SD-WAN.

Example Technology: PTP GRE

Point to Point GRE, or Generic Routing Encapsulation, is a protocol that encapsulates and transports various network layer protocols over an IP network. Providing a virtual point-to-point link enables secure and efficient communication between remote networks. Point to Point GRE offers a flexible and scalable solution for organizations seeking to establish secure connections over public or private networks.

SD-WAN combines transports, SDWAN overlay, and underlay

Look at it this way. With an SD-WAN topology, there are different levels of networking. There is an underlay network, the physical infrastructure, and an SDWAN overlay network. The physical infrastructure is the router, switches, and WAN transports; the overlay network is the virtual WAN overlays.

The SDWAN overlay presents a different network to the application. For example, the voice overlay will see only the voice overlay. The logical virtual pipe the overlay creates and the application sees differs from the underlay.

An SDWAN overlay network is a virtual or logical network created on top of an existing physical network. The internet, which connects many nodes via circuit switching, is an example of an SDWAN overlay network. An overlay network is any virtual layer on top of physical network infrastructure.

  • Consider an SDWAN overlay as a flexible tag.

This may be as simple as a virtual local area network (VLAN) but typically refers to more complex virtual layers from an SDN or an SD-WAN). Think of an SDWAN overlay as a tag so that building the overlays is not expensive or time-consuming. In addition, you don’t need to buy physical equipment for each overlay as the overlay is virtualized and in the software.

Similar to software-defined networking (SDN), the critical part is that SD-WAN works by abstraction. All the complexities are abstracted into application overlays. For example, application type A can use this SDWAN overlay, and application type B can use that SDWAN overlay. 

  • I.P. and port number, orchestrations, and end-to-end

Recent application requirements drive a new type of WAN that more accurately supports today’s environment with an additional layer of policy management. The world has moved away from looking at I.P. addresses and Port numbers used to identify applications and made the correct forwarding decision. 

Example Product: Cisco Meraki

**Section 1: Simplified Network Management**

One of the standout features of the Cisco Meraki platform is its user-friendly interface. Gone are the days of complex configurations and cumbersome setups. With Meraki, IT administrators can manage their entire network from a single, intuitive dashboard. This centralized management capability allows for real-time monitoring, troubleshooting, and updates, all from the cloud. The simplicity of the platform means that even those with limited technical expertise can effectively manage and optimize their network.

**Section 2: Robust Security Features**

In today’s digital landscape, security is paramount. Cisco Meraki understands this and has built comprehensive security features into its platform. From advanced malware protection to intrusion prevention and content filtering, Meraki offers a multi-layered approach to cybersecurity. The platform also includes built-in security analytics, providing IT teams with valuable insights to proactively address potential threats. This level of security ensures that your network remains protected against both internal and external vulnerabilities.

**Section 3: Scalability and Flexibility**

Another significant advantage of the Cisco Meraki platform is its scalability. As your business grows, so too can your network. Meraki’s cloud-based nature allows for seamless integration of new devices and locations without the need for extensive hardware upgrades. This flexibility makes it an ideal solution for businesses of all sizes, from small startups to large multinational corporations. The platform’s ability to adapt to changing needs ensures that it can grow alongside your business.

**Section 4: Comprehensive Support and Training**

Cisco Meraki doesn’t just provide a platform; it offers a complete ecosystem of support and training. From comprehensive documentation and online tutorials to live webinars and a dedicated support team, Meraki ensures that you have all the resources you need to make the most of its platform. This commitment to customer success means that you’re never alone in your network management journey.

Challenges to Existing WAN

Traditional WAN architectures consist of private MPLS links complemented with Internet links as a backup. Standard templates in most Service Provider environments are usually broken down into Bronze, Silver, and Gold SLAs. 

However, these types of SLA do not fit all geographies and often should be fine-tuned per location. Capacity, reliability, analytics, and security are all central parts of the WAN that should be available on demand. Traditional infrastructure is very static, and bandwidth upgrades and service changes require considerable time processing and locking agility for new sites.

It’s not agile enough, and nothing can be performed on the fly to meet the growing business needs. In addition, the cost per bit for the private connection is high, which is problematic for bandwidth-intensive applications, especially when the upgrades are too costly and can’t be afforded. 

  • A distributed world of dissolving perimeters

Perimeters are dissolving, and the world is becoming distributed. Applications require a WAN to support distributed environments along with flexible network points. Centralized-only designs result in suboptimal traffic engineering and increased latency. Increased latency disrupts the application performance, and only a particular type of content can be put into a Content Delivery Network (CDN). CDN cannot be used for everything.

Traditional WANs are operationally complex; people likely perform different network and security functions. For example, you may have a DMVPN, Security, and Networking specialist. Some wear all hats, but they are few and far between. Different hats have different ideas, and agreeing on a minor network change could take ages.

  • The World of SD-WAN Static Network-Based

SD-WAN replaces traditional WAN routers that are agnostic to the underlying transport technology. You can use various link types, such as MPLS, LTE, and broadband. All combined. Based on policies generated by the business, SD-WAN enables load sharing across different WAN connections that more efficiently support today’s application environment.

It pulls policy and intelligence out of the network and places them into an end-to-end solution orchestrated by a single pane of glass. SDN-WAN is not just about tunnels. It consists of components that work together to simplify network operations while meeting all bandwidth and resilience requirements.

Centralized network points are no longer adequate; we need network points positioned where they make the most sense for the application and user. Backhauling traffic to a central data center is illogical, and connecting remote sites to a SaaS or IaaS model over the public Internet is far more efficient. The majority of enterprises prefer to connect remote sites directly to cloud services. So why not let them do this in the best possible way?

A new style of WAN and SD-WAN

We require a new WAN style and a shift from a network-based approach to an application-based approach. The new WAN no longer looks solely at the network to forward packets. Instead, it looks at the business application and decides how to optimize it with the correct forwarding behavior. This new style of forwarding is problematic with traditional WAN architecture.

Making business logic decisions with IP and port number information is challenging. Standard routing is packet by packet and can only set part of the picture. They have routing tables and perform forwarding but essentially operate on their little island, losing out on a holistic view required for accurate end-to-end decision-making. An additional layer of information is needed.

A controller-based approach offers the necessary holistic view. We can now make decisions based on global information, not solely on a path-by-path basis. Getting all the routing information and compiling it into a dashboard to make a decision is much more efficient than making local decisions that only see parts of the network. 

From a customer’s viewpoint, what would the perfect WAN look like if you could roll back the clock and start again?   

SD WAN Overlay

SD-WAN • Interactive Learning

SD-WAN Path Steering Explorer

See how SD-WAN can compare available paths using latency, packet loss, jitter and business policy.

APPLICATION PATH Branch A SD-WAN Edge SaaS / Cloud Application MPLS 28 ms • 0.1% loss Broadband 18 ms • 0.4% loss LTE / 5G 42 ms • 1.2% loss PATH QUALITY Latency • Loss • Jitter • Policy SELECTED: MPLS
Learning Focus

SD-WAN compares available paths

SD-WAN can continuously evaluate the quality of available paths. The decision is not simply based on which transport exists.

28 Latency ms
0.1% Packet Loss
4 Jitter ms
Path quality Latency, packet loss and jitter provide measurements of current path conditions.
Application requirements Different applications can require different network characteristics.
Policy Business policy can influence which available path should be preferred.
Current decision: MPLS is selected because it currently provides the preferred combination of quality and policy.

Measure

SD-WAN monitors characteristics such as latency, packet loss and jitter across available paths.

Compare

The available paths can be compared against application requirements and policy.

Steer

Traffic can be directed toward a path that better satisfies the current requirements.

SD-WAN principle: path selection can be based on real-time network conditions and application policy — not simply the transport type.

Introducing the SD-WAN Overlay

SD-WAN decouples (separates) the WAN infrastructure, whether physical or virtual, from its control plane mechanism and allows applications or application groups to be placed into virtual WAN overlays. The separation will enable us to bring many enhancements and improvements to a WAN that has had little innovation in the past compared to the rest of the infrastructure, such as server and storage modules.

With server virtualization, several virtual machines create application isolation on a physical server. Applications placed in VMs operate in isolation, yet the VMs are installed on the same physical hosts.

Consider SD-WAN to operate with similar principles. Each application or group can operate independently when traversing the WAN to endpoints in the cloud or other remote sites. These applications are placed into a virtual SDWAN overlay.

Overlay Networking

Overlay networking is an approach to computer networking that involves building a layer of virtual networks on top of an existing physical network. This approach improves the underlying infrastructure’s scalability, performance, and security. It also allows for the creation of virtual networks that span multiple physical networks, allowing for greater flexibility in traffic routes.

**Virtualization**

At the core of overlay networking is the concept of virtualization. This involves separating the physical infrastructure from the virtual networks, allowing greater control over allocating resources. This separation also allows the creation of virtual network segments that span multiple physical networks. This provides an efficient way to route traffic and the ability to provide additional security and privacy measures.

**Underlay network**

A network underlay is a physical infrastructure that provides the foundation for a network overlay, a logical abstraction of the underlying physical network. The network underlay provides the physical transport of data between nodes, while the overlay provides logical connectivity.

The network underlay can comprise various technologies, such as Ethernet, Wi-Fi, cellular, satellite, and fiber optics. It is the foundation of a network overlay and essential for its proper functioning. It provides data transport and physical connections between nodes. It also provides the physical elements that make up the infrastructure, such as routers, switches, and firewalls.

Example: DMVPN over IPSec

Understanding DMVPN

DMVPN is a dynamic VPN technology that simplifies establishing secure connections between multiple sites. Unlike traditional VPNs, which require point-to-point tunnels, DMVPN uses a hub-and-spoke architecture, allowing any-to-any connectivity. This flexibility enables organizations to quickly scale their networks and accommodate dynamic changes in their infrastructure.

On the other hand, IPsec provides a robust framework for securing IP communications. It offers encryption, authentication, and integrity mechanisms, ensuring that data transmitted over the network remains confidential and protected against unauthorized access. IPsec is a widely adopted standard that is compatible with various network devices and software, making it an ideal choice for securing DMVPN connections.

The combination of DMVPN and IPsec brings numerous benefits to organizations. Firstly, DMVPN’s dynamic nature allows for easy scalability and improved network resiliency. New sites can be added seamlessly without the need for manual configuration changes. Additionally, DMVPN over IPsec provides strong encryption, ensuring the confidentiality of sensitive data. Moreover, DMVPN’s any-to-any connectivity optimizes network traffic flow, enhancing performance and reducing latency.

 

Overlay networking
Diagram: Overlay networking. Source Researchgate.

Key Challenges: Driving Overlay Networking & SD-WAN

**Challenge: We need more bandwidth**

Modern businesses demand more bandwidth than ever to connect their data, applications, and services. As a result, we have many things to consider with the WAN, such as regulations, security, visibility, branch, data center sites, remote workers, internet access, cloud, and traffic prioritization. They were driving the need for SD-WAN.

The concepts and design principles of creating a wide area network (WAN) to provide resilient and optimal transit between endpoints have continuously evolved. However, the driver behind building a better WAN is to support applications that demand performance and resiliency.

**Challenge: Suboptimal traffic flow**

The optimal route will be the fastest or most efficient and, therefore, preferred to transfer data. Sub-optimal routes will be slower and, hence, not the selected route. Centralized-only designs resulted in suboptimal traffic flow and increased latency, which will degrade application performance.

A key point to note is that traditional networks focus on centralized points in the network that all applications, network, and security services must adhere to. These network points are fixed and cannot be changed.

**Challenge: Network point intelligence**

However, the network should evolve to have network points positioned where it makes the most sense for the application and user, not based on a previously validated design for a different application era. For example, many branch sites do not have local Internet breakouts.

So, for this reason, we backhauled internet-bound traffic to secure, centralized internet portals at the H.Q. site. As a result, we sacrificed the performance of Internet and cloud applications. Designs that place the H.Q. site at the center of connectivity requirements inhibit the dynamic access requirements for digital business.

**Challenge: Hub and spoke drawbacks**

Simple spoke-type networks are sub-optimal because you always have to go to the center point of the hub and then out to the machine you need rather than being able to go directly to whichever node you need. As a result, the hub becomes a bottleneck in the network as all data must go through it. With a more scattered network using multiple hubs and switches, a less congested and more optimal route could be found between machines.

Cisco SD WAN Overlay
Diagram: Cisco SD-WAN overlay. Source Network Academy

The Fabric:

The word fabric comes from the fact that there are many paths to move from one server to another to ease balance and traffic distribution. SDN aims to centralize the order that enables the distribution of the flows over all the fabric paths. Then, we have an SDN controller device. The SDN controller can also control several fabrics simultaneously, managing intra and inter-datacenter flows.

SD-WAN is used to control and manage a company’s multiple WANs. There are different types of WAN: Internet, MPLS, LTE, DSL, fiber, wired network, circuit link, etc. SD-WAN uses SDN technology to control the entire environment. Like SDN, the data plane and control plane are separated. A centralized controller must be added to manage flows, routing or switch policies, packet priority, network policies, etc. SD-WAN technology is based on overlay, meaning nodes representing underlying networks.

Centralized logic:

In a traditional network, each device’s transport functions and controller layer are resident. This is why any configuration or change must be done box-by-box. Configuration was carried out manually or, at the most, an Ansible script. SD-WAN brings Software-Defined Networking (SDN) concepts to the enterprise branch WAN.

Software-defined networking (SDN) is an architecture, whereas SD-WAN is a technology that can be purchased and built on SDN’s foundational concepts. SD-WAN’s centralized logic stems from SDN. SDN separates the control from the data plane and uses a central controller to make intelligent decisions, similar to the design that most SD-WAN vendors operate.

A holistic view:

The controller and the SD-WAN overlay have a holistic view. The controller supports central policy management, enabling network-wide policy definitions and traffic visibility. The SD-WAN edge devices perform the data plane. The data plane is where simple forwarding occurs, and the control plane, which is separate from the data plane, sets up all the controls for the data plane to forward.

Like SDN, the SD-WAN overlay abstracts network hardware into a control plane with multiple data planes to make up one large WAN fabric. As the control layer is abstracted and decoupled above the physicals and running in software, services can be virtualized and delivered from a central location to any point on the network.

SD-WAN Overlay Features

SD-WAN Overlay Feature 1: Combining the transports:

At its core, SD-WAN shapes and steers application traffic across multiple WAN means of transport. Building on the concept of link bonding to combine numerous means of transport and transport types, the SD-WAN overlay improves the idea by moving the functionality up the stack—first, SD-WAN aggregates last-mile services, representing them as a single pipe to the application.SD-WAN allows you to combine all transport links into one big pipe. SD-WAN is transport agnostic. As it works by abstraction, it does not care what transport links you have. Maybe you have MPLS, private Internet, or LTE. It can combine all these or use them separately.

SD-WAN Overlay Feature 2: location:

From a central location, SD-WAN pulls all of these WAN resources together, creating one large WAN fabric that allows administrators to slice up the WAN to match the application requirements that sit on top. Different applications traverse the WAN, so we need the WAN to react differently. For example, if you’re running a call center, you want a low delay, latency, and high availability with Voice traffic. You may wish to use this traffic to use an excellent service-level agreement path.

SD WAN traffic steering
Diagram: SD-WAN traffic steering. Source Cisco.

SD-WAN Overlay Feature 3: steering:

Traffic steering may also be required: voice traffic to another path if, for example, the first Path is experiencing high latency. If it’s not possible to steer traffic automatically to a link that is better performing, run a series of path remediation techniques to try to improve performance. File transfer differs from real-time Voice: you can tolerate more delay but need more B/W. Here, you may want to use a combination of WAN transports ( such as customer broadband and LTE ) to achieve higher aggregate B/W.

This also allows you to automatically steer traffic over different WAN transports when there is a deflagration on one link. With the SD-WAN overlay, we must start thinking about paths, not links.

SD-WAN Overlay Feature 4: decisions:

At its core, SD-WAN enables real-time application traffic steering over any link, such as broadband, LTE, and MPLS, assigning pre-defined policies based on business intent. Steering policies support many application types, making intelligent decisions about how WAN links are utilized and which paths are taken.

The concept of an underlay and overlay are not new, and SD-WAN borrows these designs. First, the underlay is the physical or virtual world, such as the physical infrastructure. Then, we have the overlay, where all the intelligence can be set. The SDWAN overlay represents the virtual WANs that hold your different applications.

A virtual WAN overlay enables us to steer traffic and combine all bandwidths. Similar to how applications are mapped to V.M. in the server world, with SD-WAN, each application is mapped to its own virtual SD-WAN overlay. Each virtual SD-WAN overlay can have its own SD-WAN security policies, topologies, and performance requirements.

SD-WAN Overlay Feature 5:-Aware Routing Capabilities

Not only do we need application visibility to forward efficiently over either transport, but we also need the ability to examine deep inside the application and look at the sub-applications. For example, we can determine whether Facebook chat is over regular Facebook. This removes the application’s mystery and allows you to balance loads based on sub-applications. It’s like using a scalpel to configure the network instead of a sledgehammer.

SD-WAN Overlay Feature 6: Of Integration With Existing Infrastructure

The risk of introducing new technologies may come with a disruptive implementation strategy. Loss of service damages more than the engineer’s reputation. It hits all areas of the business. The ability to seamlessly insert new sites into existing designs is a vital criterion. With any network change, a critical evaluation is to know how to balance risk with innovation while still meeting objectives.

How aligned is marketing content to what’s happening in reality? It’s easy for marketing materials to implement their solution at Layer 2 or 3! It’s an entirely different ball game doing this. SD-WAN carries a certain amount of due diligence. One way to read between the noise is to examine who has real-life deployments with proven Proof of concept (POC) and validated designs. Proven POC will help you guide your transition in a step-by-step manner.

SD-WAN Overlay Feature 7: Specific Routing Topologies

Every company has different requirements for hub and spoke full mesh and Internet PoP topologies. For example, Voice should follow a full mesh design, while Data requires a hub and spokes connecting to a central data center. Nearest service availability is the key to improved performance, as there is little we can do about the latency Gods except by moving services closer together. 

SD-WAN Overlay Feature 8: Device Management & Policy Administration

The manual box-by-box approach to policy enforcement is not the way forward. It’s similar to stepping back into the Stone Age to request a catered flight. The ability to tie everything to a template and automate enables rapid branch deployments, security updates, and configuration changes. The optimal solutions have everything in one place and can dynamically push out upgrades.

SD-WAN Overlay Feature 9: Available With Automatic Failovers

You cannot apply a singular viewpoint to high availability. An end-to-end solution should address the high availability requirements of the device, link, and site level. WANs can fail quickly, but this requires additional telemetry information to detect failures and brownout events. 

SD-WAN Overlay Feature 10: On All Transports

Irrespective of link type, whether MPLS, LTE, or the Internet, we need the capacity to encrypt on all those paths without the excess baggage of IPsec. Encryption should happen automatically, and the complexity of IPsec should be abstracted.

**Application-Orientated WAN**

Push to the cloud:  

When geographically dispersed users connect back to central locations, their consumption triggers additional latency, degrading the application’s performance. No one can get away from latency unless we find ways to change the speed of light. One way is to shorten the link by moving to cloud-based applications.

The push to the cloud is inevitable. Most businesses are now moving away from on-premise in-house hosting to cloud-based management. Nevertheless, the benefits of moving to the cloud are manifold. It is easier for so many reasons.

The ready-made global footprint enables the usage of SaaS-based platforms that negate the drawbacks of dispersed users tromboning to a central data center. This software is pivotal to millions of businesses worldwide, which explains why companies such as Capsifi are so popular.

Logically positioned cloud platforms are closer to the mobile user. It’s increasingly far more efficient from the technical and business standpoint to host these applications in the cloud, which makes them available over the public Internet.

Bandwidth intensive applications:

Richer applications, multimedia traffic, and growth in the cloud application consumption model drive the need for additional bandwidth. Unfortunately, we can only fit so much into a single link. The congestion leads to packet drops, ultimately degrading application performance and user experience. In addition, most applications ride on TCP, yet TCP was not designed with performance.

Organic growth:

Organic business growth is a significant driver of additional bandwidth requirements. The challenge is that existing network infrastructures are static and unable to respond to this growth in a reasonable period adequately. The last mile of MPLS locks you in and kills agility. Circuit lead times impede the organization’s productivity and create an overall lag.

Costs:

A WAN virtualization solution should be simple. To serve the new era of applications, we need to increase the link capacity by buying more bandwidth. However, nothing is as easy as it may seem. The WAN is one of the network’s most expensive parts, and employing link oversubscription to reduce congestion is too costly.

Furthermore, bandwidth comes at a cost, and the existing TDM-based MPLS architectures cannot accommodate application demands. 

Traditional MPLS is feature-rich and offers many benefits. No one doubts this fact. MPLS will never die. However, it comes at a high cost for relatively low bandwidth. Unfortunately, MPLS’s price and capabilities are not a perfect couple.

Hybrid connectivity:

Since there is not one stamp for the entire world, similar applications will have different forwarding preferences. Therefore, application flows are dynamic and change depending on user consumption. Furthermore, the MPLS, LTE, and Internet links often complement each other since they support different application types.

For example, Storage and Big data replication traffic are forwarded through the MPLS links, while cheaper Internet connectivity is used for standard Web-based applications.

Limitations of protocols:

When left to its defaults, IPsec is challenged by hybrid connectivity. IPSec architecture is point-to-point, not site-to-site. As a result, it doesn’t natively support redundant uplinks. Complex configurations are required when sites have multiple uplinks to multiple providers.

By default, IPsec is not abstracted; one session cannot be used over multiple uplinks, causing additional issues with transport failover and path selection. It’s a Swiss Army knife of features, and much of IPSec’s complexities should be abstracted. Secure tunnels should be torn up and down immediately, and new sites should be incorporated into a secure overlay without much delay or manual intervention. 

Internet of Things (IoT):

Security and bandwidth consumption are key issues when introducing IP-enabled objects and IoT access technologies. IoT is all about Data and will bring a shed load of additional overheads for networks to consume. As millions of IoT devices come online, how efficiently do we segment traffic without complicating the network design further? Complex networks are hard to troubleshoot, and simplicity is the mother of all architectural success. Furthermore, much IoT processing requires communication to remote IoT platforms. How do we account for the increased signaling traffic over the WAN? The introduction of billions of IoT devices leaves many unanswered questions.

Branch NFV:

There has been strong interest in infrastructure consolidation by deploying Network Function Virtualization (NFV) at the branch. Enabling on-demand service and chaining application flows are key drivers for NFV. However, traditional service chaining is static since it is bound to a particular network topology. Moreover, it is typically built through manual configuration and is prone to human error.

 SD-WAN overlay path monitoring:

SD-WAN monitors the paths and the application performance on each link (Internet, MPLS, LTE ) and then chooses the best path based on real-time conditions and the business policy. In summary, the underlay network is the physical or virtual infrastructure above which the overlay network is built. An SDWAN overlay network is a virtual network built on top of an underlying Network infrastructure/Network layer (the underlay).

Controller-based policy:

An additional layer of information is needed to make more intelligent decisions about how and where to forward application traffic. SD-WAN offers a controller-based policy approach that incorporates a holistic view.

A central controller can now make decisions based on global information, not solely on a path-by-path basis with traditional routing protocols.  Getting all the routing information and compiling it into the controller to make a decision is much more efficient than making local decisions that only see a limited part of the network.

The SD-WAN Controller provides physical or virtual device management for all SD-WAN Edges associated with the controller. This includes, but is not limited to, configuration and activation, IP address management, and pushing down policies onto SD-WAN Edges located at the branch sites.

SD-WAN Overlay Case Study:

Personal Note: I recently consulted for a private enterprise. Like many enterprises, they have many applications, both legacy and new. No one knew about courses and applications running over the WAN; visibility was low. For the network design, the H.Q. has MPLS and Direct Internet access. Nothing is new here; this design has been in place for the last decade. All traffic is backhauled to the HQ/MPLS headend for security screening. The security stack, including firewalls, IDS/IPS, and anti-malware, was in the H.Q. The remote sites have high latency and limited connectivity options.

More importantly, they are transitioning their ERP system to the cloud. As apps move to the cloud, they want to avoid fixed WAN, a big driver for a flexible SD-WAN solution. They also have remote branches, which are hindered by high latency and poorly managed IT infrastructure. But they don’t want an I.T. representative at each site location. They have heard that SD-WAN has a centralized logic and can view the entire network from one central location. These remote sites must receive large files from the H.Q.; the branch sites’ transport links are only single-customer broadband links.

Some remote sites have LTE, and the bills are getting more significant. The company wants to reduce costs with dedicated Internet access or customer/business broadband. They have heard that you can combine different transports with SD-WAN and have several path remediations on degraded transports for better performance. So, they decided to roll out SD-WAN. From this new architecture, they gained several benefits.

SD-WAN Visibility

When your business-critical applications operate over different provider networks, troubleshooting and finding the root cause of problems becomes more challenging. So, visibility is critical to business. SD-WAN allows you to see network performance data in real-time and is essential for determining where packet loss, latency, and jitter are occurring so you can resolve the problem quickly.

You also need to be able to see who or what is consuming bandwidth so you can spot intermittent problems. For all these reasons, SD-WAN visibility needs to go beyond network performance metrics and provide greater insight into the delivery chains that run from applications to users.

  • Understand your baselines:

Visibility is needed to complete the network baseline before the SD-WAN is deployed. This enables the organization to understand existing capabilities, the norm, what applications are running, the number of sites connected, what service providers used, and whether they’re meeting their SLAs. Visibility is critical to obtaining a complete picture, so teams understand how to optimize the business infrastructure. SD-WAN gives you an intelligent edge, so you can see all the traffic and act on it immediately.

First, look at the visibility of the various flows, the links used, and any issues on those links. Then, if necessary, you can tweak the bonding policy to optimize the traffic flow. Before the rollout of SD-WAN, there was no visibility into the types of traffic, and different apps used what B.W. They had limited knowledge of WAN performance.

  • SD-WAN offers higher visibility:

With SD-WAN, they have the visibility to control and class traffic on layer seven values, such as what URL you are using and what Domain you are trying to hit, along with the standard port and protocol. All applications are not equal; some run better on different links. If an application is not performing correctly, you can route it to a different circuit. With the SD-WAN orchestrator, you have complete visibility across all locations, all links, and into the other traffic across all circuits. 

  • SD-WAN High Availability:

Any high-availability solution aims to ensure that all network services are resilient to failure. It aims to provide continuous access to network resources by addressing the potential causes of downtime through functionality, design, and best practices. The previous high-availability design was active and passive with manual failover. It was hard to maintain, and there was a lot of unused bandwidth. Now, they use resources more efficiently and are no longer tied to the bandwidth of the first circuit.

There is a better granular application failover mechanism. You can also select which apps are prioritized if a link fails or when a certain congestion ratio is hit. For example, you have LTE as a backup, which can be expensive. So applications marked high priority are steered over the backup link, but guest WIFI traffic isn’t.  

  • Flexible topology:

Before, they had a hub-and-spoke MPLS design for all applications. They wanted a complete mesh architecture for some applications, kept the existing hub, and spoke for others. However, the service provider couldn’t accommodate the level of granularity that they wanted.

With SD-WAN, they can choose topologies that are better suited to the application type. As a result, the network design is now more flexible and matches the application than the application matching a network design it doesn’t want.

Types of SD-WAN

The market for branch office wide-area network functionality is shifting from dedicated routing, security, and WAN optimization appliances to feature-rich SD-WAN. As a result, WAN edge infrastructure now incorporates a widening set of network functions, including secure routers, firewalls, SD-WAN, WAN path control, and WAN optimization, along with traditional routing functionality. Therefore, consider the following approach to deploying SD-WAN.

1. Application-based approach

With SD-WAN, we are shifting from a network-based approach to an application-based approach. The new WAN no longer looks solely at the network to forward packets. Instead, it looks at the business requirements and decides how to optimize the application with the correct forwarding behavior. This new way of forwarding would be problematic when using traditional WAN architectures.

Making business logic decisions with I.P. and port number information is challenging. Standard routing is the most common way to forward application traffic today, but it only assesses part of the picture when making its forwarding decision. 

These devices have routing tables to perform forwarding. Still, with this model, they operate and decide on their little island, losing the holistic view required for accurate end-to-end decision-making.  

2. SD-WAN: Holistic decision

The WAN must start making decisions holistically. It should not be viewed as a single module in the network design. Instead, it must incorporate several elements it has not integrated to capture the correct per-application forwarding behavior. The ideal WAN should be automatable to form a comprehensive end-to-end solution centrally orchestrated from a single pane of glass.

Managed and orchestrated centrally, this new WAN fabric is transport agnostic. It offers application-aware routing, regional-specific routing topologies, encryption on all transports regardless of link type, and high availability with automatic failover. All of these will be discussed shortly and are the essence of SD-WAN.  

3. SD-WAN and central logic        

Besides the virtual SD-WAN overlay, another key SD-WAN concept is centralized logic. Upon examining a standard router, local routing tables are computed from an algorithm to forward a packet to a given destination.

It receives routes from its peers or neighbors but computes paths locally and makes local routing decisions. The critical point to note is that everything is calculated locally. SD-WAN functions on a different paradigm.

Rather than using distributed logic, it utilizes centralized logic. This allows you to view the entire network holistically and with a distributed forwarding plane that makes real-time decisions based on better metrics than before.

This paradigm enables SD-WAN to see how the flows behave along the path. They are taking the fragmented control approach and centralizing it while benefiting from a distributed system. 

The SD-WAN controller, which acts as the brain, can set different applications to run over different paths based on business requirements and performance SLAs, not on a fixed topology. So, for example, if one path does not have acceptable packet loss and latency is high, we can move to another path dynamically.

4. Independent topologies

SD-WAN has different levels of networking and brings the concepts of SDN into the Wide Area Network. Similar to SDN, we have an underlay and an overlay network with SD-WAN. The WAN infrastructure, either physical or virtual, is the underlay, and the SDWAN overlay is in software on top of the underlay where the applications are mapped.

This decoupling or separation of functions allows different application or group overlays. Previously, the application had to work with a fixed and pre-built network infrastructure. With SD-WAN, the application can choose the type of topology it wants, such as a full mesh or hub and spoke. The topologies with SD-WAN are much more flexible.

5. The SD-WAN overlay

SD-WAN optimizes traffic over multiple available connections. It dynamically steers traffic to the best available link. Suppose the available links show any transmission issues. In that case, it will immediately transfer to a better path or apply remediation to a link if, for example, you only have a single link. SD-WAN delivers application flows from a source to a destination based on the configured policy and best available network path. A core concept of SD-WAN is overlaid.

SD-WAN solutions provide the software abstraction to create the SD-WAN overlay and decouple network software services from the underlying physical infrastructure. Multiple virtual overlays may be defined to abstract the underlying physical transport services, each supporting a different quality of service, preferred transport, and high availability characteristics.

6. Application mapping

Application mapping also allows you to steer traffic over different WAN transports. This steering is automatic and can be implemented when specific performance metrics are unmet. For example, if Internet transport has a 15% packet loss, the policy can be set to steer all or some of the application traffic over to better-performing MPLS transport.

Applications are mapped to different overlays based on business intent, not infrastructure details like IP addresses. When you think about overlays, it’s common to have, on average, four overlays. For example, you may have a gold, platinum, and bronze SDWAN overlay, and then you can map the applications to these overlays.

The applications will have different networking requirements, and overlays allow you to slice and dice your network if you have multiple application types. 

SD-WAN & WAN metrics

SD-WAN captures metrics that go far beyond the standard WAN measurements. For example, the traditional method measures packet loss, latency, and jitter metrics to determine path quality. These measurements are insufficient for routing protocols that only make the packet flow decision at layer 3 of the OSI model.

As we know, layer 3 of the OSI model lacks intelligence and misses the overall user experience. We must start looking at application transactions rather than relying on bits, bytes jitter, and latency.

SD-WAN incorporates better metrics beyond those a standard WAN edge router considers. These metrics may include application response time, network transfer, and service response time. Some SD-WAN solutions monitor each flow’s RTT, sliding windows, and ACK delays, not just the I.P. or TCP. This creates a more accurate view of the application’s performance.

Overlay Use Case: DMVPN Dual Cloud

Exploring Single Hub Dual Cloud Configuration

The Single Hub, Dual Cloud configuration, is a DMVPN setup in which a central hub site connects to two or more cloud service providers simultaneously. This configuration offers several advantages, such as increased redundancy, improved performance, and enhanced security.

By connecting to multiple cloud service providers, the Single Hub Dual Cloud configuration ensures redundancy if one provider experiences an outage. This redundancy enhances network availability and minimizes the risk of downtime, providing a robust and reliable network infrastructure.

With the Single Hub Dual Cloud configuration, network traffic can be load-balanced across multiple cloud service providers. This load balancing distributes the workload evenly, optimizing network performance and preventing bottlenecks. It allows for efficient utilization of network resources, resulting in enhanced user experience and improved application performance.

SD-WAN EDUCATION • WIDGET 3

Application-Aware Overlay Explorer

SD-WAN can give different applications different network behavior while sharing the same underlying WAN transports.

APPLICATIONS Voice / Real-Time Latency-sensitive ERP / Business App Reliable + secure Bulk Data / Backup Bandwidth-oriented SD-WAN POLICY Application Classification Requirements + Policy determine WAN behavior TRANSPORT POOL MPLS Private WAN Broadband Internet transport LTE / 5G Wireless transport KEY IDEA The same physical WAN can support multiple logical application overlays. Applications can receive different path, security and performance treatment.
EDUCATION PANEL

Application-Aware Networking

SD-WAN identifies application traffic and applies policy to determine how that traffic should use the available WAN.

Application Multiple applications
Requirement Different requirements
WAN Behaviour Policy determines treatment
Transport Shared transport pool
CURRENT POLICY DECISION Classify the application, then apply its requirements.
1

Identify

SD-WAN identifies the application or traffic class rather than treating every packet as identical WAN traffic.

2

Apply Policy

Business requirements can define performance, security, resilience and path preferences for each application.

3

Steer Traffic

The SD-WAN edge can select an appropriate path or transport while the underlying WAN remains shared.

SD-WAN principle: applications do not have to inherit one fixed WAN topology. Policy can create different logical network behaviour over the same physical infrastructure.

Summary: SD WAN Overlay

In today’s digital landscape, businesses increasingly rely on cloud-based applications, remote workforces, and data-driven operations. As a result, the demand for a more flexible, scalable, and secure network infrastructure has never been greater. This is where SD-WAN overlay comes into play, revolutionizing how organizations connect and operate.

SD-WAN overlay is a network architecture that allows organizations to abstract and virtualize their wide area networks, decoupling them from the underlying physical infrastructure. It utilizes software-defined networking (SDN) principles to create an overlay network that runs on top of the existing WAN infrastructure, enabling centralized management, control, and optimization of network traffic.

Key benefits of SD-WAN overlay 

1. Enhanced Performance and Reliability:

SD-WAN overlay leverages multiple network paths to distribute traffic intelligently, ensuring optimal performance and reliability. By dynamically routing traffic based on real-time conditions, businesses can overcome network congestion, reduce latency, and maximize application performance. This capability is particularly crucial for organizations with distributed branch offices or remote workers, as it enables seamless connectivity and productivity.

2. Cost Efficiency and Scalability:

Traditional WAN architectures can be expensive to implement and maintain, especially when organizations need to expand their network footprint. SD-WAN overlay offers a cost-effective alternative by utilizing existing infrastructure and incorporating affordable broadband connections. With centralized management and simplified configuration, scaling the network becomes a breeze, allowing businesses to adapt quickly to changing demands without breaking the bank.

3. Improved Security and Compliance:

In an era of increasing cybersecurity threats, protecting sensitive data and ensuring regulatory compliance are paramount. SD-WAN overlay incorporates advanced security features to safeguard network traffic, including encryption, authentication, and threat detection. Businesses can effectively mitigate risks, maintain data integrity, and comply with industry regulations by segmenting network traffic and applying granular security policies.

4. Streamlined Network Management:

Managing a complex network infrastructure can be a daunting task. SD-WAN overlay simplifies network management with centralized control and visibility, enabling administrators to monitor and manage the entire network from a single pane of glass. This level of control allows for faster troubleshooting, policy enforcement, and network optimization, resulting in improved operational efficiency and reduced downtime.

5. Agility and Flexibility:

In today’s fast-paced business environment, agility is critical to staying competitive. SD-WAN overlay empowers organizations to adapt rapidly to changing business needs by providing the flexibility to integrate new technologies and services seamlessly. Whether adding new branch locations, integrating cloud applications, or adopting emerging technologies like IoT, SD-WAN overlay offers businesses the agility to stay ahead of the curve.

Implementation of SD-WAN Overlay:

Implementing SD-WAN overlay requires careful planning and consideration. The following steps outline a typical implementation process:

1. Assess Network Requirements: Evaluate existing network infrastructure, bandwidth requirements, and application performance needs to determine the most suitable SD-WAN overlay solution.

2. Design and Architecture: Create a network design incorporating SD-WAN overlay while considering factors such as branch office connectivity, data center integration, and security requirements.

3. Vendor Selection: Choose a reliable and reputable SD-WAN overlay vendor based on their technology, features, support, and scalability.

4. Deployment and Configuration: Install the required hardware or virtual appliances and configure the SD-WAN overlay solution according to the network design. This includes setting up policies, traffic routing, and security parameters.

5. Testing and Optimization: Thoroughly test the SD-WAN overlay solution, ensuring its compatibility with existing applications and network infrastructure. Optimize the solution based on performance metrics and user feedback.

Conclusion: SD-WAN overlay is a game-changer for businesses seeking to optimize their network infrastructure. By enhancing performance, reducing costs, improving security, streamlining management, and enabling agility, SD-WAN overlay unlocks the true potential of connectivity. Embracing this technology allows organizations to embrace digital transformation, drive innovation, and gain a competitive edge in the digital era. In an ever-evolving business landscape, SD-WAN overlay is the key to unlocking new growth opportunities and future-proofing your network infrastructure.