PHASE 3 · MODULE 4

Network Troubleshooting & Diagnostics

A systematic approach to diagnosing and resolving network problems — from physical cables to application layers.

Learning Objectives

Troubleshooting Methodology

Effective troubleshooting follows a structured approach rather than randomly trying fixes. The CompTIA vendor-neutral model adapted for networking:

1
Identify the problem. Gather information from the user: what happened, when did it start, what changed recently? Check for patterns — is it one host or many?
2
Establish a theory. Based on symptoms, hypothesize the most likely cause. Consider both single-point failures and systemic issues. "If it were X, what else would you expect to see?"
3
Test the theory. Use diagnostic commands to confirm or rule out your hypothesis. Don't jump to conclusions — gather evidence first. Test one variable at a time.
4
Establish a plan of action. Once you know the root cause, decide on the fix. Consider impact, rollback options, and whether this needs change management approval.
5
Implement the solution. Apply the fix carefully. If multiple changes are needed, apply them one at a time with verification between each.
6
Verify functionality. Confirm the original problem is resolved. Check that no new problems were introduced. Test from multiple perspectives (source, destination, intermediate).
7
Document findings. Record the problem, root cause, resolution steps, and any lessons learned. Update SOPs if processes were missing or inadequate.
Golden Rule: Bottom-Up Approach

When starting fresh, always check Layer 1 (Physical) first, then work upward. Statistically, ~60% of network issues are Layer 1 or Layer 2. A loose cable will never be found by checking firewall rules.

Diagnostic Command Reference

Master these tools and you can diagnose 90% of everyday network issues.

ping
Tests reachability using ICMP Echo Request/Reply. Send packets to verify a host is online and measure round-trip time.
traceroute / tracert
Shows the path packets take to a destination, listing every router hop and its response time. Uses ICMP Time Exceeded messages.
nslookup
Queries DNS servers for record lookups. Useful for testing DNS resolution and finding misconfigured records.
dig
Advanced DNS lookup tool with detailed output showing query time, server used, and all record types. Preferred over nslookup by professionals.
curl
Transfers data with URLs. Use -v for verbose output to see HTTP headers and TLS handshake details. Excellent for web service debugging.
netstat / ss
Shows network connections, routing tables, interface stats, and listening ports. Critical for verifying services are running.
ipconfig / ifconfig / ip
Displays IP configuration of all interfaces. Windows: ipconfig /all. Linux: ip addr show.
arp -a
Shows the ARP cache — IP-to-MAC address mappings on the local machine. Essential for diagnosing Layer 2 issues.
pathmtu
Discovers the Path MTU to avoid fragmentation. On Linux: ping -M do -s 1472 <target>. On macOS: tracepath.
mtr
Combines ping and traceroute into one continuous diagnostic tool. Shows per-hop packet loss and latency in real-time.

Ping Deep Dive

# Basic ping ping 8.8.8.8 # Continuous ping (Ctrl+C to stop) ping -t google.com # Windows ping -c 10 google.com # Linux/Mac (10 packets) # With custom packet size (test MTU) ping -s 1472 -M do 8.8.8.8 # Linux: -s=size, -M=do-not-fragment # Quick timing (no DNS reverse lookup) ping -n 4 -R 192.168.1.1 # Windows: -n=count, -R=record route
Reading Ping Results

Reply from... = connection is working. Watch the time value — under 50ms is excellent (LAN), 50-150ms good (WAN), over 200ms sluggish. Request timed out = packet dropped somewhere (firewall, unreachable, or overloaded). Destination host unreachable = local routing problem (wrong gateway or no route). TTL expired = seen in traceroute when a router drops packets with exhausted TTL.

Traceroute Deep Dive

# Windows tracert -d google.com # -d skips DNS resolution (faster) tracert -h 30 -w 2000 8.8.8.8 # max hops=30, timeout=2000ms # Linux / Mac traceroute -n google.com # -n skips DNS lookup tracepath google.com # Mac/Linux: auto-discovers MTU # Modern alternative: mtr (continuous) mtr -n --report google.com
Interpreting Traceroute Output

Asterisks (*) at a hop mean the router didn't respond (often ICMP is filtered). This doesn't necessarily mean the path is broken — the next hop may still receive traffic. A consistent asterisk pattern throughout usually indicates a transparent router. Look for latency spikes at specific hops — that's where the problem likely lives.

DNS Diagnostics

# Windows nslookup google.com # Default resolver query nslookup -type=mx gmail.com # Find mail servers nslookup -type=txt example.com # SPF/DKIM records nslookup google.com 8.8.8.8 # Query specific DNS server nslookup 8.8.8.8 # Reverse lookup (PTR) # Linux/macOS — dig (more powerful) dig google.com # Full query with answer section dig +short google.com # Just the IP(s) dig @ns1.google.com google.com # Query specific nameserver dig -x 8.8.8.8 # Reverse DNS dig google.com ANY # All record types dig +trace google.com # Trace full resolution chain

Curl Deep Dive

# Verbose request — see full headers curl -v https://example.com # Only show response headers (fast) curl -I https://example.com # Follow redirects (-L) and include body (-o) curl -L -o page.html https://example.com # Test specific port connectivity (TCP layer check) curl -v telnet://192.168.1.1:22 # Check if SSH port responds # Show timing breakdown curl -w "\nDNS: %{time_namelookup}s\nConnect: %{time_connect}s\nTLS: %{time_appconnect}s\nTotal: %{time_total}s\n" -o /dev/null -s https://example.com

Wireshark Basics

Wireshark captures packets as they pass through a network interface, letting you inspect every byte of traffic. It's the ultimate diagnostic tool when other commands fall short.

ConceptDescription
Capture FilterBPF syntax applied BEFORE capturing (e.g., host 192.168.1.1). Reduces disk usage by filtering at the driver level.
Display FilterApplied AFTER capture to view specific traffic (e.g., tcp.port == 80). Doesn't discard data, just hides it.
Three-pane viewTop: packet list. Middle: packet details (protocol tree). Bottom: raw packet bytes (hex + ASCII).
Color codingGreen=normal, Red=error/tls warning, Yellow=warning, Blue=selected. Customizable.
Follow StreamRight-click a packet → Follow → TCP Stream to reconstruct the entire conversation in readable format.
Essential Display Filters

Hands-On Lab: Wireshark Capture

  1. Install Wireshark from wireshark.org. Run as administrator (Windows) or with sudo (Linux) for best results.
  2. Select your active network interface and click the blue shark-fin icon to start capture.
  3. Open a browser and visit http://example.com (intentionally use HTTP, not HTTPS).
  4. Stop the capture and apply filter: http.request
  5. Right-click any HTTP packet → Follow → TCP Stream. You'll see the full cleartext request and response.
  6. Now visit https://example.com and filter with tls — observe the encrypted handshake instead.
  7. Apply dns filter and examine a DNS query/response pair. Note the difference between UDP (query) and potentially TCP (if response is large).

Cable Testing

Physical media failures account for a significant portion of network incidents. Cable testers range from $20 continuity testers to $2,000+ certification instruments.

ToolWhat It TestsCost RangeUse Case
LED Continuity TesterBasic wire map (pin 1 to pin 1, etc.), open/short detection$10–$50Quick field verification of patch cables
TONER & probe kitTrace cables through walls/closets, identify cable ends$20–$100Cable identification in patch panels
Certificate Cable TesterWire map, length, attenuation, crosstalk, return loss, near-end crosstalk (NEXT)$500–$2,000+Compliance testing per TIA/EIA standards
OTDR (Optical Time Domain Reflectometer)Fiber loss, break location, splice points, connector loss$2,000–$15,000+Fiber optic installation and troubleshooting
MultimeterVoltage on PoE ports, continuity, resistance$20–$200Verifying PoE power delivery, basic electrical checks
Cable Standards Quick Reference

T568A: White-Green, Green, White-Orange, Blue, White-Blue, Orange, White-Brown, Brown
T568B: White-Orange, Orange, White-Green, Blue, White-Blue, Green, White-Brown, Brown
Patch cables should use the same standard on both ends (T568B-T568B). Crossover cables use different standards on each end (rarely needed with modern auto-MDI/X NICs).

Wireless Troubleshooting

Wi-Fi issues are among the most frustrating to diagnose because symptoms are often intermittent and environment-dependent.

  • Check AP logs, wpa_supplicant debug output
  • IssueLikely CausesDiagnosticsFixes
    Poor signal strengthDistance, obstacles, interferencewifi analyzer apps, iwconfig, netsh wlan show networksReposition AP, add repeater, reduce obstacles
    Channel congestionToo many APs on same channel, neighboring networksSpectrum analyzer, WiFi scanner appSwitch to less congested channel (1, 6, 11 for 2.4GHz)
    Slow throughputWrong security mode, old client, co-channel interferenceSpeed tests, ethtool, check negotiated rateUpgrade to WPA3, disable legacy 802.11b/g, increase bandwidth
    Auth failuresWrong passphrase, RADIUS issues, certificate problemsVerify credentials, check RADIUS server, renew certificates
    Roaming issuesClient won't deauth from old AP, signal threshold misconfiguredCheck roaming thresholds, test with client probe requestsAdjust RSSI kickback threshold, enable 802.11r/k/v fast transition
    Intermittent dropsInterference from microwaves, Bluetooth, bad cabling to AP Spectrum scan, cable tester on backhaulChange channels, upgrade cabling, move AP away from sources
    2.4 GHz vs 5 GHz Trade-offs

    2.4 GHz: Better range and penetration through walls, but crowded (microwaves, Bluetooth, neighbors) and slower max speeds. Use for IoT devices and distant clients.
    5 GHz: Faster speeds, more non-overlapping channels, less interference — but shorter range and poorer wall penetration. Use for high-bandwidth tasks (video, large files).

    Common Connectivity Issues & Fixes

    SymptomProbable CauseDiagnostic StepsResolution
    No internet, LAN works Default gateway or DNS failure ipconfig /all check gateway and DNS; ping 8.8.8.8 (works) vs ping google.com (fails) Renew DHCP lease; verify ISP uplink; check DNS settings
    169.254.x.x address DHCP failure — APIPA assigned ipconfig /release && ipconfig /renew; check DHCP server status and scope availability Restart DHCP server; check scope exhaustion; verify switch port isn't blocking DHCP (port 67/68)
    Intermittent connectivity Cable fault, duplex mismatch, interference show interface for errors/drops; cable tester; check link lights Replace cable; set correct duplex/speed (prefer auto-negotiate); move away from interference source
    Can ping IP but not hostname DNS resolution failure nslookup / dig; check /etc/resolv.conf or DNS server config Configure correct DNS server; flush DNS cache; check DNS forwarder on gateway
    Limited/no connectivity (Windows) IP conflict or incorrect subnet mask arp -a check duplicate MAC; ipconfig verify mask matches network Assign static IP outside DHCP range; correct subnet mask; enable DHCP snooping
    Can't reach remote subnet Missing route, ACL blocking, NAT misconfiguration tracert to find where packets drop; show ip route on router Add missing route; adjust ACL; verify NAT translation table entries
    High latency on local network Switch loop, duplex mismatch, overloaded link show spanning-tree; show interfaces counters for collisions/crc errors Fix STP topology; ensure matched duplex settings; aggregate links with LACP
    SSL/TLS certificate errors Expired cert, wrong hostname, untrusted CA Browser error details; openssl s_client -connect host:443 Renew certificate; fix hostname matching; install missing CA bundle

    Case Studies

    1
    The Office That Lost Internet at 9 AM Daily

    Symptom: Every weekday at approximately 9:00 AM, the entire office loses internet access for 5–10 minutes. Internal LAN continues working fine.

    Investigation:

    • Confirmed internal LAN works (can ping switches, printers, local servers)
    • Traceroute to external IPs shows hang at the edge router at exactly 9 AM
    • Checked ISP circuits — one circuit shows CRC errors correlating with the outage window
    • Found that the building's main elevator motor starts at 8:58 AM and causes electromagnetic interference on the faulty coaxial cable run

    Root Cause: Aging coaxial drop cable inside the building, weakened by years of elevator vibration, creating intermittent signal degradation when the motor cycles on.

    Resolution: Replaced the coaxial cable with shielded CAT6 runs to the optical converter. Added a fiber uplink as backup path. Outages eliminated entirely.

    Lesson: Pattern-based issues require correlating timing with environmental factors. Layer 1 problems can manifest as seemingly higher-layer symptoms.

    2
    The Printer Everyone Could See Except Each Other

    Symptom: Several departments report they cannot print to a network printer, though everyone can ping it. The print queue appears full but jobs never process.

    Investigation:

    • Ping succeeds — Layer 3 connectivity confirmed
    • Traceroute shows normal path
    • From the print server: can't connect to printer on port 9100 (JetDirect)
    • Wireshark capture on the printer's VLAN shows ARP requests going out but no replies from some subnets
    • Discovered the switch port connected to the printer was configured with storm-control broadcast level 10% and the printer was generating broadcast storms due to a misconfigured protocol

    Root Cause: Storm control on the switch port was dropping excessive broadcast traffic during surge periods, preventing some clients' ARP requests from reaching the printer.

    Resolution: Adjusted storm-control threshold to 30%, replaced the printer's firmware, and moved the printer to a dedicated access vlan with appropriate QoS priority for control traffic.

    Lesson: When connectivity seems inconsistent (some can reach, others can't), consider Layer 2 broadcast behaviors and switch configurations.

    3
    The SSL Certificate That Broke Everything

    Symptom: Users report browsers showing security warnings on multiple internal sites after a routine maintenance window. Some applications fail to authenticate.

    Investigation:

    • Multiple sites affected — not isolated to one server
    • Error: "Certificate chain incomplete" or "Unable to verify the first certificate"
    • Checked the web servers: certificates were valid and renewed
    • Used openssl s_client -showcerts -connect site:443 — saw the intermediate certificate was missing from the chain
    • The maintenance script had purged the intermediate CA bundle from the reverse proxy's SSL configuration

    Root Cause: Maintenance automation removed the intermediate certificate from Nginx's ssl_certificate directive, keeping only the leaf cert. Browsers that cached the full chain before still worked; fresh connections failed.

    Resolution: Restored the full certificate chain (leaf + intermediates) in the correct order. Added a pre-deployment validation step that runs openssl s_client -showcerts against each endpoint.

    Lesson: SSL certificate chain issues often affect only some users (those without cached chains). Always validate the full certificate chain, not just individual certs.

    Documenting Findings & Creating SOPs

    Good documentation turns individual heroics into organizational capability. An incident you solve today shouldn't become someone else's emergency next month.

    ElementWhat to IncludeWhy It Matters
    Incident SummaryDate/time, affected systems, severity, durationQuick reference for pattern analysis and reporting
    Symptoms ObservedExact error messages, user descriptions, affected scopeEnables rapid symptom-to-cause matching for future incidents
    Diagnostic Steps TakenCommands run, outputs captured, hypotheses tested and ruled outPrevents re-investigation and documents what was tried
    Root CauseSpecific technical cause with evidence (logs, captures, configs)Addresses the actual problem, not just the symptom
    ResolutionStep-by-step fix applied, verification performedRepeatable recovery if the issue recurs
    Preventive ActionsConfiguration changes, monitoring alerts, process updatesStops the same issue from happening again
    SOP Template: Network Connectivity Check

    Trigger: User reports "can't get internet" or "slow network"
    Step 1: Determine scope — one device or multiple? One floor or entire building?
    Step 2: Physical check — link lights on NIC and switch port? Correct cable?
    Step 3: IP config — ipconfig /all or ip addr. Is there an APIPA (169.254.x.x)?
    Step 4: Local reachability — ping 127.0.0.1 (loopback), then ping <own_IP>, then ping <gateway>
    Step 5: External reachability — ping 8.8.8.8. If this works, it's a DNS issue.
    Step 6: DNS check — nslookup google.com. If it fails, check DNS server config.
    Step 7: Trace the path — traceroute 8.8.8.8 to find where packets are dropping.
    Step 8: If all above passes but app still fails, check application-specific ports with telnet <host> <port> or nc -zv <host> <port>.

    Hands-On Labs

    Laboratory 1: End-to-End Diagnostic Walkthrough

    1. Open a terminal. Run ipconfig /all (Windows) or ip addr (Linux). Record your IP, subnet mask, gateway, and DNS servers.
    2. Ping your default gateway. Does it respond? What's the average RTT?
    3. Ping an external IP (8.8.8.8). Does it respond? Compare timing to the gateway ping.
    4. Ping a domain name (google.com). Does DNS resolve correctly?
    5. Run traceroute 8.8.8.8 (or tracert on Windows). How many hops to reach Google's DNS? Which hops show highest latency?
    6. Use netstat -an | grep LISTEN (Linux) or netstat -an (Windows) to identify all listening services on your machine.
    7. Test connectivity to a specific port: nc -zv google.com 443. Does it succeed?
    8. Perform a DNS lookup using both nslookup and dig. Compare the output detail levels.

    Laboratory 2: Wireless Site Survey Simulation

    1. On a laptop with WiFi, run netsh wlan show networks mode=bssid (Windows) or iw dev wlan0 scan (Linux) to discover nearby networks.
    2. Note the SSIDs, channels, signal strengths (dBm), and security types you discover.
    3. Identify which 2.4 GHz channel has the least congestion (channels 1, 6, 11 are non-overlapping).
    4. If available, use a mobile WiFi analyzer app to visualize signal heat maps across your home/office.
    5. Recommend optimal AP placement based on your observations — prioritize line-of-sight and distance from interference sources.

    Laboratory 3: Wireshark Deep Analysis

    1. Start a Wireshark capture on your primary interface.
    2. Generate various traffic: browse to an HTTP site, then an HTTPS site, send an email (if configured), and ping an external host.
    3. Stop capture and apply these filters sequentially: http, then tls, then dns, then icmp.
    4. Find a DNS query packet. Expand the details pane to see the query name, type, and flags.
    5. Find a TLS Client Hello packet. Note the cipher suites advertised by your client.
    6. Look for any TCP retransmissions: tcp.analysis.retransmission. If none appear, try downloading a large file and re-checking.
    7. Practice "Follow TCP Stream" on an HTTP session and note how readable the cleartext looks compared to the TLS stream.

    Resources

    ← Essential Protocols Back to Phase 3 Overview →