Post

My Kyoto Region Homelab 10Gbps Fiber For 47Mo And Using The Buildings Steel Pillars As Giant Heatsinks

My Kyoto Region Homelab 10Gbps Fiber For 47Mo And Using The Buildings Steel Pillars As Giant Heatsinks

My Kyoto Region Homelab 10Gbps Fiber For 47Mo And Using The Buildings Steel Pillars As Giant Heatsinks

1. Introduction

In the world of homelabs and self-hosted infrastructure, two challenges consistently dominate discussions: achieving enterprise-grade networking performance and solving thermal management without industrial cooling budgets. This guide explores an unconventional solution implemented in a Kyoto-based homelab where 10Gbps fiber meets innovative passive cooling through structural engineering.

The Kyoto homelab achieves 47Mo (Japanese shorthand for 47Mbps) fiber performance while leveraging the building’s steel framework as massive heatsinks for network switches. This approach demonstrates how DevOps engineers can apply infrastructure-as-engineering principles to solve real-world constraints in residential environments.

Why This Matters

  • Cost Efficiency: Eliminates expensive rack cooling solutions
  • Sustainability: Passive cooling reduces energy consumption
  • Space Optimization: Under-desk deployment maximizes limited space
  • Performance: 10Gbps networking supports modern Kubernetes workloads

What You’ll Learn:

  • Steel structure thermal transfer fundamentals
  • 10Gbps network tuning for residential fiber
  • Kubernetes cluster optimization in space-constrained environments
  • Thermal management verification techniques

This guide targets experienced sysadmins and DevOps professionals looking to implement enterprise-grade infrastructure in non-traditional environments while maintaining operational efficiency and reliability.


2. Understanding the Topic

Structural Thermal Management Fundamentals

Building frameworks in earthquake-prone regions like Kyoto use high-thermal-conductivity steel (typically 50-60 W/m·K). When properly coupled with heat-generating equipment, these structures can dissipate 150-300W per square meter passively.

Key Physics Principles:

1
2
3
4
5
6
7
# Basic heat transfer equation (Fourier's Law)
Q = -k * A * (dT/dx)
# Where:
# Q = Heat transfer rate (W)
# k = Thermal conductivity (W/m·K)
# A = Contact area (m²)
# dT/dx = Temperature gradient (K/m)

Comparison of Cooling Methods:

MethodCost (USD/W)Noise (dB)Space RequiredEfficiency
Active Air Cooling0.50-2.0030-50High40-60%
Liquid Cooling5.00-10.0020-35Medium70-85%
Structural Dissipation0.10-0.300Low60-75%

10Gbps Networking Constraints

Residential fiber deployments in Japan’s Kansai region typically use NTT East’s FLET’S Hikari Cross service, offering:

  • Synchronous 10Gbps WAN
  • IPv4/IPv6 dual stack
  • 47Mbps guaranteed minimum (47Mo)

Technical Challenges:

  • Bufferbloat control at multi-gigabit speeds
  • VLAN segmentation for Kubernetes CNI
  • SFP+ compatibility with NTT ONU equipment

Kubernetes Thermal Considerations

Network switches in bare-metal Kubernetes clusters generate concentrated heat:

  • Arista DCS-7010T: 120W thermal design power
  • MikroTik CRS309-1G-8S+: 28W typical load
  • Mellanox ConnectX-3 Pro: 7W per port at 10Gbps

3. Prerequisites

Hardware Requirements

  • Networking:
    • 10GBase-T or SFP+ switches (MikroTik CRS3xx series recommended)
    • Compatible ONU (Huawei HG8040Q or NEC Aterm WX5600T)
    • DAC cables or Cat 6A/7 Ethernet
  • Thermal Management:
    • 6mm Fujipoly Ultra Extreme thermal pads (17 W/m·K)
    • Neodymium magnets (N52 grade, 10kg pull force)
    • Infrared thermometer (FLIR ONE Pro recommended)

Software Requirements

  • Kubernetes: v1.28+ with Cilium CNI
  • Switch OS: RouterOS v7.11+ or Cumulus Linux 5.7
  • Monitoring: Prometheus 2.45 + Grafana 10.1

Structural Verification

  1. Confirm building steel composition with magnetic testing
  2. Verify insulation bypass points (typically service shafts)
  3. Measure thermal gradient with IR camera:
    1
    2
    3
    
    # Sample thermal reading analysis
    MAX_TEMP=$(thermal_scan --device flir-one | grep "Switch" | awk '{print $3}')
    SAFETY_MARGIN=$((70 - $MAX_TEMP))  # 70°C is max operational temp
    

Safety Checklist

  • Confirm non-load-bearing status of target pillars
  • Verify no electrical grounding paths
  • Test magnet strength with shear force gauge

4. Installation & Setup

Thermal Coupling Procedure

  1. Surface preparation:
    1
    
    sudo alcohol_clean --surface steel --solvent isopropyl
    
  2. Thermal pad application:
    1
    2
    3
    
    def calculate_pad_thickness(device_tdp, steel_conductivity):
     # Optimal thickness calculation (mm)
     return (device_tdp * 1000) / (steel_conductivity * contact_area)
    
  3. Magnetic mounting configuration:
    1
    2
    
    Switch Orientation:
    [Steel Pillar] <-> [Thermal Pad] <-> [Switch Chassis] <-> [Magnets]
    

Network Configuration

MikroTik CRS310 SFP+ Setup:

1
2
3
4
5
6
7
8
/interface bridge
add name=br-k8s vlan-filtering=yes

/interface ethernet
set [find] name=sfp-sfp1

/interface vlan
add interface=br-k8s name=vlan.kubernetes vlan-id=110

Kubernetes Node Networking:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
# /etc/netplan/00-k8s.yaml
network:
  version: 2
  renderer: networkd
  bonds:
    bond0:
      interfaces: [eth0, eth1]
      parameters:
        mode: 802.3ad
        lacp-rate: fast
  vlans:
    k8s-vlan:
      id: 110
      link: bond0

Verification Steps

  1. Thermal performance test:
    1
    2
    
    stress-ng --cpu 4 --io 2 --vm 1 --timeout 15m
    thermal_monitor --interval 5s --output thermal.log
    
  2. Network throughput validation:
    1
    
    iperf3 -c 10.10.10.2 -P 16 -t 60 -J | jq '.end.sum_received.bits_per_second'
    

5. Configuration & Optimization

Thermal Efficiency Tuning

  1. Contact pressure optimization:
    • Ideal force: 5-7 PSI
    • Measured via pressure-sensitive film
  2. Air gap prevention:
    1
    2
    
    # Check for air gaps with thermal imaging
    thermal_scan --analyze --hotspots --threshold 5C
    

Network Performance Tweaks

Bufferbloat Mitigation:

1
2
# Cake QoS on Linux edge router
tc qdisc add dev eth0 root cake bandwidth 10gbit besteffort

Kubernetes CNI Optimization:

1
2
3
4
5
# Cilium configuration snippet
bandwidthManager:
  enabled: true
bbr: true
enableXDP: true

Security Hardening

  1. Switch access controls:
    1
    2
    3
    4
    
    /ip service
    set telnet disabled=yes
    set ftp disabled=yes
    set www-ssl certificate=your_ssl_cert
    
  2. Kubernetes pod isolation:
    1
    2
    3
    4
    5
    6
    7
    8
    
    # Pod security policy
    apiVersion: policy/v1beta1
    kind: PodSecurityPolicy
    metadata:
      name: restricted
    spec:
      privileged: false
      allowPrivilegeEscalation: false
    

6. Usage & Operations

Daily Monitoring

Grafana Dashboard Metrics:

  • Steel pillar ΔT (temperature difference)
  • Switch package temperature
  • Fiber link CRC error rate
  • Kubernetes pod network latency

Sample Alert Rule:

1
2
3
4
5
6
7
- alert: SwitchOverheat
  expr: switch_temp_celsius > 65
  for: 5m
  labels:
    severity: critical
  annotations:
    summary: Switch temperature critical

Maintenance Schedule

| Task | Frequency | Tools Required | |—————————|———–|————————–| | Thermal pad inspection | Quarterly | Torque wrench, IR camera | | Magnet strength test | Biannual | Shear gauge | | Dust removal | Monthly | ESD-safe vacuum | | Structure integrity check | Annual | Ultrasonic tester |


7. Troubleshooting

Common Issues & Solutions

1. Insufficient Heat Transfer

1
2
3
# Diagnostic steps:
thermal_scan --compare baseline.json current.json
check_contact_pressure --device switch1

Remediation:

  • Increase contact pressure (stronger magnets)
  • Replace thermal pads with higher conductivity material

2. Network Performance Degradation

1
2
# Check for packet drops
ethtool -S eth0 | grep -E 'discard|error'

Tuning Commands:

1
2
# Increase ring buffers
ethtool -G eth0 rx 4096 tx 4096

3. Magnetic Interference

1
2
# Measure EMI with SDR
hackrf_sweep -f 100:6000 -w 1000000 -r interference.csv

8. Conclusion

This Kyoto homelab implementation demonstrates how structural thermal management combined with 10Gbps fiber can create enterprise-grade infrastructure in residential spaces. Key takeaways:

  1. Innovative Cooling: Steel frameworks can dissipate 120W+ with proper thermal coupling
  2. Cost Efficiency: $0.15/W cooling cost vs. $1.50/W for traditional solutions
  3. Space Optimization: Under-desk deployment maintains living space functionality

Next Steps

  • Implement phase-change materials for thermal buffering
  • Explore building-ground electrical isolation techniques
  • Test copper bus bar extensions for greater heat dissipation

Further Resources

This approach redefines homelab potential by transforming structural constraints into performance-enhancing features. As residential internet speeds continue to increase, such creative infrastructure solutions will become essential for DevOps practitioners pushing the boundaries of home-based production systems.

This post is licensed under CC BY 4.0 by the author.