Networking Resources
Our local-area network (LAN) supports high-speed connections and data transfers for all HECC supercomputing systems, visualization systems, and other resources. The LAN is composed almost entirely of Cisco Systems® equipment and has a 10 gigabit (GigE) Ethernet backbone supporting both 1 G and 10 G hosts.
Network Systems Facts
- 1,172 TB inbound annually, averaging 98 TB/month
- 961 TB outbound annually, averaging 80 TB/month
- The network contains 914 active ports supporting NAS supercomputing and visualization systems
- 838 GigE Ethernet ports
- 76 10-GigE Ethernet ports
- Maximum bandwidth available: 1.6 TB per second
- Total number of HECC sub-networks: 75
- 8 Ethernet networking devices, including:
- 6 Cisco 6500 Catalyst L3 switches for public, private, management connections, including SGI CXFS
- 2 Cisco 4948 switches for CXFS in building N233 at Ames
- 4 separate VPN domains within the supercomputing network
Cabling Infrastructure
The network cabling infrastructure is modular, flexible, and quickly reusable.
- 8 sub-floor panels with a capacity of 96 ports of copper and fiber
- Capacity for 3,456 connections in the cabling infrastructure of the supercomputing network
- Nearly 10 miles of fiber and 10 miles of copper cabling are currently in use for Ethernet and fiber channel networks, and up to 20 miles of each could be supported by the infrastructure
- Largest InfiniBand® (IB) network in the world, with over 63 miles of cabling
- Three distinct IB: two for Pleiades, one for Columbia
- Three 24-port Voltaire ISR9024D-M SDR/DDR switches
- One 24-port Voltaire ISR9024D switch
- Seventy-two 24-port Voltaire ISR2012/ISR2024 DDR switches
- One 24-port Voltaire ISR9024S SDR switch
- One 24-port Mellenox Infiniscale®-IV QDR switch
- One 36-port Voltaire 4036 QDR switch
- 2,417 IB switches
- 44,304 switchports
- 19,080 IB host connections