;docx

Суперкомпьютерные решения на
базе технологий HP
Школа-тренинг по углубленному изучению технологий
программирования графических процессоров
NVIDIA CUDA 2014, Новосибирск
Юдин Андрей
Ведущий технический консультант
Отдел подготовки технических решений
HP Россия
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HPC – Formula 1 в мире ИТ
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Why Is HPC Becoming So Important To Nations?
Worldwide political leaders increasingly recognize this trend:
• In 2009, Russian President Dmitry Medvedev warned that without more investment in
supercomputer technology, “Russian products will not be competitive or of interest to
potential buyers.”
• In June 2010, Rep. Chung Doo-un of South Korea’s Grand National Party: “If Korea is to
survive in this increasingly competitive world, it must not neglect nurturing the
supercomputer industry, which has emerged as a new growth driver in advanced
countries.”
• The Korean National Assembly then called for the creation of a national five-year
plan for advancing HPC
• In February 2012, the European Commission announced that it has adopted a plan to
double spending on HPC to €1.2 billion, with much of that money aimed at the
installation of additional petascale supercomputer systems
3
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HPC is all around you
4
Engineering/
Manufacturing
Engineering/
Manufacturing
Life Sciences
GeoSciences
•Structural Analysis
•Fluid Dynamics
•Impact Modeling
•Big Data
•Electrical Design
•Circuit Verification
•Board Layout
•Drug design
•Next gen sequencing
•Bio Informatics
•Big Data
•Seismic
•Reservoir Modeling
•Big Data
Government /
Classified
Government/
Academic Research
•Cryptography
•Military/Security
•Nuclear Safety
•Big Data
•Particle Physics
•Life Sciences
•Climate Modeling
•Big Data
Financial
Services
•Financial Analytics
•High Freq Trading
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Media &
Entertainment
•Rendering
•Gaming
•Big Data
Общая архитектура HPC решения
5
5
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
© Copyright 2010 HPDC
Вычислительный кластер – большая интеграционная
работа
6
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
ONLY WITH AN
UNDERSTANDING OF
APPLICATIONS CAN ONE TRULY
DESIGN AN APPROPRIATE
SOLUTION
7
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
©2009 HP
Профилирование приложений
*
8
*
*
*HP has characterized
*HP starting characterization work
*
*
*
*
*
HP CONFIDENTIAL
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
8
© Copyright 2010 HPDC
*
*
*
*
*
инфраструктура
для HPC
HPКонвергентная
UNIFIED CLUSTER
PORTFOLIO
HP Unified Cluster Portfolio
Все что необходимо для HPC
решений
Индустриально стандартные
компоненты, референсные
архитектуры: сервера,
интерконнекты, электропитание, ПО
Масштабируемые СХД
обеспечивающие необходимые
объемы хранения данных и
производительность
Кластерное и системное ПО для всех
компонент; Сотрудничество с ISV
Тех.поддержка решения целиком, а не
отдельных
«кирпичей»Адаптируемая –
наращиваемая; new innovation
9
9
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
©2010 HP Confidential
HP - №1 в мире HPC
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
22 Years of Innovation with Industry-leading capabilities
ProLiant Servers
1989
1990s
1st x86 server
(SystemPro)
1st multi-processor
x86 server
2000s
1st remote mgmt
1st rack mount
1st AMD servers
1st Integrated x86
server management
Virtual Connect
2007
1st Virtual Connect
Module
2008
2009
2010
1st Scalable VC
Management
1st Flex-10
Module
1st FlexFabric
Module
HP Storage
1989
1990s
2004
1st RAID cache
1st Dual parity
RAID
st Large scale
st
1
RAID with
1 Fiber
direct
connect
RAID 6/ADG
Channel
1st
11
2012
2009-10
1st Blade server
1st Energy Star server
st
1 Sea of Sensors
1st Terabyte Blade
st
1 Dynamic Power
1st 10 Gb FlexFabric
Capping
Embedded
1st Embedded
Management (iLO)
2005
1st
SAS
storage
2007-8
1st
1st Active Health
1st Sea of Sensors 3D
1st Smart Memory
1st Location-based
intelligence
2012
1st Flex-10 Module
with native hardware
DCB support
2010
Storage blade
1st Tape blade
1st Blade DAS
1st
solution
1st
Flash Back
Write Cache
Integrated blade
SAN Solution
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
2012
1st
Smart Storage
1st Advanced
data mirroring
HP ProLiant - the x86 server market leader 1
In all regions, platforms, processors, OS; by revenue and by units
Worldwide
12
Europe
Source: herein
IDC’s WorldWide
Quarterly
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained
is subject to
change Server
withoutTracker,
notice. February 28, 2012, by Units.
ISC’13 & 41st TOP500 list
HP - #1 WW
HP - #1 в России
HP
HP
37,5% (180)
IBM
Bull
Fujitsu
Del
13
RSC
Cray Inc.
SGI
32% (160)
50% (4)
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
T-Platforms
HPC - всегда проблема выбора
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Трансформация технологий в HPC
Performance
HP leading this transition
x86 clusters,
with Linux
• Unified Cluster
Portfolio
• HP Cluster Platforms
• Insight Cluster
Management Utility
15
15
Multi-core,
and
InfiniBand
• Catalyst partner program
for multi-core software
• 1st IB support for Blades,
• Focused MPI optimization
for IB
GPGPUs/coprocessors
• Early community
and customer
engagement
• 1st GPU-enabled
servers
• SL’s integrated
support
• Extensive benchmarking
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Low power
computing
• Discovery lab
• Ecosystem
development
• Commercialization
Процессорные конфигурации
Main Stream
Специализация НРС
16
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Сервер – основа HPC решения
• Количество;
• Цена всего решения;
• Ключевые компоненты:
• Процессор (CPU % CPU+GPU);
• Память;
• Интерконекты;
• Функциональность
• Управляемость
• Обслуживаемость
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Портфель серверных продуктов HP
Оптимизированы для любых нагрузок и моделей использования
ML
18
DL
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
SL
BL
Intel® Xeon® E5-2600 v2 Families (Ivy Bridge EP)
What is Ivy Bridge?
Intel Xeon Processor
E5-2600 v2
Socket compatible replacement for the
E5-2600 series processors
•
•
Up to 35% higher performance
•
•
•
•
•
Up to 30MB
Shared Cache
4 channels of up to
DDR3 1866 MHz
memory
Integrated
PCI
Express* 3.0
Up to 40
lanes
per socket
•
Called the E5-2600 v2 series processors
Up to 12 cores
Up to 1866 MHz memory supported
Up to 30MB Shared Cache
Same power envelope
Additional security features (Intel Secure
Key, Intel OS Guard)
* Other names and brands may be claimed as the property of others
19
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP Restricted - HP & Partner Internal Use; Customer Viewable under NDA. Subject to change without notice.
Ускорители вычисленийрабочих станций
options: accelerator solutions
NVIDIA Tesla K10
NVIDIA Tesla K20
NVIDIA Tesla K20X
NVIDIA GRID K1
NVIDIA GRID K2
Intel Xeon Phi 5110P
Intel Xeon Phi 7120P
20
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Серверная ПЛАТФОРМА HP ProLiant SL
SL6500 Scalable System
21
SL4500 HyperStorage Series
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
SL6500
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP ProLiant SL230s Gen8 1U Half Width Tray
Rear Kit Options
• 2 – 3.5 HDDS
• 4 – 2.5 HDDs
• 4 – SDD’s
• 1- GPU
Air Flow Exhaust
Chassis Interface Port
8 Nodes per 4U chassis
16 CPUs per 4U chassis
8 GPUs per 4U chassis
2 Socket-R CPUs
PCIe Expansion Slot
Or
Hot-Plug HDD
Or
Fusion I/O Accelerator
16 DIMM Slots
Flex Fabric Slot
Or
Hot-Plug HDD
Management
Port – iLO4
1- Serial Port
2- 1GbE Ports
SID Tab – System Identification
SUV Port – Serial/USB/Video
2013 Hewlett-Packard
Development Company, L.P. The information contained herein is subject to change without notice.
23 23© Copyright
© Copyright
2010 HPDC
HP ProLiant SL250s Gen8 2U Half Width Tray
Rear GPU
Air Flow Exhaust
Chassis Interface Port
1-3
Phi/GPU
2 GPU Tray
4 Nodes per 4U chassis
8 CPUs per 4U chassis
12 GPUs per 4U chassis
2 Socket-R CPUs
(Below GPU Tray)
PCIe Expansion Slot
16 DIMM Slots
(Below GPU Tray)
Flex Fabric Slot
Management
Port – iLO4
SUV Port – Serial/USB/Video
2- 1GbE Ports
1- Serial Port
SID Tab – System Identification
2013 Hewlett-Packard
Development Company, L.P. The information contained herein is subject to change without notice.
24 24© Copyright
© Copyright
2010 HPDC
HP ProLiant SL270s Gen8 4U Half Width
Tray
Air Flow Exhaust
1-8
Phi/GPU
Chassis Interface Port
2 Nodes per 4U chassis
4 CPUs per 4U chassis
16 GPUs per 4U chassis
8 GPU Tray
2 Socket-R CPUs
(Below GPU Tray)
16 DIMM Slots
(Below GPU Tray)
Flex Fabric Slot
PCIe Expansion Slot
8 Hot Plug Drives
Management
Port – iLO4
2- 1GbE Ports
SUV Port – Serial/USB/Video
1- Serial Port
SID Tab – System Identification
2013 Hewlett-Packard
Development Company, L.P. The information contained herein is subject to change without notice.
25 25© Copyright
© Copyright
2010 HPDC
SL4500
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP ProLiant SL4500 HyperStorage
SL4540 & SL4545
(1 X 60 HDD)
SL4540 & SL4545
(2 X 25 HDD)
SL4540 & SL4545
(3 X 15 HDD)
Object Storage
Email
Hadoop
2 node
3 node
1 node
27
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Шасси HP ProLiant SL4500 HyperStorage
Вид спереди и сзади
Серверный узел
(SL4540 Gen8 или SL4545 G7)
2 дисковые корзины
(30 LFF SmartDrive дисков горячей
замены в каждой)
5 вентиляторных модулей горячей
земены
(2 вентилятора/модуль)
Модуль вводавывода
Индикация жестких дисков
До 4-х блоков питания горячей
замены
Модуль
управления
2 SFF SmartDrive
диска горячей
замены
Кнопка
извлечения
серверного узла
Индикация UID, состояния,
Кнопка включения, 2 порта
USB,
Видео-выход
28
Лицевая панель
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Вид сзади
Look at the SL4500 Single node
Вид внутри
Сервер
(SL4540 Gen8
или SL4545 G7)
2 дисковые корзины
(30 LFF SmartDrive
дисков горячей
замены в каждой)
29
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
5 вентиляторных модулей горячей
земены
(2 вентилятора/модуль)
Модуль вводавывода
Рабочие узлы Hadoop - ProLiant SL4540 vs. ProLiant
DL380e
Full-Rack Capability
Per Node (2U)
HP ProLiant DL380e Gen8
core/spindle 12:12
Processor 12 Cores
Dual Six-Core Intel® per server
Storage
2U
36 TB
(recommended)
(12x3TB SATA Drives)*
Memory
Network
384 GB
4 NICS
20 Servers (20 Chassis)
2 Network Switches
240 cores
240 spindles
720 TB Disk space
1G NICs(10GbE optional)
(4x1GbE NICs per Server)
* Additionally, 2 SFF 2.5 inch SATA/SSD hot plug hard drives available at the front of the server for OS/boot
HP ProLiant SL4540 Gen8 - 3x15
Per Node (1.43U)
Full-Rack Capability
core/spindle 16:15
Processor 16 Cores
Dual Eight-Core Intel® per server
4.3U
Storage
Memory
Network
30
45 TB
(15x3TB LFF 3.5 inch SAS/SATA
hot plug hard drives per server)*
192 GB
4 x 1GbE NICs
2x 10GbE & 2x
1GbE NICs
(+PCI Card) **
27 Servers (9 Chassis)
3 Network Switches
432 cores
405 spindles
1.2 PB Disk Space
1G NICs(10GbE optional)
* Additionally, 2 SFF 2.5 inch SATA/SSD hot plug hard drives available at the front of the server for OS/boot purposes
4 xto1GbE
ports
via PCInotice.
Card for Apples vs. Apples comparison
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein**Added
is subject
change
without
HP ProLiant SL4500
На 30% выше плотность размещения данных при том же уровне энергопотребления *
На 20% ниже энергопотребление, цена и занимаемое пространство при равном объеме данных
На 45% меньше кабелей для подключения шасси
HP ProLiant SL4540 Gen8 HyperStorage System
HP ProLiant SL4545 G7 HyperStorage System
*По сравнению со стандартным сервером и подключенной к нему СХД (JBOD)
31
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
hp.com/go/ProLiant/BigDataServer
32
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP трансформирует серверный рынок
Project «Moonshot»
Project «Odyssey»
Project «Voyager»
Delivering the future of
extreme low-energy servers
Redefining the future of
mission-critical computing
Redefining the expectations
and economics of data
centers
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP Moonshot System
Первые в мире программноопределяемые серверы
• Масштабируемость;
• Ускорение инноваций;
• Специализация вычислений.
34
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Обзор шасси HP Moonshot 1500
Платформа для ИТ-сред нового поколения
45 картриджей с горячей заменой
• 1-нодовые = 45 серверов в шасси
• 4-нодовые =180 серверов в шасси
• вычислительный узел, узел хранения или их комбинация
• x86 , ARM или карты-ускорители
35
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
2 внутренних коммутатора
• Коммутатор HP Moonshot-45G
(порты 45 x1Gb)
Кардинальное упрощение и сокращение
Radically changing economics of IT
Example:
“Redstone” Server
Traditional x86
$1.2M
$3.3M
89%
94%
63%
93%
400 servers in 10 racks
20 switches
1,600 cables
91 kilowatts
36
less energy
less space
less cost
less HW complexity
Based on weighted average performance projections
for workloads such as web serving, memcached, and
Data Analytics. Cost estimates include infrastructure,
space, and power and cooling costs over three years.
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
1,600 servers in 1/2 rack
2 switches
41 cables
9.9 kilowatts
Первые в мире программно-определяемые серверы
Архитектура для новых реалий ИТ
Архитектура Moonshot
10:1 по масштабируемости*
Программно-определяемые серверы
Специализация под приложения
8x эффективнее *
Скорость внедрения инноваций
3x быстрее*
Платформа HP Moonshot
*Source: HP internal research
37
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Спасибо!
[email protected]
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Download Report