Документ взят из кэша поисковой машины. Адрес оригинального документа : http://hpc.msu.ru/files/hpcmsu/downloads/MSU_CCOE.pdf Дата изменения: Wed May 7 15:31:14 2014 Дата индексирования: Sat Apr 9 22:22:19 2016 Кодировка:

M O S C O W S TAT E U N I V E R S I T Y

C U DA C E N T E R O F E X C E L L E N C E


Moscow State University (MSU) is one of the oldest (since 1755) and largest Russian educational and research centers. MSU is the leading Russian HPC center as well, serving more than 700 research groups from Russian universities and institutes of Russian Academy of Sciences. The agship of MSU HPC facilities is "Lomonosov" supercomputer. Being installed in 2009 with peak per formance of 420 TFlops, it had a number of successive upgrades. The most signi cant upgrades were made on the basis of NVIDIA X2070 accelerators in 20112012. 2130 GPUs brought "Lomonosov " to 1.7 PFlops of the total peak per formance. At the end of 2011 MSU was awarded a highly honored CUDA Center of Excellence status from NVIDIA Corporation. Since then, CCOE MSU has been arranging a number of activities aimed to create a complete GPU HPC infrastructure. This infrastructure should unite all necessar y components for the wide dissemination of GPU technologies in MSU and far beyond. Our activities include installing GPUenabled software on MSU "Lomonosov " supercomputer, a series of trainings and hand-on labs, lectures, contests, scholarships for MSU students, popular articles in "Supercomputers" magazine and so on. Primarily targeted on students, post-graduates and young researchers, these e orts were extremely successful. But as far as our young colleagues are reaching the new horizons, our well-known scientists and researchers dramatically improved their GPU experience as well. Here we'd like to highlight several selected HPC GPU projects of di erent research groups, mostly from MSU, on various topics.


Implementation of the LU-SGS Method for 3D Gas Dynamics on GPU-Accelerated Computer Systems
1st Award of CCOE MSU "GPUs for Superproblems" Contest (2013) LU-SGS solver based on CUDA is usually about 15-30 times faster on GPU compared to 1 CPU core and scalable up to hundreds compute nodes Pavel Pavlukhin, MSU Mechanics and Mathematics Dept., post-graduate, giperchuv@mail.ru

C code without additional libraries, and MPI is used for data transfer between GPUs. Complex overlap scheme (MPI calls, kernel launching, etc.) is used for per formance reasons.

Actual CFD tasks require huge amount of compute resources. New parallel LUSGS algorithm combined with immersed boundar y method was implemented on GPU. Software complex based on this implementation is used for solving CFD problems with various geometr y complicity. Solver is implemented in CUDA

Numerical Simulation of the Ice Moving in Strati ed Fluid
PhD Degree Obtained in 2013 By using GPU we are able to perform computations with higher resolution which gives us an opportunity to study the interaction between sea ice and ocean in greater details Evgeny Mortikov, MSU Research Computing Center, researcher, evgeny.mortikov@gmail.com

The project aims at determining the relevance of ocean strati cation for ice dynamics and at investigating internal wave processes associated with ice motion. Current models of sea ice dynamics don't take into account additional drag component due to generation of internal waves. Improvements of

such models are necessar y for forecasting the future of the Arctic Ocean and the changes in polar ice cover. Stated goals were achieved with the development of the new high resolution computational models able to capture the features of ice underside geometr y and the variation of water density with depth in uid simulations. Implementation of numerical model for GPU clusters is based on CUDA and MPI libraries. Numerical simulations show that the strati cation of water column signi cantly changes the relation between drag force and ice velocity. Moreover,

the presence of di erent drag regimes could explain some of the discrepancies between large scale Arctic Ocean models estimates and the characteristics of ice motion obser ved in nature.


C mputer Simulation of Protein-Protein Complex Formation Using Software Module Which Combines Techniques of Brownian and Molecular D ynamics
3x Winner of CCOE MSU Scholarship (2012-2013) GPU acceleration allows to signi cantly reduce time required for the simulation Vladimir Fedorov, MSU Dept. of Biology, 5-year student, xbgth@yandex.ru

Protein-protein interaction is the basis of the most biological processes. The techniques of Brownian and molecular dynamics were combined and applied to study of protein-protein complex formation of plastoc yanin and c ytochrome f ­ proteins involved in the photosynthetic electron transport chain of chloroplasts of higher plants.

GROMACS package with a hybrid parallel architecture support was used for this. The principle possibility of modeling the process of electron-transport proteins complex formation "from rst principles" and the estimates of the rate of their interaction based only on the structure of proteins were showed. This opens up the possibility of using a combined method of Brownian and molecular dynamics for analysis of electron-transport proteins binding kinetics. Results can be applied to the development of new drugs

in the pharmaceutical, alternative energetics using biohydrogen, and agriculture.

Molecular Mechanisms of Nucleation and Growth of Hydroxyapatite Crystals in the Presence of Osteogenic Peptides
Winner of CCOE MSU Scholarship (2013) Winner of CCOE MSU Scholarship (2013) Using hybrid (CPU+GPU) version of CP2K allowed to solve DFT single-point problem for periodic crystal with about 500 atoms in the elementary cell two times faster Irina Mukosey, MSU Bioengineering and Bioinformatics Dept., 5-year student, irina_irbis@bk.ru

One of the most important problems of modern medicine is a bone tissue regeneration when the large part of bone is destroyed. The common strategy under development is to install prosthesis in the place of

lost or destroyed bone. It is necessar y to design materials and technology for faster replacement of prosthesis to natural bone tissue. CP2K program was used to calculate partial charges of the hydroxyapatite sur faces for further molecular dynamic simulation of interaction of the osteogenic peptides with these sur faces by GROMACS package. Both CP2K and GROMACS packages use CUDA libraries (including cublas and cu t) for internal calculations.


Numerical Simulation of Optical Frequency Combs and Solitons Generation in Microresonators
Winner of CCOE MSU Scholarship (2013) Using CUDA implementation of FFT we obtain 7x speedup over CPU cluster in simulation of large system of coupled ODEs Grigoriy Lihachev, MSU Dept. of Physics, graduate, g.lihachev@gmail.com

Numerical simulations to test and substantiate experimentally motivated hypothesis regarding dynamics of frequency combs and solitons formation in microresonators were per formed. Two models were simulated: coupled modes equations in frequency domain and Lugiato-Lefever equation in time domain. The series of precisely spaced spectral lines that form an optical frequency comb

enable an unprecedented measurement capability in precision spectroscopy, frequency metrology, and microwave photonics. CUFFT librar y (CUDA 5.5) was used to calculate nonlinear term

in large system of ordinary di erential equations (coupled modes equations) and in split-step Fourier method.

GPU Acceleration of Marine Hydrodynamics in OpenFOAM
"Supercomputers" Magazine Award of CCOE MSU "GPUs for Superproblems" Contest (2013) The use of developed library allowed us to decrease up to twice the time of simulation comparing with original OpenFOAM methods, namely GAMG. According to our estimations, solver can be made 2x or even faster with some additional code improvements Boris Krasnopolsky, MSU Institute of Mechanics, researcher, krasnopolsky@imec.msu.ru Alexey Medvedev, T-Services, alexey.v.medvedev@gmail.com

Modeling of unsteady hydrodynamics for objects with complex geometr y is a computationally expensive problem, which takes a long time. Any successful attempts to decrease this time, including the use of GPU accelerators, are of

high practical importance. GPU accelerators are used to speed up the most computationally intensive part of CFD simulations ­ solution of SLAEs. GPU part of the developed librar y is a result of original research and it contains designed algorithms and theirs C/C++ implementations with a limited use of code fragments, adopted from CUSP librar y. An OpenFOAM plug-in was developed to use Kr ylov subspace iterative methods and multigrid methods on GPU, which are implemented in SLS librar y.


Applying Multi-GPU for Monte -Carlo Multidimensional Numerical Integration
"The Largest Application" Award of CCOE MSU "GPUs for Superproblems" Contest (2013) Using a single GPU allows to increase the performance of Monte-Carlo integration in 40100 times compared to a single CPU. Using Multi-GPU allows to increase the performance of Monte-Carlo integration proportionally to a number of available GPU nodes Lev Barash, RAS Landau Institute for Theoretical Physics, researcher, barash@chg.ru Lev Shchur, RAS Landau Institute for Theoretical Physics, professor, shchur@chg.ru

Monte-Carlo multidimensional numerical integration has numerous applications in par ticle physics, in computational nances, and in other areas. Recent algorithms ( T. Hahn, Comp. Phys. Commun. 176, 2007, 712.713; J. Kanzaki, Eur. Phys. J. C., 2011, 71:1559) were generalized in order

to use Multi-GPU for Monte Carlo numerical integration. The new software package was developed using CUDA and MPI technologies. Figures show parallelization e ciency and its saturation.

Solution of the Inverse Problems of 3D Ultrasound Tomography Using NVIDIA GPUs
Special NVIDIA Award of CCOE MSU "GPUs for Superproblems" Contest (2013) The mere use of faster GPU memory allows the computations to be sped up by a factor of 20-30 compared to a one cluster core Alexander Goncharsky, MSU Research Computing Center, professor, gonchar@srcc.msu.ru Sergey Romanov, MSU Research Computing Center, researcher, romanov60@gmail.com Sergey Seryozhnikov, MSU Research Computing Center, researcher, s2110sj@gmail.com

The project focuses on the development of e cient methods for solving nonlinear inverse problem of 3D ultrasound tomography as coe cient inverse problem for wave equation. The algorithms are primarily targeted to the development

of ultrasound tomographs for di erential diagnosis of breast cancer. Software package for GPU-based supercomputers was developed. The OpenCL interface was used for GPU programming. Computations were performed on 24 GPUs NVIDIA Tesla X2070. nonlinear coe cient inverse problem with more than 100 million unknowns have been solved. The quality of reconstruction is very good so that even small irregularities with sizes ~2 mm are restored fairly well. The developed algorithms t very well the structure of GPU-based supercomputers.


GPU Education
A special attention CCOE MSU pays to education. Our educational activities include: · short (2-3) days trainings on NVIDIA GPU programming technologies; · special 1-term courses at the Computational Mathematics and Cybernetics Department of MSU; · annual "NVIDIA HPC Day at MSU" event carried in autumn; · annual "Summer Supercomputing Academy " with a special GPU programming technologies track; · GPU Computing Meetup group; · "Parallel Computing on GPU: Architecture and Programming Models" textbook proposed to publish in the frame of the national "Supercomputing Education" project; · scholarships for MSU students; · popular articles in Russian "Supercomputers" magazine.

Welcome!
As the leading Russian supercomputing center, MSU hosts a large number of various HPC projects and activities. To get more, please meet us on exhibitions: · International Supercomputing Conference (ISC'14): Leipzig, Germany, June 23-25, 2014, booth 753; · SuperComputing (SC'14): New Orleans, LA, USA, November 17-20, 2014, booth 4035.


MOSCOW STATE UNIVERSITY
ESTABLISHED IN 1755

40 000+ STUDENTS 41 FACULTIES 350+ DEPARTMENTS 5 MA JOR RESEARCH INSTITUTES

MSU CUDA CENTER OF EXCELLENCE
ESTABLISHED IN 2011

CCOE.MSU.RU