No 14.Z50.31.0024. “ ! "
WMS #
!# " ! , # , ( !%
PanDA
! ”. # XVII $ % DAMDID/RCDL’2015 « )*
$ # ! ! , # # ) , # ( () ( &
% ( ! . 1 ' ' , 2 # (3 ). '+ 0 ) ! & $ & . . 1
$ ( '+ , & ' ' $ ($ " ( ( . " ( %
, *
$ # ( “ ! " $ ' * & $ '$ & », 13-16 ( ' ' ( # -# “ !
# , ( # ! , & 1.1 "
" $ % &!)*
' ' # $ , !# ( & ( and Distributed Analysis”) [2], # &! ( ' '
( 2 # “# & 2 # !
% & 0 & % # # &
' $ '!)* $ $ !# ()* * !# $ [3].
# 3 ” ' ' ( $ # !) ' ' $ ( # & # ( & / # ) % & PanDA, ( ' $ ($ ! $ ( !
PanDA (
& ' % # %
# &! PanDA (“Production 2007 % ! # , &
ATLAS, ' # PanDA $ # ! ! . 1 #
% ( ! 0 ( , $, ' # % !## - & # #
( # & & ! ATLAS % .
% ' # $ & # $ ! ! .
PanDA # & ' '+ # ( ! #
( & , # $.
$ ! (
# ' '* $ ! & ' !
% &!)* 2. ! ATLAS # $ WLCG #
100000 2015 %.
!# & ! '+ ( ( & ( (# # $ ( $
), 0 & ( () (: 2 # & !#
! 0 : . 2. $
& ' 1 > & 0 # # ' ' ! # . ' &
' ! , # % , ( % ,
, ( #
& # & Pilot
, !) ( &
( () ( !) ( $ ( ! !) & ()*!) , # ' $ &
, # & #! ! )*
)* ,
, & ! & !# .
# & (. , ! $ # ' $ & 3, # '! ,
, ! . 4.
$ !& ( '
# . 5. $ , # ! $ , 0! * !#
, 0! ' & #! #
0 ! # # & # # 1
0 # & #! $ & & ' (), # '+ 0 % $ & ! () ( ,
& $ # !
& & & #! & ! ! ! & ( ( , $ % ( % 0 % # ( !& ) $ 2.3 )
F ( & & ' & #! # # $ ' # # !& & $ '*
)
InfiniBand DDR, !) # ( 20,5 ' 144 ' . H $
# ( & ( ( & ( ( ! # $ ( # ( ( # ( ( # ( % ( # !# !) # !&
,
( % $ !, ( . 6. F “ ! , & # !* & ( ( # % ( $ & # %
! ” % ( ( & #!
) ( !# # » !# 0 !# « ! # # ) ! SSH
, SLURM. F ( # & 0 0 ! ( ' 2 #
CERN.
!*
ATLAS #!
ATLAS. F (
# !#
( PanDA,
% & ATLAS,
!# ! ! # ) & $ 0 ' ! ”. " $
$ & 0 ( ).
% ( ' # . M ! .URL: http://bioinf.spbau.ru/ru/quast
Integrated Workload and Data Management System in a Heterogeneous Computing
Infrastructure
In this paper an approach to manage computing powers of grids, cloud platforms, supercomputers as well as university and research clusters for computational tasks in data intensive domains is described. This approach uses the experience of the workload management system PanDA (Production and distributed analysis) which was developed at CERN for the ATLAS experiment. Based on this approach, we designed and implemented Workload and Data Management System (WDMS) at NRC “Kurchatov institute”. WDMS is currently in production for High Energy and Nuclear Physics and bioinformatics applications and it can be used for other data- and compute-intensive scientific workflows.