Warning, /DPGAnalysis/HcalTools/scripts/psm/readmeDEF is written in an unsupported language. File is not indexed.
0001 !!!!!!!!!!!!!!
0002
0003
0004 !!!!!!!!!!!!!!
0005
0006
0007
0008 Warning: before use correct everywhere below the letters:
0009 ...qq7/CMSSW_12_2_0_pre2... for needed dirs.
0010
0011
0012
0013 !!!!!!!!!!!!!!
0014
0015
0016
0017 I.SELECTION OF RUNS FOR EACH ERA
0018 ==============================
0019
0020 1. fill into files (ztmpHcalNZS_A,...E...HI) all list of runs for each
0021 dataset era (...Run2018A-v1,..E....HI..) using commands:
0022
0023 dasgoclient --query="run dataset=/HcalNZS/Run2018A-v1/RAW" --limit=0 > ztmpHcalNZS_A
0024 dasgoclient --query="run dataset=/HcalNZS/Run2018B-v1/RAW" --limit=0 > ztmpHcalNZS_B
0025 dasgoclient --query="run dataset=/HcalNZS/Run2018C-v1/RAW" --limit=0 > ztmpHcalNZS_C
0026 dasgoclient --query="run dataset=/HcalNZS/Run2018D-v1/RAW" --limit=0 > ztmpHcalNZS_D
0027 dasgoclient --query="run dataset=/HcalNZS/Run2018E-v1/RAW" --limit=0 > ztmpHcalNZS_E
0028 dasgoclient --query="run dataset=/HIHcalNZS/HIRun2018A-v1/RAW" --limit=0 > ztmpHcalNZS_HI
0029
0030 2. specify in file rundate.sh the line with ...dataset=...
0031 and correct the line:
0032 mv index_selection.html index_selectionA(B...).html
0033
0034 and use obtained txt file ztmpHcalNZS_A(B...)
0035 and execute one of the commands:
0036
0037 ./rundate.sh ztmpHcalNZS_A > ztmpA
0038 ./rundate.sh ztmpHcalNZS_B > ztmpB
0039 ./rundate.sh ztmpHcalNZS_C > ztmpC
0040 ./rundate.sh ztmpHcalNZS_D > ztmpD
0041 ./rundate.sh ztmpHcalNZS_E > ztmpE
0042 ./rundate.sh ztmpHcalNZS_HI > ztmpHI
0043
0044 (file index_selectionA(B...).html is created )
0045
0046 3. use file index_selectionA(B...).html to select runs
0047 of needed size and only 1 run per day(last one),
0048 with comparison with
0049 https://cms-service-dqm.web.cern.ch/cms-service-dqm/CAF/certification/Collisions18
0050 /13TeV/PromptReco/Cert_314472-325175_13TeV_PromptReco_Collisions18_JSON.txt
0051
0052 , create txt files:
0053 runtime_runA(B...)
0054 runlist_runA(B...)
0055
0056
0057 II. running of main cc-kode (creation of root files)
0058 ===================================================
0059 1) interactively
0060 (w/o config.Data.lumiMask =
0061 'https://cms-service-dqm.web.cern.ch/cms-service-dqm/CAF/certification/Collisions18
0062 /13TeV/PromptReco/Cert_314472-325175_13TeV_PromptReco_Collisions18_JSON.txt'
0063 )
0064 - necessary corrections:
0065 1. correct file "file_lists.csh" for dataset used
0066 2. correct file "runlist_runA(B...)" to specify run list
0067 - running:
0068 ./mkcfg_new120.csh runlist_runA(B...)
0069 - see, how many py-files in PYTHON_runlist_run dir..
0070 - run ~ 15 jobs per PC: 1-15, 15-30, ...nn1- NN using commands:
0071 ./run_interactive.csh runlist_run nn1 NN
0072
0073 2) using crab:
0074 see https://cms-service-dqm.web.cern.ch/cms-service-dqm/CAF/certification/Collisions18/13TeV/PromptReco/
0075 - correct: PSM_Global_2018_cfg.py
0076 - for each run correct and use scripts:
0077 crab_NZS2018C_1(2...).py
0078 - running:
0079 source /cvmfs/cms.cern.ch/crab3/crab.csh
0080 source /cvmfs/cms.cern.ch/crab3/crab_standalone.csh
0081 setenv SCRAM_ARCH slc7_amd64_gcc900
0082 cmsenv
0083
0084 crab submit -c crab_NZS2018C_1(2...).py
0085
0086 to check(kill) use:
0087 crab status
0088 crab status -d ./crab_20200212_101405
0089 crab tasks
0090 crab tasks --days
0091 crab kill -d ./crab_20200212_101405
0092
0093 III. visulization on GlobalPSM sajt
0094 ==================================
0095 -- (using script cp_runs_fromeos_into_longruns.sh )
0096 - merge pices of root files into one big run-root file:
0097
0098 ./cp_runs_fromeos_into_longruns.sh runlist_runA /afs/cern.ch/work/z/zhokin/hcal/qq7/CMSSW_12_2_0_pre2/src/DPGAnalysis/HcalTools/scripts/psm/longruns
0099 ./cp_runs_fromeos_into_longruns.sh runlist_runB /afs/cern.ch/work/z/zhokin/hcal/qq7/CMSSW_12_2_0_pre2/src/DPGAnalysis/HcalTools/scripts/psm/longruns
0100 ./cp_runs_fromeos_into_longruns.sh runlist_runC /afs/cern.ch/work/z/zhokin/hcal/qq7/CMSSW_12_2_0_pre2/src/DPGAnalysis/HcalTools/scripts/psm/longruns
0101 (input dir is /eos/cms/store/user/zhokin/PSM/HcalNZS/2018 ;
0102 see: ll /eos/cms/store/user/zhokin/PSM/HcalNZS/ )
0103
0104 -- for each run, put root files into dir./eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/GlobalPSM/histos :
0105 cp /afs/cern.ch/work/z/zhokin/hcal/qq7/CMSSW_12_2_0_pre2/src/DPGAnalysis/HcalTools/scripts/psm/longruns/* /eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/GlobalPSM/histos/.
0106
0107 -- fill table on GlobalPSM sajt: add new runs
0108 https://cms-conddb.cern.ch/eosweb/hcal/HcalRemoteMonitoring/GlobalPSM
0109 - correct file index_toAddOnlyNewRuns_EOS.sh for "dasgoclient.. dataset=..." and "k="
0110 and then use scripts:
0111 ./index_toAddOnlyNewRuns_EOS.sh runlist_runA
0112 ./index_toAddOnlyNewRuns_EOS.sh runlist_runB
0113 ./index_toAddOnlyNewRuns_EOS.sh runlist_runC
0114 ./index_toAddOnlyNewRuns_EOS.sh runlist_runD
0115
0116 At that, check index_draft.html and if everything is ok, copy it:
0117 cp index_draft.html /eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/GlobalPSM/index.html
0118
0119 -- to visualize PSM-plots for each new run, use script:
0120 ./GlobalPSM_EOS.sh runlist_all
0121 (during this running, for each run, new dirs like GLOBAL_runnumber
0122 will be created in dir.
0123 /eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/GlobalPSM )
0124
0125 IV. use of AMT scripts
0126 =====================
0127 -- use macro zGlobalamtTimeDependenciesPhiSymmetryHE.cc
0128 in dir
0129 cd /afs/cern.ch/work/z/zhokin/hcal/qq7/CMSSW_12_2_0_pre2/src/DPGAnalysis/HcalTools/macros/amt
0130 - create dirs.
0131 zamtPhiSymmetryHElin
0132 zamtPhiSymmetryHElog
0133
0134 - ./compile.csh zGlobalamtTimeDependenciesPhiSymmetryHE.cc
0135 - ./zGlobalamtTimeDependenciesPhiSymmetryHE.cc.exe
0136
0137 cd zamtPhiSymmetryHElog
0138 gnome-open *.png
0139
0140 -- visualization:
0141 - correct files in dir:
0142 /eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/AMT/index.html
0143 and mainly here:
0144 /afs/cern.ch/cms/CAF/CMSALCA/ALCA_HCALCALIB/HCALMONITORING/AMTweb
0145
0146 -see site:
0147
0148 https://cms-conddb.cern.ch/eosweb/hcal/HcalRemoteMonitoring/AMT
0149
0150 https://cms-cpt-software.web.cern.ch/cms-cpt-software/General/Validation/SVSuite/HcalRemoteMonitoring/AMT/HE.html
