Warning, /DPGAnalysis/HcalTools/scripts/cmt/Readme is written in an unsupported language. File is not indexed.
0001 --------------------- For RUN3: Global runs of 2021,2022,...
0002 ======================================================
0003
0004
0005 I. ------- Preparation of framework:
0006 =====================================
0007
0008 ssh lxplus
0009
0010 cd your_working_dir
0011
0012 setenv SCRAM_ARCH slc7_amd64_gcc10
0013
0014 cmsrel CMSSW_12_3_0_pre4
0015
0016 cd CMSSW_12_3_0_pre4/src
0017
0018 cmsenv
0019
0020 git cms-addpkg DPGAnalysis/HcalTools
0021
0022 cd DPGAnalysis/HcalTools
0023
0024 II. ----- Compilation of main code CMTRawAnalyzer.cc
0025 ======================================================
0026
0027 scram b
0028
0029 cd your_dir_CMSSW_12_3_0_pre4/src/DPGAnalysis/HcalTools/scripts/cmt
0030 ( this is initial_dir )
0031
0032 IIIa.------- Necessary corrections:
0033 ======================================
0034
0035 1) correct file "file_lists.csh" for dataset used
0036 on DAS site : https://cmsweb.cern.ch/das/
0037 issue the command:
0038 (as example:)
0039 dataset run=346512
0040 and see the dataset names containing RAW, NZS Hcal, like:
0041 /HcalNZS/Commissioning2021-v1/RAW
0042
0043 2) correct file "runlist_run" to specify run list
0044
0045 IIIb.------- Possible corrections:
0046 ======================================
0047
0048 1) see https://twiki.cern.ch/twiki/bin/view/CMSPublic/SWGuideFrontierConditions#HLT_reconstruction_Global_tags
0049
0050 and specify in file " a.py.end " the HLT name in line "process.GlobalTag.globaltag ..."
0051
0052
0053 IVa. ------- Running interactively:
0054 ====================================
0055 setenv SCRAM_ARCH slc7_amd64_gcc10
0056 cmsenv
0057 voms-proxy-init -voms cms -rfc
0058
0059 ./mkcfg_new120.csh runlist_run
0060
0061 - see, how many py-files in PYTHON_runlist_run dir..
0062
0063 - run ~ 15 jobs per PC: 1-15, 15-30, ...nn1- NN using commands:
0064
0065 ./run_interactive.csh runlist_run nn1 NN
0066
0067 IVb. ------ Running using condor.jdl:
0068 ======================================
0069
0070 - specify if necessary the lines in file run_condor.csh :
0071
0072 setenv SCRAM_ARCH slc7_amd64_gcc10
0073
0074 cmsrel CMSSW_12_3_0_pre4
0075
0076 cd CMSSW_12_3_0_pre4/src
0077
0078 - and line with eos-directory,
0079 where you are going to record the resulting root files:
0080
0081 /eos/cms/store/user/zhokin/CMT/RootFilesToBeMarched/2022
0082
0083
0084 - specify the line "Transfer_Input_Files =" in file condor.jdl :
0085
0086 namely, correct path for CMTRawAnalyzer.cc, CMTRawAnalyzer.h and BuildFile.xml
0087
0088 (and specify IF NECESSARY runlist_run name used "arguments = runlist_run ..."
0089 or just as example: cp runlist_craft runlist_run)
0090
0091 ------ In advance, before condor starting issue commands:
0092
0093 voms-proxy-init -voms cms -rfc
0094
0095 voms-proxy-init -voms cms -rfc -out /afs/cern.ch/user/z/zhokin/private/x509up
0096
0097 chmod +x /afs/cern.ch/user/z/zhokin/private/x509up
0098
0099
0100 - to start, issue main command:
0101
0102 condor_submit condor.jdl
0103
0104 - running...... wait, check using condor commands like:
0105
0106 condor_q
0107 (see condor commands: https://twiki.cern.ch/twiki/bin/view/CMSPublic/CompOpsGlideinWMSCondorCommands )
0108 condor_history |grep zhokin
0109 (condor_rm 3748513.0 (it's to remove all jobs 3748513.0))
0110
0111 see obtained root files in dir:
0112
0113 cd /eos/cms/store/user/zhokin/CMT/RootFilesToBeMarched/2022
0114
0115 V. ------------------- Copying:
0116 ======================================
0117
0118 all good root files to be copied into /initial_dir/longruns/.
0119 (example:
0120 scp Global*.root /afs/cern.ch/work/z/zhokin/hcal/qq8/CMSSW_12_3_0_pre4/src/DPGAnalysis/HcalTools/scripts/cmt/longruns/.
0121 )
0122 check all root-files availability:
0123
0124 cd /initial_dir
0125 ./checkoutput120.csh PYTHON_runlist_run longruns > tmp.txt
0126
0127 see file tmp.txt and missed_run_parts to see which root file still to be reproduced:
0128 crashed jobs to be re-runned interactively and copied into dir longruns/.
0129
0130 - merging run-root-piecies into one big run-root file:
0131
0132 ./glu_runs_fromfile.csh longruns runlist_run
0133
0134 - copy into /eos using examples like:
0135
0136 eos cp Global_325001.root /eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/CMT/histos/Global_325001.root
0137 or
0138 cp Global_555555.root /eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/CMT/histos/Global_555555.root
0139 cp Global_345821_1.root /eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/CMT/histos/Global_345821.root
0140
0141 - for check:
0142 eos ls -l /eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/CMT/histos/
0143
0144
0145 VI. --- Three steps to provide visualization of new global-runs:
0146 ================================================================
0147 - correct in advance the file "index_zhokin.sh":
0148 a) put last line number of CMT site;
0149 b) check dataset name;
0150 c) for printout:correct comments and type;
0151
0152 1) ./index_zhokin.sh runlist_run
0153
0154 [[[ (or absolet: try to correct file "index_toAddOnlyNewRuns_EOS.sh" for "dasgoclient.. dataset=..." and
0155 "k=" - number(!) of new-recorded global-runs and execute:
0156 ( for tests use also: index_toAddOnlyNewRunsCRAFT_EOS.sh , index_toAddOnlyNewRunsCosmics_EOS.sh runlist_test )
0157 1) ./index_toAddOnlyNewRuns_EOS.sh runlist_run
0158 (use for craft test: ./index_toAddOnlyNewRunsCRAFT_EOS.sh runlist_test ) ]]]
0159
0160 eos cp OLDindex.html /eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/CMT/OLDindex.html
0161
0162 eos cp index_draft.html /eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/CMT/index.html
0163
0164 for check of new lines on CMT site see:
0165 https://cms-conddb.cern.ch/eosweb/hcal/HcalRemoteMonitoring/CMT/
0166
0167 --------------------------------------
0168
0169 - in dir. .../macros/cmt/
0170 ./compile.csh RemoteMonitoringGLOBAL.cc
0171 ./compile.csh RemoteMonitoringMAP_Global.cc
0172
0173 - and again, in dir. /scripts/cmt/ execute:
0174 2) ./CMT_EOS.sh runlist_run (or if test use runlist_test )
0175 ( a lot of printout.., wait a moment till the message:"CMT script done")
0176 3) ./GlobalRMT_EOS.sh runlist_run (or if test use runlist_test )
0177 (wait a moment till the message:"GlobalRMT script done")
0178 See the results at https://cms-conddb.cern.ch/eosweb/hcal/HcalRemoteMonitoring/CMT/
0179
0180 -- IF NECESSARY: provide for each new run the CMTanalysis using Instruction below.
0181 Edit default file CMTresults.html to provide the summary for each new run.
0182 Copy each time corrected CMTresults.html file into /eos in corresponding dir. ,
0183 as is shown below :
0184 cp CMTresults.html /eos/cms/store/group/dpg_hcal/comm_hcal/www/HcalRemoteMonitoring/CMT/GLOBAL_325001/CMTresults.html
