Rt batch run on ts

Generate PBS submission jobs

 * python generate_PBS_bash.py 

  * sh submit_PBS_small.sh 

-bash-4.2$ cat submit_PBS_small.sh 

qsub PBS/ts_1_2.pbs

qsub PBS/ts_2_3.pbs

qsub PBS/ts_3_4.pbs

qsub PBS/ts_4_5.pbs

qsub PBS/ts_5_6.pbs

qsub PBS/ts_6_7.pbs

qsub PBS/ts_7_8.pbs

qsub PBS/ts_8_9.pbs

qsub PBS/ts_9_10.pbs

qsub PBS/ts_10_11.pbs

These jobs were done within minutes. 

23:50 sh submit_PBS.sh  ==> 3342 jobs, one for each USA county. small test run. 

00:14 Use generate_PBS_bash.py  for time from Feb 1, 2020 to Nov 1, 2021. Sub 3342 jobs again. 

-bash-4.2$ qstat | head

job-ID  prior   name       user         state submit/start at     queue                          slots ja-task-ID 

-----------------------------------------------------------------------------------------------------------------

  40904 0.50500 epi_job1   hqin         r     11/10/2021 01:16:14 all.q@ts26.cm.cluster              1        

  40905 0.50500 epi_job2   hqin         r     11/10/2021 01:16:14 all.q@ts19.cm.cluster              1        

  40906 0.50500 epi_job3   hqin         r     11/10/2021 01:16:14 all.q@ts01.cm.cluster              1        

  40907 0.50500 epi_job4   hqin         r     11/10/2021 01:16:14 all.q@ts33.cm.cluster              1        

  40909 0.50500 epi_job6   hqin         r     11/10/2021 01:16:14 all.q@ts19.cm.cluster              1        

  40910 0.50500 epi_job7   hqin         r     11/10/2021 01:16:14 all.q@ts01.cm.cluster              1        

  40912 0.50500 epi_job9   hqin         r     11/10/2021 01:16:14 all.q@ts29.cm.cluster              1        

  40914 0.50500 epi_job11  hqin         r     11/10/2021 01:16:14 all.q@ts26.cm.cluster              1  

The last output file was generated on Nov 14, 2021 at 04:43. So the job run for more than 5 days. 

total 209792

-rw-r--r-- 1 hqin simctr 23771 Nov 14 04:43 Suffolk_NewYork_US_v2.csv