deep supervised learning

https://twitter.com/jacobmbuckman/status/1475305972616900612?s=20

 

probability for data science

 

https://probability4datascience.com/

Notice of Special Interest (NOSI): Methods Development for Genomic Studies of Genetic Variation, Function, and Disease

 Notice of Special Interest (NOSI): Methods Development for Genomic Studies of Genetic Variation, Function, and Disease

https://grants.nih.gov/grants/guide/notice-files/NOT-HG-22-007.html

historical twitter data

 

https://gwu-libraries.github.io/sfm-ui/posts/2017-09-14-twitter-data

cointegration on all counties 1-3151 on ridgeside.

 

hqin@ridgeside:~/anaconda3/bin$ source  activate /home/hqin/.conda/envs/r2021nov

(r2021nov) hqin@ridgeside:~/github/COVID19_transmission_MS$ nohup  R -f auto_county_cajo.R --args 1 3151 1 &

job started on 13:33 Dec 17, 2021

Anaconda tensorflow on IBM powerpc architecture

This is for LOOKOUT cluster at UTC SimCenter

The key step is to specify the channel for IBM PowerPC. More details can be found at the following link.

https://stackoverflow.com/questions/35330084/installing-tensorflow-on-the-ibm-power8

The following link might also be helpful.

https://gauravm.gitbook.io/about/blogs/installing-pytorch-and-transformers-on-ibm-powerpc-architecture

If you need additional information, please let me know.

ICML

 

https://icml.cc/Sponsors/sponsorinfo

RH is close to a stationary signal for Hamilton, TN

 

adf.test(tb4$RH)

	Augmented Dickey-Fuller Test

data:  tb4$RH
Dickey-Fuller = -6.996, Lag order = 8, p-value = 0.01
alternative hypothesis: stationary

update Labda from 18 to LTS 20.4.x

In Lambda server root account. 

$sudo apt update

install the necessary packages (python, nvidia docker etc)

$sudo apt upgrade

This runs for a while, with many heading on focal shown on screen

chose N to keep ssh_config

13:20, a gui-window popped-up, chose English US as keyboard

13:22, Yes to restart service

13:29 close all chromium browser window update

INFO waiting for automatic snapd to restart

13:31, passed, and moving forward, many lines printed on screen

13:39, updating database for manual pages ........

13:48 searching for obsolete software

13:58 fetch and download can take several hours, continue? chose Yes. 

13:59. system update is complete. Restart? Yes. 

14:02, user log in window appeared. 

Run partial update using "software & update" tool as lambda root. 

TODO: need to test cuda and GPU support. 

auto cointegration Johasen test on ECS323GPUStation and macbook pro

20211211Sat: 

22:04, executed (error occured). 

hqin@ECS323GPUStation:~/COVID19_transmission_MS$ 

hqin@ECS323GPUStation:~/COVID19_transmission_MS$ cat commands_cajo.txt 

nohup  R -f auto_county_cajo.R --args 1 800  & 

nohup  R -f auto_county_cajo.R --args 801 1600  & 

nohup  R -f auto_county_cajo.R --args 1601 2400  & 

nohup  R -f auto_county_cajo.R --args 2401 3151 & 

Back at MacPro

22:40. I modified the code to take debug as input, and ran on macpro. Many jobs get done quickly, but something take very long time. 

22:55, move to ECS323GPUStation: 

hqin@ECS323GPUStation:~/COVID19_transmission_MS$ cat commands_cajo.txt 

nohup  R -f auto_county_cajo.R --args 1 800  1 & 

nohup  R -f auto_county_cajo.R --args 801 1600  1 & 

nohup  R -f auto_county_cajo.R --args 1601 2400 1  & 

nohup  R -f auto_county_cajo.R --args 2401 3151 1 &

hqin@ECS323GPUStation:~/COVID19_transmission_MS$ ps -ef | grep county

hqin      156203       1 99 22:03 pts/0    00:51:08 /usr/lib/R/bin/exec/R -f auto_county_cajo.R --args 801 1600

hqin      591653   13303  0 22:54 pts/0    00:00:00 grep county

hqin     3595313       1 99 22:54 pts/0    00:00:38 /usr/lib/R/bin/exec/R -f auto_county_cajo.R --args 1 800 1

hqin     3595314       1 99 22:54 pts/0    00:00:38 /usr/lib/R/bin/exec/R -f auto_county_cajo.R --args 801 1600 1

hqin     3595315       1 99 22:54 pts/0    00:00:38 /usr/lib/R/bin/exec/R -f auto_county_cajo.R --args 1601 2400 1

hqin     3595316       1 99 22:54 pts/0    00:00:38 /usr/lib/R/bin/exec/R -f auto_county_cajo.R --args 2401 3151 1

The job 801-1600 took almost 55 minutes on ECS313GPUStation and is the longest job. 

Re-run commands_cajo.txt and all jobs are done quickly. So, co.ja() run have stochastic elements.  

(base) hqin@CS313BQin COVID19_transmission_MS % ls -tlh *csv

-rw-r--r--  1 hqin  staff   266K Dec 11 23:15 _autocajo_801-1600.csv

-rw-r--r--  1 hqin  staff   257K Dec 11 23:15 _autocajo_2401-3151.csv

-rw-r--r--  1 hqin  staff   266K Dec 11 23:15 _autocajo_1601-2400.csv

-rw-r--r--  1 hqin  staff   523K Dec 11 23:15 _autocajo_1-3151.csv

TODO: merge these four temporary files. 

Alternatively, run the whole process in workstation. 

auto cajo pbs on ts117

 job in EQW status? !

This does NOT worked for batch cointegration using Johansen test

-bash-4.2$ 

-bash-4.2$ cat cajo.pbs 

#!/bin/bash -l

#$ -S /bin/bash

#$ -N epinow_job

#$ -V

#$ -cwd

. /etc/profile.d/modules.sh

module load anaconda/5.2.0

source activate r2021nov

5000 study guide for waiver test

Study Guide for CPSC 5000 Waiver Test 

Programming Language: Java 

1. Number Types, Variables, Constants, Operators 

• Commonly used number types, declaration and use of variables, declaration and use of  constants 

• Arithmetic operators, increment vs. decrement, integer division and remainder, power and  roots, cast operators; be able to determine the value of a given expression • Strings, string concatenation, escape sequences, strings and characters, substrings  • Arrays, two-dimensional arrays, array lists 

2. Input, Output, Exception Handling 

• Reading input, formatted output 

• Reading and writing text files, text input and output 

• Exception handling (throwing exceptions, catching exceptions, checked exceptions, closing  resources), designing your own exception types 

3. If statement 

• Relational operators for comparing values (integers, floating-point numbers, strings, objects) • Boolean variables and operators, logical conditions 

• Multiple alternatives using if, switch statement 

• Nested branches/if 

4. Loops 

• The while loop 

• The for loop 

• The do loop 

• Sentinel values 

• Common loop algorithms 

• Nested loops 

5. Classes and Objects 

• Concepts of classes and objects, concept of encapsulation, advantages of encapsulation

• Instance variables, instance variables vs. local variables, constructors, methods, public interface  of a class 

• Implementing and designing classes, constructing objects 

• Discovering classes for programming problems 

• Inheritance: implementing subclasses, overriding methods 

• Interfaces: declaring an interface type, implementing an interface type, working with interface  variables (converting from classes to interfaces, invoking methods on interface variables, casting  from interfaces to classes), the Comparable interface 

• Relationships between classes (dependency, aggregation, inheritance) 

6. Algorithms 

• Common loop algorithms (sum and average value, counting matches, finding the first match,  prompting until a match is found, maximum and minimum, comparing adjacent values) • Common array algorithms (filling, sum and average value, maximum and minimum, element  separators, linear search, removing an element, inserting an element, swapping elements,  copying arrays, reading input) 

• Random numbers and simulations: generating random numbers, the monte Carlo method • Recursion, the efficiency of recursion 

7. Other topics 

• Method (signature, overloading, and pass by value/reference, recursive programing) • Polymorphism (introduced by abstract class, interface, and generic programming) • GUI and event-driven programming 

• Applied programming (threading, socket, and exception handling)

 

quantum computer and neural networks

 
Quantum processor swapped in for a neural network
Quantum processor used to model weather based on sparse data.

https://arstechnica.com/science/2021/12/quantum-processor-swapped-in-for-a-neural-network/

UTC sample bylaws

 

https://www.utc.edu/sites/default/files/2020-06/dpa-bylaws-v2.pdf

Rt ~ g_workplace ERA_dewpoint ERA_K, air_temp

 early 2020 to spring 2021. 

Hamilton, TN

 sub = tb4[, c('Rt', 'g_workplace',  'ERA5_dewpoint', 'K', 'air_temp')] # r <= 2