Prerequisites

Once you are in the analytics server (see Command 1 below), make sure JAVA-environment is setup properly. Run this command "java -version"

• if you get output below then you are all set

  11:46am atanas@analytics ~ $ java -version
  java version "1.8.0_181"
  Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
  Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode)

• If not, run command "use Java-1.8" and check again

It's best to set this up once and for all in your startup configuration file - run "nano .my.cshrc". Set Java environment, look at snapshot for exact location to place it.

use Java-1.8
setenv EDITOR nano
setenv TIGER_HOME "/home/unix/analytics/TigerETL3"
setenv RUN3 "/home/unix/analytics/TigerETL3/runEtlAgent.sh"

• open a new ssh-connection and run "java -version" (see above)

Commands

1. ssh-connect to "analytics" server using your favorite SSH tool. For Windows SecureCRT is offered as standard ssh-software to Broadies. For Mac you can connect through the command line in Terminal.

2. You will be asked for username/password but interface is pretty straightforward

3. run etl-commands as you see fit

sudo -u analytics /home/unix/analytics/TigerETL3/restartWeb.sh

sudo -u analytics /local/spark/restartSpark.sh

sudo -u analytics crontab -l | grep spark

sudo -u analytics crontab -l

sudo -u analytics crontab -l | grep PoolingCalculator

/home/unix/analytics/TigerETL3/runEtlAgent.sh PoolingCalculator

sudo -u analytics EDITOR=nano crontab -e

Editing with NANO: Use keyboard to navigate, Ctrl + X to exit, type 'y' to save changes.

Manually run a specific cron-job

sudo -u analytics crontab -l | grep Orsp

$RUN3 Task db=analyticsetl 'task=sparkJob(agentName=Orsp)' 'delta=MillisDelta.now'

Useful crontab utils: 

https://crontab-generator.org/

https://crontab.guru/

/home/unix/analytics/TigerETL3/runEtlShell.sh

sudo -u analytics htop