Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Prerequisites

Once you are in the analytics server (see Command 1 below), make sure JAVA-environment is setup properly. Run this command "java -version"

  • if you get output below then you are all set

    Code Block
    11:46am atanas@analytics ~ $ java -version
    java version "1.8.0_181"
    Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
    Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode)


  • If not, run command "use Java-1.8" and check again

It's best to set this up once and for all in your startup configuration file - run "nano .my.cshrc". Set Java environment, look at snapshot for exact location to place it.


Code Block
titleTiger environment
use Java-1.8
setenv EDITOR nano
setenv TIGER_HOME "/home/unix/analytics/TigerETL3"
setenv RUN3 "/home/unix/analytics/TigerETL3/runEtlAgent.sh"


  • Image Addedopen a new ssh-connection and run "java -version" (see above)

Commands

  1. ssh-connect to "analytics" server using your favorite SSH tool. For Windows SecureCRT is offered as standard ssh-software to Broadies. For iOS (I don't know, pls some iOS guy fill this in ???)Mac you can connect through the command line in Terminal.
  2. You will be asked for username/password but interface is pretty straightforward

  3. run etl-commands as you see fit

...

Code Block
languagebash
themeEmacs
titleEdit cronjob
sudo -u analytics EDITOR=nano crontab -e

Editing with NANO: Use keyboard to navigate, Ctrl + X to exit, type 'y' to save changes.

Manually run a specific cron-job

Code Block
languagebash
themeEmacs
titlesearch for your cron-job entry and copy it in clipboard
sudo -u analytics crontab -l | grep Orsp


Code Block
languagebash
themeEmacs
titlepaste the command and run it
$RUN3 Task db=analyticsetl 'task=sparkJob(agentName=Orsp)' 'delta=MillisDelta.now'

Image Added


Useful crontab utils: 

https://crontab-generator.org/

...