Prerequisites
...
Prerequisites
Once you are in the analytics server (see Command 1 below), make sure JAVA-environment is setup properly. Run this command "java -version"
...
It's best to set this up once and for all in your startup configuration file - run "nano .my.cshrc". Set Java environment and specify nano as your default editor.
...
environment, look at snapshot for exact location to place it.
| Code Block | ||
|---|---|---|
| ||
use Java-1.8
setenv EDITOR nano
setenv TIGER_HOME "/home/unix/analytics/TigerETL3"
setenv RUN3 "/home/unix/analytics/TigerETL3/runEtlAgent.sh" |
open a new ssh-connection and run "java -version" (see above)
Commands
- ssh-connect to "analytics" server using your favorite SSH tool. For Windows SecureCRT is offered as standard ssh-software to Broadies. For Mac you can connect through the command line in Terminal.
You will be asked for username/password but interface is pretty straightforward
- run etl-commands as you see fit
...
| Code Block | ||||||
|---|---|---|---|---|---|---|
| ||||||
sudo -u analytics EDITOR=nano crontab -e |
Editing with NANO: Use keyboard to navigate, Ctrl + X to exit, type 'y' to save changes.
Manually run a specific cron-job
| Code Block | ||||||
|---|---|---|---|---|---|---|
| ||||||
sudo -u analytics crontab -l | grep Orsp |
| Code Block | ||||||
|---|---|---|---|---|---|---|
| ||||||
$RUN3 Task db=analyticsetl 'task=sparkJob(agentName=Orsp)' 'delta=MillisDelta.now' |
Useful crontab utils:
https://crontab-generator.org/
...