Prerequisites
Make sure JAVA-environment is setup properly
Run this command "java -version"
- if you get output like this11:46am atanas@analytics ~ $ java -version
java version "1.8.0_181"
Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode)
11:46am atanas@analytics ~ $
- ssh-connect to "analytics" server using your favorite SSH tool. For Windows SecureCRT is offered as standard ssh-software to Broadies. For Mac you can connect through the command line in Terminal.
You will be asked for username/password but interface is pretty straightforward
- run etl-commands as you see fit
Restart WebServer
sudo -u analytics /home/unix/analytics/TigerETL3/restartWeb.sh
Restart Spark
sudo -u analytics /local/spark/restartSpark.sh
Print out Spark cron-jobs
sudo -u analytics crontab -l | grep spark
Print out all ETL cron-jobs
sudo -u analytics crontab -l
Print out specific cron-job
sudo -u analytics crontab -l | grep PoolingCalculator
Run specific ETL-agent
/home/unix/analytics/TigerETL3/runEtlAgent.sh PoolingCalculator
Edit cronjob
sudo -u analytics EDITOR=nano crontab -e
Useful crontab utils:
https://crontab-generator.org/
Run EtlShell
/home/unix/analytics/TigerETL3/runEtlShell.sh
For more information, please review Tiger3 ETL Shell
Check overall health/load on the server
sudo -u analytics htop
