Prerequisites
Make sure JAVA-environment is setup properly. Run this command "java -version"
if you get output below then you are all set
11:46am atanas@analytics ~ $ java -version java version "1.8.0_181" Java(TM) SE Runtime Environment (build 1.8.0_181-b13) Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode)
- If not, run command "use Java-1.8" and check again
It's best to set this up once and for all in your "startup configuration file". (For CShell this is ".my.cshrc")
Commands
- ssh-connect to "analytics" server using your favorite SSH tool. For Windows SecureCRT is offered as standard ssh-software to Broadies. For Mac you can connect through the command line in Terminal.
You will be asked for username/password but interface is pretty straightforward
- run etl-commands as you see fit
Restart WebServer
sudo -u analytics /home/unix/analytics/TigerETL3/restartWeb.sh
Restart Spark
sudo -u analytics /local/spark/restartSpark.sh
Print out Spark cron-jobs
sudo -u analytics crontab -l | grep spark
Print out all ETL cron-jobs
sudo -u analytics crontab -l
Print out specific cron-job
sudo -u analytics crontab -l | grep PoolingCalculator
Run specific ETL-agent
/home/unix/analytics/TigerETL3/runEtlAgent.sh PoolingCalculator
Edit cronjob
sudo -u analytics EDITOR=nano crontab -e
Useful crontab utils:
https://crontab-generator.org/
Run EtlShell
/home/unix/analytics/TigerETL3/runEtlShell.sh
For more information, please review Tiger3 ETL Shell
Check overall health/load on the server
sudo -u analytics htop