...
Prerequisites
Once you are in the analytics server (see Command 1 below), make sure JAVA-environment is setup properly. Run this command "java -version"
if you get output below then you are all set
| Code Block |
|---|
11:46am atanas@analytics ~ $ java -version
java version "1.8.0_181"
Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode) |
- If not, run command "use Java-1.8" and check again
It's best to set this up once and for all in your startup configuration file - run "nano .my.cshrc". Set Java environment, look at snapshot for exact location to place it.
| Code Block |
|---|
|
use Java-1.8
setenv EDITOR nano
setenv TIGER_HOME "/home/unix/analytics/TigerETL3"
setenv RUN3 "/home/unix/analytics/TigerETL3/runEtlAgent.sh" |
Image Addedopen a new ssh-connection and run "java -version" (see above)
Commands
- ssh-connect to "analytics" server using your favorite SSH tool. For Windows SecureCRT is offered as standard ssh-software to Broadies. For Mac you can connect through the command line in Terminal.
You will be asked for username/password but interface is pretty straightforward
...
- run etl-commands as you see fit
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | Restart WebServer |
|---|
|
sudo -u analytics /home/unix/analytics/TigerETL3/restartWeb.sh |
...
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | Run specific ETL-agent |
|---|
|
/home/unix/analytics/TigerETL3/runEtlAgent.sh PoolingCalculator |
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | Edit cronjob |
|---|
|
sudo -u analytics EDITOR=nano crontab -e |
Editing with NANO: Use keyboard to navigate, Ctrl + X to exit, type 'y' to save changes.
Manually run a specific cron-job
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | search for your cron-job entry and copy it in clipboard |
|---|
|
sudo -u analytics crontab -l | grep Orsp |
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | paste the command and run it |
|---|
|
$RUN3 Task db=analyticsetl 'task=sparkJob(agentName=Orsp)' 'delta=MillisDelta.now' |
Image Added
Useful crontab utils:
https://crontab-generator.org/
...
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | Run EtlShell |
|---|
|
/home/unix/analytics/TigerETL3/runEtlShell.sh PoolingCalculator |
| Info |
|---|
For more information, please review Tiger3 ETL Shell |
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | Check overall health/load on the server |
|---|
|
sudo -u analytics htop |
...