Prerequisites
Once you are in the analytics server (see Command 1 below), make sure JAVA-environment is setup properly. Run this command "java -version"
if you get output below then you are all set
| Code Block |
|---|
11:46am atanas@analytics ~ $ java -version
java version "1.8.0_181"
Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode) |
- If not, run command "use Java-1.8" and check again
It's best to set this up once and for all in your startup configuration file - run "nano .my.cshrc". Set Java environment, look at snapshot for exact location to place it.
| Code Block |
|---|
|
use Java-1.8
setenv EDITOR nano
setenv TIGER_HOME "/home/unix/analytics/TigerETL3"
setenv RUN3 "/home/unix/analytics/TigerETL3/runEtlAgent.sh" |
Image Addedopen a new ssh-connection and run "java -version" (see above)
Commands
- ssh-connect to "analytics" server using your favorite SSH tool. For Windows SecureCRT is offered as standard ssh-software to Broadies. For iOS (I don't know, pls some iOS guy fill this in ???)Mac you can connect through the command line in Terminal.
You will be asked for username/password but interface is pretty straightforward
- run etl-commands as you see fit
...
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | Edit cronjob |
|---|
|
sudo -u analytics EDITOR=nano crontab -e |
Editing with NANO: Use keyboard to navigate, Ctrl + X to exit, type 'y' to save changes.
Manually run a specific cron-job
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | search for your cron-job entry and copy it in clipboard |
|---|
|
sudo -u analytics crontab -l | grep Orsp |
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | paste the command and run it |
|---|
|
$RUN3 Task db=analyticsetl 'task=sparkJob(agentName=Orsp)' 'delta=MillisDelta.now' |
Image Added
Useful crontab utils:
https://crontab-generator.org/
...
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | Run EtlShell |
|---|
|
/home/unix/analytics/TigerETL3/runEtlShell.sh |
| Info |
|---|
For more information, please review Tiger3 ETL Shell |
| Code Block |
|---|
| language | bash |
|---|
| theme | Emacs |
|---|
| title | Check overall health/load on the server |
|---|
|
sudo -u analytics htop |
...