Versions Compared

Version Old Version 28 New Version 29
Changes made by

Atanas Mihalev

Atanas Mihalev

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
  1. connect to "analytics" server using your favorite SSH tool
  2. enter EtlShell /home/unix/analytics/TigerETL3/runEtlShell.sh
  3. run etl-commands as you see fit

...

TASK descriptionCOMMAND

Manually push into GitHub by providing CSV-list of dbObjects and optional commit message. Note that dbObjects are specified by (dbname.schema.objectname) triplets where dbname is: seqprod, labopsjira or bsp

If no explicit commit-message is provided then built-into-your-code comments  would be picked

 

/* GITHUBCOMMENT: RPT-1234 */


analytics.tiger.agents.OracleVCS.main(Array("labopsjira.REPORTING.ZZZAB_METADATA_TRANSITIONS,seqprod.COGNOS.ACTIVE_LAB", "Monads are great"))
blacklist runfolder from RunMercury/RghqsLoader agents

CognosDB("RunfolderAPI.blacklist", RunfolderAPI.blacklistRun("runfolder1,runfolder2"))

whitelist runfolder from RunMercury/RghqsLoader agents

CognosDB("RunfolderAPI.whitelist", RunfolderAPI.whitelistRun("runfolder1,runfolder2"))

Manual Refresh in PDO Star5 using a query (using PDO_NAMEs)


Code Block
languagescala
AnalyticsEtlDB("analytics.tiger.agents.PdoStar.fromSQL", deltaFromSql("""SELECT DISTINCT a.pdo_name||','||a.pdo_sample_id FROM cognos.pdo_star5 a WHERE a.pdo_name = 'PDO-14680'""") flatMap DataSetEtl() flatMap analytics.tiger.agents.PdoStar.pipeline)


Manual Refresh in PDO Star5 using a query (alternate method using "Old" Collaborator Sample IDs)


Code Block
import analytics.tiger.agents.PdoStar._


AnalyticsEtlDB("analytics.tiger.agents.PdoStar.fromSQL", collSamplesToPdoSamples(List("oldcollabSMID1","oldcollabSMID2")) flatMap DataSetEtl() flatMap pipeline)


Manual Refresh of Picard Aggregations for a list of samples (Research)
CognosDB("analytics.tiger.agents.PicardAggregator.Manual", deltaETL(Set("ALCH-ABSQ-TTP1-A-12-0-D-A489-36","ALCH-ABSQ-NB1-A-1-0-D-A489-36")) flatMap DataSetEtl() flatMap analytics.tiger.agents.PicardAggregator.Regular.pipeline)
 Manual Refresh of Picard Aggregations using a query

CognosDB("analytics.tiger.agents.PicardAggregator.fromSQL",deltaFromSql deltaFromSql("""SELECT a.SAMPLE FROM cognosFROM cognos.slxre2_pagg_sample a WHERE a.SAMPLE = 'CAD-JDV-098'""") flatMap DataSetEtl() flatMap analytics.tiger.agents.PicardAggregator.Regular.pipeline)

Manual Refresh of Picard Aggregations for a list of samples (CRSP)

 AnalyticsEtlDB("analytics.tiger.agents.PicardAggregator.CRSP.Manual", deltaETL(Set("SM-HXT86")) flatMap DataSetEtl() flatMap analytics.tiger.agents.PicardAggregator.CRSP.pipeline)

Manual Refresh of Picard Aggregations using a query (CRSP)

 AnalyticsEtlDB("analytics.tiger.agents.PicardAggregator.CRSP.fromSQL", deltaFromSql("""SELECT a.SAMPLE FROM cognos.slxre2_pagg_sample a WHERE a.SAMPLE = 'SM-HUTAC'""") flatMap DataSetEtl() flatMap analytics.tiger.agents.PicardAggregator.CRSP.pipeline)