In some occasions, the analytics team may need to take specific actions to check or update changes in the datamarts. Examples in which this may happen may include the following:

...

  1. Log in to your favorite SSH tool (e.g. SecureCRT)
    1. connect to "analytics" server
    2. enter the following: /home/unix/analytics/TigerETL3/runEtlShell.sh
    3. paste & run the following etl-command once, pasting the "Old" Collaborator Sample IDs in the query below

      No Format
      import analytics.tiger.agents.PdoStar._
      AnalyticsEtlDB("analytics.tiger.agents.PdoStar.fromSQL", collSamplesToPdoSamples(List("oldcollabSMID1","oldcollabSMID2")) flatMap DataSetEtl() flatMap pipeline)


    4. The NOTE: These are supposed to be two lines (the first ends with an underscore). Once you hit enter, the command takes a little while. You'll know it's complete when you get the scala prompt again.

2.3. Reviewing that PDO STAR did refresh

  1. Rerun the PDO_STAR query above. This refresh is immediate, so you can run the query right away.
  2. If it returns nothing, the DM is all set.
  3. If it still returns records, ensure that that is unexpected behavior and try the refresh again. (occasionally, there are other samples that need to remain with the "old" IDs, as is usually the case in sample swaps)
    1. If it still returns unexpected records, talk with Nasko.

2.4. Refreshing the ReadgroupMetadata DM in SEQPROD Database

Tip
iconfalse
titleReference

Review Analytics ETL Framework for more details on this section

...