Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

In some occasions, the analytics team may need to take specific actions to check or update changes in the datamarts. Examples in which this may happen may include the following:

...

  1. If refreshes aren't showing updated data, it may be because the sample ETL is down. If LIMS team has done their part, but the bsp.analytics_sample and analytics.bsp_sample DMs are not updated, check the ETL agent here: http://analytics:8090/etl_runs?status=Succeeded&status=Failed&status=Running&status=Abandoned&agent=analytics.tiger.agents.BspSample&action=Refresh

1.6. Resolving DataChecker Errors - PK violations of Aggregation DMs


  1. In cognos, check whether PK violators have already been picked up by a subsequent ETL

    SELECT e.error_timestamp, la.TIMESTAMP etl_timestamp, e.*
    FROM err$_slxre2_pagg_library e
    LEFT JOIN slxre2_pagg_library la ON
    la.project = e.project
    AND la.SAMPLE = e.SAMPLE
    AND la.LIBRARY = e.LIBRARY
    AND la.data_type = e.data_type
    WHERE e.resolution_timestamp IS NULL

  2. If etl_timestamp is after the last error_timestamp , the error record can be resolved(use the query below). If etl_timestamp is missing or is before error_timestamp, then follow up with Pipeline team, send them specific (project, sample, librarym data type)

    UPDATE err$_slxre2_pagg_library
    SET resolution_timestamp = SYSDATE
    WHERE resolution_timestamp IS NULL

  3. If a subset of violators were picked up by the ETL, adjust the WHERE clause in the UPDATE statement to just those entries

2. PDO STAR, RGHQS, and Read Group Metadata Datamart Refresh Push

...

  1. Rerun the PDO_STAR query above. This refresh is immediate, so you can run the query right away.
  2. If it returns nothing, the DM is all set.
  3. If it still returns records, ensure that that is unexpected behavior and try the refresh again. (occasionally, there are other samples that need to remain with the "old" IDs, as is usually the case in sample swaps)
    1. If it still returns unexpected records, talk with Nasko.

2.5. ReadgroupMetadata DM Refresh in SEQPROD Database

...