Motivation
...
| Column name | Data type | Description |
|---|---|---|
| PDO | VARCHAR2 | PDO |
| PDO_SAMPLE | VARCHAR2 | PDO SAMPLE |
| DATA_TYPE | VARCHAR2 | Exome, WGS |
| REQUEST_TYPE | NUMBER | "RequestFinalAggregation", "RequestTopOff", "RequestTopOffGroup", "RequestPoolCreated", "RequestSendToRework", "RequestHoldForTopOff", "RequestWaitingForNewRwData", "RequestReset", "RequestPCHoldForTopOff","RequestVolumeFinal" |
| USER_NAME | VARCHAR2 | who triggered this action/transition |
| PARAMS | VARCHAR2 | This is a free text where Tableau developers can store additional info re this transition which later can be used. Usually it's semicolon-separated-list-of-key=value-pairs |
| TIMESTAMP | DATE | when this action was triggered |
| IS_LATEST | NUMBER | Boolean (1 or 0), Is this the latest transition a given (PDO, PDO_SAMPLE, DATA_TYPE) has gone through. Every time new transition is recorded it comes with IS_LATEST=1 whereas previous latest transition is reset IS_LATEST=0 |
| IP_ADDRESS | VARCHAR2 | where (which IP) this request came from |
...
- requestType is the text-representation of this request (RequestFinalAggregation, RequestTopOff, etc)
- each individual item is a quintuple representing a single sample like this pdo:pdo_sample:data_type:user_name:parameters (greens are optional, trailing colons are not required)
...
- JOIN cognos.slxre_readgroup_metadata ON (pdo, pdo_sample, data_type) and lookup (research_project_id,collaborator_sample_id) for a given sample
- send JSON message to appropriate JMS queue
Environments
2 separate environments are provided
...
In EtlShell: by copy/pasting the (pdo:pdo_samples:datatype) triplets
Code Block language scala import analytics.tiger.agents.SAW CognosDB("analytics.tiger.agents.SAW.PushDev.Manual", SAW.manual("PDO-111:SM-111:E,PDO-222:SM-222:E") flatMap SAW.finalAggDev("nasko"))In EtlShell: by loading (pdo:pdo_samples:datatype) triplets via SQL
Code Block language scala import analytics.tiger.agents.SAW val sql = """SELECT m.pdo || ':' || m.pdo_sample || ':' || m.data_type data FROM cognos.rapidqc_agg m WHERE m.pdo='PDO-17350' AND m.pdo_sample IN ('SM-I3797','SM-I2NWY','SM-I371P','SM-I2P3C')""" CognosDB("analytics.tiger.agents.SAW.AutoPushDevPushDev.ManualviaSQL", SAW.viaSQL(sql) flatMap SAW.finalAggDev("nasko"))
...