This web-server supports following services:
| Table of Contents |
|---|
Production tools
JqlTableauExtractService
Extracts data from JIRA into Tableau as native TDE file.
sampleWorkflow - records sampleWorkflow-transitions in DB (used by RQC reports, etc)
sampleAnalyticsWorkflow - new version sampleWorkflow
labopsjira / BspFreezerLocations - support SRS tools
CromwellViewer - monitor pipeline workflows (see also Cromwell API)
txtExtract - extract data from datamarts as csv/tsv
IlluminaSummary - used by John Walsh to upload summary-file to DWH
IlluminaMetrics - used by Walsh to upload "barcodeCounts" files to DWH
ETLDashboard - ATTN: Actual ETLs (running on UNIX) are not affected even if Dashboard is down.
http://analytics:8090/etl_runs?latest_run_only=true shows only latest run for each agent.
"generate_sql" service generates automatically a JIRADWH query for extracting data from Jira
JiraWebConnector - alternative interface to get data into Tableau (failed to gain popularity)
troubleshooting tools: sqlMonitor, peekattable, LockedObjects,
Services in red above are being used in production tools, others are for development and maintenance purposes.
CromwellViewer
HYPER file. https://broadinstitute.atlassian.net/wiki/spaces/AN/pages/613974091/Jira+Extraction+API+v2+Tableau+Edition
Often developed using CodeAssistant.
sampleAnalyticsWorkflow
labopsjira / BspFreezerLocations
Supports SRS tools
Metrics
Service used by John Walsh to upload metrics files (Summary, basecalling, BroadWest, etc) to DWH
CromwellViewer
Monitors pipeline workflows.
Lucidchart pageCount 1 autoUpdate true align left type rich autoSize 1 macroId 2a2c31fb-fab9-4c5a-a00f-140ecfbfde27 instanceId Confluence:8792679401 pages width 700 documentId a66a4d00-3f3b-47cd-957e-aa22786b46cc documentToken a66a4d00-3f3b-47cd-957e-aa22786b46cc|42323|613974029|TXuBQcR7wCn5MWtRQzTV4kH+p1AAxqjPao6Ecc8fLto= updated 1554319967154 height 500
Development and Maintenance tools
DependencyVisualizer
Service that visualizes relationships between different things (reports, datamarts, webservices and more).
ETLDashboard
ATTN: Actual ETLs (running on UNIX) are not affected even if Dashboard is down.
http://analytics:8090/etl_runs?latest_run_only=true shows only latest run for each agent.
"generate_sql" service generates automatically a JIRADWH query for extracting data from Jira - http://analytics:8090/api/v2/generate_sql?domain=labopsjira&project_name=SRS
JiraWebConnector
Alternative interface to get data into Tableau (failed to gain popularity)
codeAssistant
Service that helps users create SQL queries from JQL (Jira) queries.
txtExtract service
extract data from datamarts as csv/tsv. created in December 2018 (see RPT-5119, RPT-5179)
...
After the conf file is edited, the analytics webserver must be forced to refresh it (otherwise, the webserver will use the version of the file as it was upon webserver restart). You can force an "extractSQL.conf" reload with this http://analytics:8090/api/v2/csvExtract
Troubleshooting Tools
sqlMonitor, peekattable, LockedObjects,
Troubleshooting
If any of these services gets in trouble, the easiest way to bring it back might be to restart the Web Server (analytics server - useful tools and commands)
...