Skip to content

Job request: 14846

Organisation:
The London School of Hygiene & Tropical Medicine
Workspace:
healthcare_needs_chronic_kidney_disease
ID:
t6vbdj6x3csfuecs
View repo View project.yaml

This page shows the technical details of what happened when the authorised researcher Viyaasan Mahalingasivam requested one or more actions to be run against real patient data within a secure environment.

By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.

The output security levels are:

  • highly_sensitive
    • Researchers can never directly view these outputs
    • Researchers can only request code is run against them
  • moderately_sensitive
    • Can be viewed by an approved researcher by logging into a highly secure environment
    • These are the only outputs that can be requested for public release via a controlled output review service.

Pipeline

Show project.yaml 
version: "3.0"

expectations:
  population_size: 50000

actions:

  2017:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2017
    outputs:
      highly_sensitive:
        cohort: output/input_2017.csv

  2017_ckd:
    run: stata-mp:latest analysis/ckd.do 2017
    needs: [2017]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2017_ckd.csv
      moderately_sensitive:
        log: logs/2017_ckd.log
  
  2017_ckd_complete:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2017_ckd_complete
    needs: [2017, 2017_ckd]
    outputs:
      highly_sensitive:
        cohort: output/input_2017_ckd_complete.csv

  2017_clean_ckd_complete:
    run: stata-mp:latest analysis/ckd_complete.do 2017
    needs: [2017, 2017_ckd, 2017_ckd_complete]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2017_ckd_complete.dta
      moderately_sensitive:
        log: logs/2017_ckd_complete.log

  2017_outcomes:
    run: stata-mp:latest analysis/outcomes.do 2017
    needs: [2017, 2017_ckd, 2017_ckd_complete, 2017_clean_ckd_complete]
    outputs:
      moderately_sensitive:
        log: logs/2017_outcomes.log

  2018:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2018
    outputs:
      highly_sensitive:
        cohort: output/input_2018.csv

  2018_ckd:
    run: stata-mp:latest analysis/ckd.do 2018
    needs: [2018]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2018_ckd.csv
      moderately_sensitive:
        log: logs/2018_ckd.log
  
  2018_ckd_complete:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2018_ckd_complete
    needs: [2018, 2018_ckd]
    outputs:
      highly_sensitive:
        cohort: output/input_2018_ckd_complete.csv

  2018_clean_ckd_complete:
    run: stata-mp:latest analysis/ckd_complete.do 2018
    needs: [2018, 2018_ckd, 2018_ckd_complete]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2018_ckd_complete.dta
      moderately_sensitive:
        log: logs/2018_ckd_complete.log

  2018_outcomes:
    run: stata-mp:latest analysis/outcomes.do 2018
    needs: [2018, 2018_ckd, 2018_ckd_complete, 2018_clean_ckd_complete]
    outputs:
      moderately_sensitive:
        log: logs/2018_outcomes.log

  2019:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2019
    outputs:
      highly_sensitive:
        cohort: output/input_2019.csv

  2019_ckd:
    run: stata-mp:latest analysis/ckd.do 2019
    needs: [2019]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2019_ckd.csv
      moderately_sensitive:
        log: logs/2019_ckd.log
  
  2019_ckd_complete:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2019_ckd_complete
    needs: [2019, 2019_ckd]
    outputs:
      highly_sensitive:
        cohort: output/input_2019_ckd_complete.csv

  2019_clean_ckd_complete:
    run: stata-mp:latest analysis/ckd_complete.do 2019
    needs: [2019, 2019_ckd, 2019_ckd_complete]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2019_ckd_complete.dta
      moderately_sensitive:
        log: logs/2019_ckd_complete.log

  2019_outcomes:
    run: stata-mp:latest analysis/outcomes.do 2019
    needs: [2019, 2019_ckd, 2019_ckd_complete, 2019_clean_ckd_complete]
    outputs:
      moderately_sensitive:
        log: logs/2019_outcomes.log

  2020:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2020
    outputs:
      highly_sensitive:
        cohort: output/input_2020.csv

  2020_ckd:
    run: stata-mp:latest analysis/ckd.do 2020
    needs: [2020]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2020_ckd.csv
      moderately_sensitive:
        log: logs/2020_ckd.log
  
  2020_ckd_complete:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2020_ckd_complete
    needs: [2020, 2020_ckd]
    outputs:
      highly_sensitive:
        cohort: output/input_2020_ckd_complete.csv

  2020_clean_ckd_complete:
    run: stata-mp:latest analysis/ckd_complete.do 2020
    needs: [2020, 2020_ckd, 2020_ckd_complete]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2020_ckd_complete.dta
      moderately_sensitive:
        log: logs/2020_ckd_complete.log

  2020_outcomes:
    run: stata-mp:latest analysis/outcomes.do 2020
    needs: [2020, 2020_ckd, 2020_ckd_complete, 2020_clean_ckd_complete]
    outputs:
      moderately_sensitive:
        log: logs/2020_outcomes.log

  2021:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2021
    outputs:
      highly_sensitive:
        cohort: output/input_2021.csv

  2021_ckd:
    run: stata-mp:latest analysis/ckd.do 2021
    needs: [2021]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2021_ckd.csv
      moderately_sensitive:
        log: logs/2021_ckd.log
  
  2021_ckd_complete:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2021_ckd_complete
    needs: [2021, 2021_ckd]
    outputs:
      highly_sensitive:
        cohort: output/input_2021_ckd_complete.csv

  2021_clean_ckd_complete:
    run: stata-mp:latest analysis/ckd_complete.do 2021
    needs: [2021, 2021_ckd, 2021_ckd_complete]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2021_ckd_complete.dta
      moderately_sensitive:
        log: logs/2021_ckd_complete.log

  2021_outcomes:
    run: stata-mp:latest analysis/outcomes.do 2021
    needs: [2021, 2021_ckd, 2021_ckd_complete, 2021_clean_ckd_complete]
    outputs:
      moderately_sensitive:
        log: logs/2021_outcomes.log

  2022:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2022
    outputs:
      highly_sensitive:
        cohort: output/input_2022.csv

  2022_ckd:
    run: stata-mp:latest analysis/ckd.do 2022
    needs: [2022]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2022_ckd.csv
      moderately_sensitive:
        log: logs/2022_ckd.log
  
  2022_ckd_complete:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_2022_ckd_complete
    needs: [2022, 2022_ckd]
    outputs:
      highly_sensitive:
        cohort: output/input_2022_ckd_complete.csv

  2022_clean_ckd_complete:
    run: stata-mp:latest analysis/ckd_complete.do 2022
    needs: [2022, 2022_ckd, 2022_ckd_complete]
    outputs:
      highly_sensitive:
        analysis_dataset: output/2022_ckd_complete.dta
      moderately_sensitive:
        log: logs/2022_ckd_complete.log

  2022_outcomes:
    run: stata-mp:latest analysis/outcomes.do 2022
    needs: [2022, 2022_ckd, 2022_ckd_complete, 2022_clean_ckd_complete]
    outputs:
      moderately_sensitive:
        log: logs/2022_outcomes.log

  ckd_progression:
    run: stata-mp:latest analysis/ckd_progression.do
    needs: [2017_clean_ckd_complete, 2018_clean_ckd_complete, 2019_clean_ckd_complete, 2020_clean_ckd_complete, 2021_clean_ckd_complete, 2022_clean_ckd_complete, 2017_outcomes, 2018_outcomes, 2019_outcomes, 2020_outcomes, 2021_outcomes, 2022_outcomes]
    outputs:
      moderately_sensitive:
        log: logs/ckd_progression.log
        output: output/ckd_progression.csv

Timeline

  • Created:

  • Started:

  • Finished:

  • Runtime:

These timestamps are generated and stored using the UTC timezone on the TPP backend.

Job request

Status
Failed 
JobRequestError: ckd_progression failed on a previous run and must be re-run
Backend
TPP
Workspace
healthcare_needs_chronic_kidney_disease
Requested by
Viyaasan Mahalingasivam
Branch
main
Force run dependencies
No
Git commit hash
a2106bf
Requested actions
  • run_all

Code comparison

Compare the code used in this job request