Skip to content

Job request: 8463

Organisation:
University of Bristol
Workspace:
covid-ve-change-over-time--include-prev-infection
ID:
fimwcgjwsjuwigok

This page shows the technical details of what happened when the authorised researcher Elsie Horne requested one or more actions to be run against real patient data within a secure environment.

By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.

The output security levels are:

  • highly_sensitive
    • Researchers can never directly view these outputs
    • Researchers can only request code is run against them
  • moderately_sensitive
    • Can be viewed by an approved researcher by logging into a highly secure environment
    • These are the only outputs that can be requested for public release via a controlled output review service.

Jobs

  • Action:
    check_episodes
    Status:
    Status: Succeeded
    Job identifier:
    fcnx2e5lypyqj2in

Pipeline

Show project.yaml
version: '3.0'

expectations:

  population_size: 100000

actions:

  ## # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # 
  ## DO NOT EDIT project.yaml 
  ## This file is created by create_project.R 
  ## Edit and run create_project.R to update the project.yaml 
  ## # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # 
  ## #################################### 
  ## study definition 
  ## #################################### 
  ## generate dummy data for study_definition 

  dummy_data_vax:
    run: r:latest analysis/dummy_data_vax.R
    outputs:
      moderately_sensitive:
        dummy_data: analysis/dummy_data_vax.feather

  ## study definition 

  generate_study_population:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_vax
      --output-format feather
    dummy_data_file: analysis/dummy_data_vax.feather
    needs:
    - dummy_data_vax
    outputs:
      highly_sensitive:
        cohort: output/input_vax.feather

  ## #################################### 
  ## preprocessing 
  ## #################################### 
  ## process data from study_definition 

  data_input_process:
    run: r:latest analysis/preprocess/data_input_process.R
    needs:
    - dummy_data_vax
    - generate_study_population
    outputs:
      highly_sensitive:
        data_wide_vax_dates: output/data/data_wide_vax_dates.rds
        data_processed: output/data/data_processed.rds
      moderately_sensitive:
        data_properties: output/tables/data_*_tabulate.txt

  ## check number of events for defining prior covid 

  check_prior_covid:
    run: r:latest analysis/preprocess/check_prior_covid.R
    needs:
    - data_input_process
    outputs:
      highly_sensitive:
        prior_covid_n: output/lib/prior_covid_n.json
      moderately_sensitive:
        prior_covid_outcomes_n: output/eda/prior_covid_outcomes_n.png

  ## apply eligiblity criteria from boxes a and b 

  data_eligible_ab:
    run: r:latest analysis/preprocess/data_eligible_ab.R
    needs:
    - data_input_process
    outputs:
      highly_sensitive:
        data_eligible_a: output/data/data_eligible_a.rds
        data_eligible_b: output/data/data_eligible_b.rds
      moderately_sensitive:
        eligibility_count_ab: output/tables/eligibility_count_ab.csv
        group_age_ranges: output/lib/group_age_ranges.csv

  ## #################################### 
  ## second_vax_period 
  ## #################################### 
  ## identify second vaccination time periods 
  ## create dataset for identifying second vaccination time periods 

  data_2nd_vax_dates:
    run: r:latest analysis/second_vax_period/data_2nd_vax_dates.R
    needs:
    - data_input_process
    - data_eligible_ab
    outputs:
      highly_sensitive:
        data_vax_plot: output/second_vax_period/data/data_vax_plot.rds
        second_vax_period_dates_rds: output/second_vax_period/data/second_vax_period_dates.rds
      moderately_sensitive:
        second_vax_period_dates_txt: output/second_vax_period/tables/second_vax_period_dates.txt

  ## apply eligiblity criteria from boxes c, d and e 

  data_eligible_cde:
    run: r:latest analysis/preprocess/data_eligible_cde.R
    needs:
    - data_input_process
    - data_eligible_ab
    - data_2nd_vax_dates
    outputs:
      highly_sensitive:
        data_eligible_e_vax: output/data/data_eligible_e_vax.rds
        data_eligible_e_unvax: output/data/data_eligible_e_unvax.rds
        data_eligible_e: output/data/data_eligible_e.csv
      moderately_sensitive:
        eligibility_count_cde: output/tables/eligibility_count_cde.csv

  ## #################################### 
  ## study definition covs 
  ## #################################### 

  generate_covs_data:
    run: cohortextractor:latest generate_cohort --study-definition study_definition_covs
      --output-format feather
    needs:
    - check_prior_covid
    - data_eligible_cde
    outputs:
      highly_sensitive:
        cohort: output/input_covs.feather

  ## #################################### 
  ## process covariates data 
  ## #################################### 
  ## (includes anytest_date) 

  data_covariates_process:
    run: r:latest analysis/preprocess/data_covariates_process.R
    needs:
    - data_input_process
    - data_eligible_cde
    - generate_covs_data
    outputs:
      highly_sensitive:
        data_covariates: output/data/data_all.rds
        data_episodes: output/data/data_episodes.rds
      moderately_sensitive:
        data_min_max_fu_csv: output/lib/data_min_max_fu.csv

  ## check covid episodes 

  check_episodes:
    run: r:latest analysis/preprocess/check_episodes.R
    needs:
    - data_covariates_process
    outputs:
      moderately_sensitive:
        episode_triggers: output/eda/episode_triggers.png
        episode_lengths: output/eda/episode_lengths_*.png

Timeline

  • Created:

  • Started:

  • Finished:

  • Runtime: 00:01:00

These timestamps are generated and stored using the UTC timezone on the TPP backend.

Job request

Status
Succeeded
Backend
TPP
Requested by
Elsie Horne
Branch
include-prev-infection
Force run dependencies
No
Git commit hash
49c3245
Requested actions
  • check_episodes

Code comparison

Compare the code used in this job request