Job request: 5961
- Organisation:
- Bennett Institute
- Workspace:
- covid_mortality_over_time
- ID:
- dhcc7cvhmm33a2pq
This page shows the technical details of what happened when the authorised researcher Linda Nab requested one or more actions to be run against real patient data within a secure environment.
By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.
The output security levels are:
-
highly_sensitive
- Researchers can never directly view these outputs
- Researchers can only request code is run against them
-
moderately_sensitive
- Can be viewed by an approved researcher by logging into a highly secure environment
- These are the only outputs that can be requested for public release via a controlled output review service.
Jobs
-
- Job identifier:
-
7wnhxia326byuxnk
-
- Job identifier:
-
awmlq33d7hje2gds - Error:
- nonzero_exit: Job exited with error code 1
-
- Job identifier:
-
lhqpn2esowgdhnoe - Error:
- dependency_failed: Not starting as dependency failed
-
- Job identifier:
-
ukb2tgujxuyderra - Error:
- dependency_failed: Not starting as dependency failed
-
- Job identifier:
-
32zya3zbnji67ag6 - Error:
- dependency_failed: Not starting as dependency failed
-
- Job identifier:
-
o4txqvsnll4azc7a - Error:
- dependency_failed: Not starting as dependency failed
Pipeline
Show project.yaml
version: '3.0'
expectations:
population_size: 1000
actions:
# Extract data
# When argument --index-date-range is changed, change has to be made in ./analysis/config.R and ./analysis/config.py too
generate_study_population:
run: cohortextractor:latest generate_cohort --study-definition study_definition --skip-existing --output-format=csv.gz --index-date-range "2020-02-01 to 2020-08-01 by month"
outputs:
highly_sensitive:
cohort: output/input_*.csv.gz
# Extract ethnicity
generate_study_population_ethnicity:
run: cohortextractor:latest generate_cohort --study-definition study_definition_ethnicity --output-format=csv.gz
outputs:
highly_sensitive:
cohort: output/input_ethnicity.csv.gz
# Join data
join_data:
run: python:latest analysis/join_ethnicity.py
needs: [generate_study_population, generate_study_population_ethnicity]
outputs:
highly_sensitive:
cohort: output/input*.csv.gz
# Calculate mortality rates (crude + subgroup specific)
calculate_measures:
run: cohortextractor:latest generate_measures --study-definition study_definition
needs: [join_data]
outputs:
moderately_sensitive:
measure: output/measure_*_mortality_rate.csv
# Standardise crude mortality rate
standardise_crude_rates:
run: r:latest analysis/crude_rates_standardise.R
needs: [calculate_measures]
outputs:
moderately_sensitive:
csvs: output/rates/crude_*monthly_std.csv
# Standardise subgroup specific mortality rates
standardise_subgroup_rates:
run: r:latest analysis/subgroups_rates_standardise.R
needs: [calculate_measures]
outputs:
moderately_sensitive:
csvs: output/rates/*_monthly_std.csv
Timeline
-
Created:
-
Started:
-
Finished:
-
Runtime: 10:14:29
These timestamps are generated and stored using the UTC timezone on the TPP backend.
Job request
- Status
-
Failed
- Backend
- TPP
- Workspace
- covid_mortality_over_time
- Requested by
- Linda Nab
- Branch
- main
- Force run dependencies
- Yes
- Git commit hash
- 1a0b289
- Requested actions
-
-
run_all
-
Code comparison
Compare the code used in this job request
- No previous job request available for comparison