Job request: 27536
- Organisation:
- University of Bristol
- Workspace:
- reduce-wp1
- ID:
- 36jlcltkzcdsvm6d
This page shows the technical details of what happened when the authorised researcher Andrea Schaffer requested one or more actions to be run against real patient data within a secure environment.
By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.
The output security levels are:
-
highly_sensitive
- Researchers can never directly view these outputs
- Researchers can only request code is run against them
-
moderately_sensitive
- Can be viewed by an approved researcher by logging into a highly secure environment
- These are the only outputs that can be requested for public release via a controlled output review service.
Jobs
-
- Job request status:
- Nothing to do
- Status:
- Status: Nothing to do
- Job request status message:
-
All requested actions were already scheduled to run
Pipeline
Show project.yaml
version: '5.0'
actions:
# Extract population for consort diagram
# generate_dataset_consort:
# run: ehrql:v1 generate-dataset analysis/dataset_definition/dataset_definition_consort.py --output output/dataset_consort.csv.gz
# outputs:
# highly_sensitive:
# dataset: output/dataset_consort.csv.gz
# consort_diagram:
# run: python:v2 python analysis/preprocessing/consort_diagram.py
# needs: [generate_dataset_consort]
# outputs:
# moderately_sensitive:
# dataset: output/consort_diagram_dta.csv
generate_dataset_wp1_common:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_common.py --output output/dataset_wp1_common.csv.gz
--dummy-data-file analysis/dummy_data/dummy_dataset_wp1_common.csv.gz
outputs:
highly_sensitive:
dataset: output/dataset_wp1_common.csv.gz
# diabetes_algo_wp1:
# run: diabetes-algo:v0.0.9 --output output/tmp_dataset_wp1_common.csv.gz
# config:
# df_input: tmp_dataset_wp1_common.csv.gz
# birth_date: dob
# ethnicity_cat: ethnicity_cat
# df_output: dataset_wp1_common.csv.gz
# needs:
# - generate_dataset_wp1_common
# outputs:
# highly_sensitive:
# dataset: output/dataset_wp1_common.csv.gz
generate_dataset_wp1_2019:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2019.csv.gz
--dummy-data-file analysis/dummy_data/dummy_dataset_wp1_2019.csv.gz
-- --cohort_index_date "2019-02-01"
#needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2019.csv.gz
generate_dataset_wp1_2020:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2020.csv.gz
--dummy-data-file analysis/dummy_data/dummy_dataset_wp1_2020.csv.gz
-- --cohort_index_date "2020-02-01"
#needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2020.csv.gz
generate_dataset_wp1_2021:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2021.csv.gz
--dummy-data-file analysis/dummy_data/dummy_dataset_wp1_2021.csv.gz
-- --cohort_index_date "2021-02-01"
#needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2021.csv.gz
generate_dataset_wp1_2022:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2022.csv.gz
--dummy-data-file analysis/dummy_data/dummy_dataset_wp1_2022.csv.gz
-- --cohort_index_date "2022-02-01"
#needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2022.csv.gz
generate_dataset_wp1_2023:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2023.csv.gz
--dummy-data-file analysis/dummy_data/dummy_dataset_wp1_2023.csv.gz
-- --cohort_index_date "2023-02-01"
#needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2023.csv.gz
generate_dataset_wp1_2024:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2024.csv.gz
--dummy-data-file analysis/dummy_data/dummy_dataset_wp1_2024.csv.gz
-- --cohort_index_date "2024-02-01"
#needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2024.csv.gz
generate_dataset_wp1_2025:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2025.csv.gz
--dummy-data-file analysis/dummy_data/dummy_dataset_wp1_2025.csv.gz
-- --cohort_index_date "2025-02-01"
#needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2025.csv.gz
wp1_processing_main:
run: r:v2 analysis/wp1/0_wp1_processing_main.R
needs: [generate_dataset_wp1_common, generate_dataset_wp1_2023]
outputs:
highly_sensitive:
data: output/wp1/wp1_main.csv
moderately_sensitive:
csv: output/wp1/checks/main/check_*.csv
figs: output/wp1/checks/main/figures/*.png
txt: output/wp1/checks/main/skim*.txt
wp1_processing_ts:
run: r:v2 analysis/wp1/1_wp1_processing_ts.R
needs: [generate_dataset_wp1_common, generate_dataset_wp1_2019, generate_dataset_wp1_2020, generate_dataset_wp1_2021, generate_dataset_wp1_2022, generate_dataset_wp1_2023, generate_dataset_wp1_2024, generate_dataset_wp1_2025]
outputs:
highly_sensitive:
data: output/wp1/wp1_ts*.csv.gz
moderately_sensitive:
csv: output/wp1/checks/ts/*.csv
figs: output/wp1/checks/ts/figures/*.png
txt: output/wp1/checks/ts/skim*.txt
wp1_timeseries:
run: r:v2 analysis/wp1/2_wp1_timeseries.R
needs: [wp1_processing_ts]
outputs:
moderately_sensitive:
csv: output/wp1/wp1_timeseries.csv
plot: output/wp1/figures/plot*.png
# wp1_tables:
# run: r:v2 analysis/wp1/3_wp1_tables.R
# needs: [wp1_processing_main]
# outputs:
# moderately_sensitive:
# csv: output/wp1/tables/wp1_*.csv
# wp1_combinations:
# run: r:v2 analysis/wp1/4_wp1_combinations.R
# needs: [wp1_processing]
# outputs:
# moderately_sensitive:
# csv: output/wp1/wp1_combinations.csv
Job statistics
Timeline
-
Created:
-
Runtime:
These timestamps are generated and stored using the UTC timezone on the TPP backend.
Job request
- Status
-
Nothing to do
- Backend
- TPP
- Workspace
- reduce-wp1
- Requested by
- Andrea Schaffer
- Branch
- main
- Force run dependencies
- No
- Git commit hash
- 7fbf391
- Requested actions
-
-
generate_dataset_wp1_2025
-
Code comparison
Compare the code used in this job request