Job request: 27533
- Organisation:
- University of Bristol
- Workspace:
- reduce-wp1
- ID:
- ikmzq45vngfszizp
This page shows the technical details of what happened when the authorised researcher Andrea Schaffer requested one or more actions to be run against real patient data within a secure environment.
By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.
The output security levels are:
-
highly_sensitive
- Researchers can never directly view these outputs
- Researchers can only request code is run against them
-
moderately_sensitive
- Can be viewed by an approved researcher by logging into a highly secure environment
- These are the only outputs that can be requested for public release via a controlled output review service.
Jobs
-
- Action:
- generate_dataset_wp1_2019
- Status:
- Failed
- Job identifier:
-
pdbc7efrqsgm4sk4 - Status message:
- cancelled_by_user: Cancelled by user
-
- Action:
- generate_dataset_wp1_2020
- Status:
- Failed
- Job identifier:
-
mlx4kpj64fzzplyr - Status message:
- cancelled_by_user: Cancelled by user
-
- Action:
- generate_dataset_wp1_2021
- Status:
- Failed
- Job identifier:
-
3wdml5hnsg4pkzjk - Status message:
- cancelled_by_user: Cancelled by user
-
- Action:
- generate_dataset_wp1_2022
- Status:
- Failed
- Job identifier:
-
2wbyznxdsi53dux2 - Status message:
- cancelled_by_user: Cancelled by user
-
- Action:
- generate_dataset_wp1_2023
- Status:
- Failed
- Job identifier:
-
kqm3hx6efrnphx2o - Status message:
- cancelled_by_user: Cancelled by user
-
- Action:
- generate_dataset_wp1_2024
- Status:
- Failed
- Job identifier:
-
2l7e2enr6zmbgs7n - Status message:
- cancelled_by_user: Cancelled by user
-
- Action:
- generate_dataset_wp1_2025
- Status:
- Failed
- Job identifier:
-
257wdm4ukgi6zaps - Status message:
- cancelled_by_user: Cancelled by user
-
- Action:
- generate_dataset_wp1_common
- Status:
- Failed
- Job identifier:
-
mfvktsj7y4rhcbja - Status message:
- cancelled_by_user: Cancelled by user
Pipeline
Show project.yaml
version: '5.0'
actions:
# Extract population for consort diagram
# generate_dataset_consort:
# run: ehrql:v1 generate-dataset analysis/dataset_definition/dataset_definition_consort.py --output output/dataset_consort.csv.gz
# outputs:
# highly_sensitive:
# dataset: output/dataset_consort.csv.gz
# consort_diagram:
# run: python:v2 python analysis/preprocessing/consort_diagram.py
# needs: [generate_dataset_consort]
# outputs:
# moderately_sensitive:
# dataset: output/consort_diagram_dta.csv
generate_dataset_wp1_common:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_common.py --output output/dataset_wp1_common.csv.gz
outputs:
highly_sensitive:
dataset: output/dataset_wp1_common.csv.gz
# diabetes_algo_wp1:
# run: diabetes-algo:v0.0.9 --output output/tmp_dataset_wp1_common.csv.gz
# config:
# df_input: tmp_dataset_wp1_common.csv.gz
# birth_date: dob
# ethnicity_cat: ethnicity_cat
# df_output: dataset_wp1_common.csv.gz
# needs:
# - generate_dataset_wp1_common
# outputs:
# highly_sensitive:
# dataset: output/dataset_wp1_common.csv.gz
generate_dataset_wp1_2019:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2019.csv.gz
-- --cohort_index_date "2019-02-01"
needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2019.csv.gz
generate_dataset_wp1_2020:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2020.csv.gz
-- --cohort_index_date "2020-02-01"
needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2020.csv.gz
generate_dataset_wp1_2021:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2021.csv.gz
-- --cohort_index_date "2021-02-01"
needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2021.csv.gz
generate_dataset_wp1_2022:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2022.csv.gz
-- --cohort_index_date "2022-02-01"
needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2022.csv.gz
generate_dataset_wp1_2023:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2023.csv.gz
-- --cohort_index_date "2023-02-01"
needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2023.csv.gz
generate_dataset_wp1_2024:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2024.csv.gz
-- --cohort_index_date "2024-02-01"
needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2024.csv.gz
generate_dataset_wp1_2025:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2025.csv.gz
-- --cohort_index_date "2025-02-01"
needs: [generate_dataset_wp1_common]
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2025.csv.gz
wp1_processing_main:
run: r:v2 analysis/wp1/0_wp1_processing_main.R
needs: [generate_dataset_wp1_2023]
outputs:
highly_sensitive:
data: output/wp1/wp1_main.csv
moderately_sensitive:
csv: output/wp1/checks/main/check_*.csv
figs: output/wp1/checks/main/figures/*.png
txt: output/wp1/checks/main/skim.txt
wp1_processing_ts:
run: r:v2 analysis/wp1/0_wp1_processing_ts.R
needs: [generate_dataset_wp1_2019, generate_dataset_wp1_2020, generate_dataset_wp1_2021, generate_dataset_wp1_2022, generate_dataset_wp1_2023, generate_dataset_wp1_2024, generate_dataset_wp1_2025]
outputs:
highly_sensitive:
data: output/wp1/wp1_ts_all.csv
moderately_sensitive:
csv2: output/wp1/checks/ts/check_*.csv
figs2: output/wp1/checks/ts/figures/*.png
txt2: output/wp1/checks/ts/skim.txt
# wp1_timeseries:
# run: r:v2 analysis/wp1/2_wp1_timeseries.R
# needs: [wp1_processing]
# outputs:
# moderately_sensitive:
# csv: output/wp1/wp1_timeseries.csv
# wp1_tables:
# run: r:v2 analysis/wp1/3_wp1_tables.R
# needs: [wp1_processing]
# outputs:
# moderately_sensitive:
# csv: output/wp1/tables/wp1_*.csv
# wp1_combos:
# run: r:v2 analysis/wp1/4_wp1_combinations.R
# needs: [wp1_processing]
# outputs:
# moderately_sensitive:
# csv: output/wp1/wp1_combinations.csv
Job statistics
| Status | Count | Percentage |
|---|---|---|
| Pending | 0 | 0% |
| Running | 0 | 0% |
| Succeeded | 0 | 0% |
| Failed | 8 | 100% |
8 / 8 (100%) complete
Timeline
-
Created:
-
Finished:
-
Runtime:
These timestamps are generated and stored using the UTC timezone on the TPP backend.
Job request
- Status
-
Failed
- Backend
- TPP
- Workspace
- reduce-wp1
- Requested by
- Andrea Schaffer
- Branch
- main
- Force run dependencies
- No
- Git commit hash
- 5212cb7
- Requested actions
-
-
generate_dataset_wp1_common -
generate_dataset_wp1_2019 -
generate_dataset_wp1_2020 -
generate_dataset_wp1_2021 -
generate_dataset_wp1_2022 -
generate_dataset_wp1_2023 -
generate_dataset_wp1_2024 -
generate_dataset_wp1_2025
-
Code comparison
Compare the code used in this job request