Job request: 27530
- Organisation:
- University of Bristol
- Workspace:
- reduce-wp1
- ID:
- yojbmacnz2oxslty
This page shows the technical details of what happened when the authorised researcher Andrea Schaffer requested one or more actions to be run against real patient data within a secure environment.
By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.
The output security levels are:
-
highly_sensitive
- Researchers can never directly view these outputs
- Researchers can only request code is run against them
-
moderately_sensitive
- Can be viewed by an approved researcher by logging into a highly secure environment
- These are the only outputs that can be requested for public release via a controlled output review service.
Jobs
-
- Action:
- generate_dataset_wp1_2019
- Status:
- Pending
- Job identifier:
-
fy3s5hwtb56bsfp5 - Status message:
- waiting_on_db_workers: Waiting on available database workers
-
- Action:
- generate_dataset_wp1_2020
- Status:
- Pending
- Job identifier:
-
5puj2lajmxrqnhus - Status message:
- waiting_on_db_workers: Waiting on available database workers
-
- Action:
- generate_dataset_wp1_2021
- Status:
- Pending
- Job identifier:
-
wftamu54azicmjds - Status message:
- waiting_on_db_workers: Waiting on available database workers
-
- Action:
- generate_dataset_wp1_2022
- Status:
- Pending
- Job identifier:
-
tshufrk65mhcmcjz - Status message:
- waiting_on_db_workers: Waiting on available database workers
-
- Action:
- generate_dataset_wp1_2023
- Status:
- Pending
- Job identifier:
-
enqat4l5i2rbn6dk - Status message:
- waiting_on_db_workers: Waiting on available database workers
-
- Action:
- generate_dataset_wp1_2024
- Status:
- Pending
- Job identifier:
-
qcfzfsbsocqlhrix - Status message:
- waiting_on_db_workers: Waiting on available database workers
-
- Action:
- generate_dataset_wp1_2025
- Status:
- Pending
- Job identifier:
-
4mebkzqzem5nkgd5 - Status message:
- waiting_on_db_workers: Waiting on available database workers
-
- Action:
- wp1_processing_main
- Status:
- Pending
- Job identifier:
-
yzv4effsvodhelcg - Status message:
- waiting_on_dependencies: Waiting on dependencies
-
- Action:
- wp1_processing_ts
- Status:
- Pending
- Job identifier:
-
rbq24443ivjlzq4k - Status message:
- waiting_on_dependencies: Waiting on dependencies
Pipeline
Show project.yaml
version: '5.0'
actions:
# Extract population for consort diagram
# generate_dataset_consort:
# run: ehrql:v1 generate-dataset analysis/dataset_definition/dataset_definition_consort.py --output output/dataset_consort.csv.gz
# outputs:
# highly_sensitive:
# dataset: output/dataset_consort.csv.gz
# consort_diagram:
# run: python:v2 python analysis/preprocessing/consort_diagram.py
# needs: [generate_dataset_consort]
# outputs:
# moderately_sensitive:
# dataset: output/consort_diagram_dta.csv
# generate_dataset_wp1_common:
# run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_common.py --output output/tmp_dataset_wp1_common.csv.gz
# outputs:
# highly_sensitive:
# dataset: output/tmp_dataset_wp1_common.csv.gz
# diabetes_algo_wp1:
# run: diabetes-algo:v0.0.9 --output output/tmp_dataset_wp1_common.csv.gz
# config:
# df_input: tmp_dataset_wp1_common.csv.gz
# birth_date: dob
# ethnicity_cat: ethnicity_cat
# df_output: dataset_wp1_common.csv.gz
# needs:
# - generate_dataset_wp1_common
# outputs:
# highly_sensitive:
# dataset: output/dataset_wp1_common.csv.gz
generate_dataset_wp1_2019:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1.py --output output/dataset_wp1_2019.csv.gz
-- --cohort_index_date "2019-02-01"
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2019.csv.gz
generate_dataset_wp1_2020:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1.py --output output/dataset_wp1_2020.csv.gz
-- --cohort_index_date "2020-02-01"
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2020.csv.gz
generate_dataset_wp1_2021:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1.py --output output/dataset_wp1_2021.csv.gz
-- --cohort_index_date "2021-02-01"
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2021.csv.gz
generate_dataset_wp1_2022:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1.py --output output/dataset_wp1_2022.csv.gz
-- --cohort_index_date "2022-02-01"
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2022.csv.gz
generate_dataset_wp1_2023:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1.py --output output/dataset_wp1_2023.csv.gz
-- --cohort_index_date "2023-02-01"
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2023.csv.gz
generate_dataset_wp1_2024:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1.py --output output/dataset_wp1_2024.csv.gz
-- --cohort_index_date "2024-02-01"
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2024.csv.gz
generate_dataset_wp1_2025:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1.py --output output/dataset_wp1_2025.csv.gz
-- --cohort_index_date "2025-02-01"
outputs:
highly_sensitive:
dataset: output/dataset_wp1_2025.csv.gz
wp1_processing_main:
run: r:v2 analysis/wp1/0_wp1_processing_main.R
needs: [generate_dataset_wp1_2023]
outputs:
highly_sensitive:
data: output/wp1/wp1_main.csv
moderately_sensitive:
csv: output/wp1/checks/main/check_*.csv
figs: output/wp1/checks/main/figures/*.png
txt: output/wp1/checks/main/skim.txt
wp1_processing_ts:
run: r:v2 analysis/wp1/0_wp1_processing_ts.R
needs: [generate_dataset_wp1_2019, generate_dataset_wp1_2020, generate_dataset_wp1_2021, generate_dataset_wp1_2022, generate_dataset_wp1_2023, generate_dataset_wp1_2024, generate_dataset_wp1_2025]
outputs:
highly_sensitive:
data: output/wp1/wp1_ts_all.csv
moderately_sensitive:
csv2: output/wp1/checks/ts/check_*.csv
figs2: output/wp1/checks/ts/figures/*.png
txt2: output/wp1/checks/ts/skim.txt
# wp1_timeseries:
# run: r:v2 analysis/wp1/2_wp1_timeseries.R
# needs: [wp1_processing]
# outputs:
# moderately_sensitive:
# csv: output/wp1/wp1_timeseries.csv
# wp1_tables:
# run: r:v2 analysis/wp1/3_wp1_tables.R
# needs: [wp1_processing]
# outputs:
# moderately_sensitive:
# csv: output/wp1/tables/wp1_*.csv
# wp1_combos:
# run: r:v2 analysis/wp1/4_wp1_combinations.R
# needs: [wp1_processing]
# outputs:
# moderately_sensitive:
# csv: output/wp1/wp1_combinations.csv
Job statistics
| Status | Count | Percentage |
|---|---|---|
| Pending | 9 | 100% |
| Running | 0 | 0% |
| Succeeded | 0 | 0% |
| Failed | 0 | 0% |
0 / 9 (0%) complete
Timeline
-
Created:
-
Runtime:
These timestamps are generated and stored using the UTC timezone on the TPP backend.
Job request
- Status
-
Pending
- Backend
- TPP
- Workspace
- reduce-wp1
- Requested by
- Andrea Schaffer
- Branch
- main
- Force run dependencies
- No
- Git commit hash
- 292f06e
- Requested actions
-
-
generate_dataset_wp1_2019 -
generate_dataset_wp1_2020 -
generate_dataset_wp1_2021 -
generate_dataset_wp1_2022 -
generate_dataset_wp1_2023 -
generate_dataset_wp1_2024 -
generate_dataset_wp1_2025 -
wp1_processing_main -
wp1_processing_ts
-
Code comparison
Compare the code used in this job request