Job request: 27342

Organisation:: University of Bristol
Workspace:: reduce-wp1
ID:: hqypi2oesxyehlvo

This page shows the technical details of what happened when the authorised researcher Andrea Schaffer requested one or more actions to be run against real patient data within a secure environment.

By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.

The output security levels are:

highly_sensitive
- Researchers can never directly view these outputs
- Researchers can only request code is run against them
moderately_sensitive
- Can be viewed by an approved researcher by logging into a highly secure environment
- These are the only outputs that can be requested for public release via a controlled output review service.

Jobs

Action:

diabetes_algo_wp1

Status:

Pending

Job identifier:

rk47y26ko4xqm3ff

Status message:

waiting_on_dependencies: Waiting on dependencies
Action:

generate_dataset_wp1_2019

Status:

Pending

Job identifier:

6f4zxu5ansezcqoe

Status message:

waiting_db_maintenance: Waiting for database to finish maintenance
Action:

generate_dataset_wp1_2020

Status:

Pending

Job identifier:

ozkjlw4cgiwm5pcb

Status message:

waiting_db_maintenance: Waiting for database to finish maintenance
Action:

generate_dataset_wp1_2021

Status:

Pending

Job identifier:

ucyebkvs4ec6ryxm

Status message:

waiting_db_maintenance: Waiting for database to finish maintenance
Action:

generate_dataset_wp1_2022

Status:

Pending

Job identifier:

ou5aro5t6p7xvbdt

Status message:

waiting_db_maintenance: Waiting for database to finish maintenance
Action:

wp1_processing

Status:

Pending

Job identifier:

ohafvxskicetxfr4

Status message:

waiting_on_dependencies: Waiting on dependencies
Action:

wp1_checks

Status:

Pending

Job identifier:

cvlhezmgawaysgkw

Status message:

waiting_on_dependencies: Waiting on dependencies
Action:

generate_dataset_wp1_2023

Status:

Pending

Job identifier:

4c2s5wipcvy37yd6

Status message:

waiting_db_maintenance: Waiting for database to finish maintenance
Action:

generate_dataset_wp1_2024

Status:

Pending

Job identifier:

kypmk56nv23wo3ly

Status message:

waiting_db_maintenance: Waiting for database to finish maintenance
Action:

generate_dataset_wp1_2025

Status:

Pending

Job identifier:

vzc4i75zp44rqv4p

Status message:

waiting_db_maintenance: Waiting for database to finish maintenance
Action:

generate_dataset_wp1_common

Status:

Pending

Job identifier:

pik62fazuctq6yfi

Status message:

waiting_db_maintenance: Waiting for database to finish maintenance

Pipeline

Show project.yaml

version: '5.0'

actions:

  # Extract population for consort diagram

  # generate_dataset_consort:
  #   run: ehrql:v1 generate-dataset analysis/dataset_definition/dataset_definition_consort.py --output output/dataset_consort.csv.gz
  #   outputs:
  #     highly_sensitive:
  #       dataset: output/dataset_consort.csv.gz

  # consort_diagram:
  #   run: python:v2 python analysis/preprocessing/consort_diagram.py
  #   needs: [generate_dataset_consort]
  #   outputs:
  #     moderately_sensitive:
  #       dataset: output/consort_diagram_dta.csv
  
  generate_dataset_wp1_common:
    run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_common.py --output output/tmp_dataset_wp1_common.csv.gz
    outputs:
      highly_sensitive:
        dataset: output/tmp_dataset_wp1_common.csv.gz

  diabetes_algo_wp1:
    run: diabetes-algo:v0.0.9 --output output/tmp_dataset_wp1_common.csv.gz
    config:
      df_input: tmp_dataset_wp1_common.csv.gz
      birth_date: dob
      ethnicity_cat: ethnicity_cat
      df_output: dataset_wp1_common.csv.gz
    needs:
      - generate_dataset_wp1_common
    outputs:
      highly_sensitive:
        dataset: output/dataset_wp1_common.csv.gz

  generate_dataset_wp1_2019:
    run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2019.csv.gz
      -- --cohort_index_date "2019-02-01"
    outputs:
      highly_sensitive:
        dataset: output/dataset_wp1_2019.csv.gz

  generate_dataset_wp1_2020:
    run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2020.csv.gz
      -- --cohort_index_date "2020-02-01"
    outputs:
      highly_sensitive:
        dataset: output/dataset_wp1_2020.csv.gz

  generate_dataset_wp1_2021:
    run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2021.csv.gz
      -- --cohort_index_date "2021-02-01"
    outputs:
      highly_sensitive:
        dataset: output/dataset_wp1_2021.csv.gz

  generate_dataset_wp1_2022:
    run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2022.csv.gz
      -- --cohort_index_date "2022-02-01"
    outputs:
      highly_sensitive:
        dataset: output/dataset_wp1_2022.csv.gz

  generate_dataset_wp1_2023:
    run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2023.csv.gz
      -- --cohort_index_date "2023-02-01"
    outputs:
      highly_sensitive:
        dataset: output/dataset_wp1_2023.csv.gz
        
  generate_dataset_wp1_2024:
    run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2024.csv.gz
      -- --cohort_index_date "2024-02-01"
    outputs:
      highly_sensitive:
        dataset: output/dataset_wp1_2024.csv.gz
        
  generate_dataset_wp1_2025:
    run: ehrql:v1 generate-dataset analysis/dataset_definition_wp1_time_dep.py --output output/dataset_wp1_2025.csv.gz
      -- --cohort_index_date "2025-02-01"
    outputs:
      highly_sensitive:
        dataset: output/dataset_wp1_2025.csv.gz

  wp1_processing:
    run: r:v2 analysis/wp1/0_wp1_processing.R
    needs: [diabetes_algo_wp1, generate_dataset_wp1_2019, generate_dataset_wp1_2020, generate_dataset_wp1_2021, generate_dataset_wp1_2022, generate_dataset_wp1_2023, generate_dataset_wp1_2024, generate_dataset_wp1_2025]
    outputs:
      highly_sensitive:
        data: output/wp1/wp1_ts_all.csv
        data2: output/wp1/wp1_main.csv
 
  wp1_checks:
    run: r:v2 analysis/wp1/1_wp1_checks.R 
    needs: [wp1_processing]
    outputs:
      moderately_sensitive:
        csv: output/wp1/checks/main/check_*.csv
        figs: output/wp1/checks/main/check_*.png
        txt: output/wp1/checks/main/skim.txt
        csv2: output/wp1/checks/ts/check_*.csv
        figs2: output/wp1/checks/ts/check_*.png
        txt2: output/wp1/checks/ts/skim.txt

  wp1_timeseries:
    run: r:v2 analysis/wp1/2_wp1_timeseries.R 
    needs: [wp1_processing]
    outputs:
      moderately_sensitive:
        csv: output/wp1/wp1_timeseries.csv

  wp1_tables:
    run: r:v2 analysis/wp1/3_wp1_tables.R 
    needs: [wp1_processing]
    outputs:
      moderately_sensitive:
        csv: output/wp1/tables/wp1_*.csv

  wp1_combos:
    run: r:v2 analysis/wp1/4_wp1_combinations.R 
    needs: [wp1_processing]
    outputs:
      moderately_sensitive:
        csv: output/wp1/wp1_combinations.csv

Job statistics

Status	Count	Percentage
Pending	11	100%
Running	0	0%
Succeeded	0	0%
Failed	0	0%

0 / 11 (0%) complete

Timeline

Created: 10 hours ago 04 Nov 2026 16:14:01 UTC
Runtime:

These timestamps are generated and stored using the UTC timezone on the TPP backend.

Job request

Status: Pending
Backend: TPP
Workspace: reduce-wp1
Requested by: Andrea Schaffer
Branch: main
Force run dependencies: No
Git commit hash: bb45467
Requested actions: generate_dataset_wp1_common

diabetes_algo_wp1

generate_dataset_wp1_2019

generate_dataset_wp1_2020

generate_dataset_wp1_2021

generate_dataset_wp1_2022

generate_dataset_wp1_2023

generate_dataset_wp1_2024

generate_dataset_wp1_2025

wp1_processing

wp1_checks

Code comparison

Compare the code used in this job request

No previous job request available for comparison