Skip to content

Job request: 27523

Organisation:
University of Oxford
Workspace:
surgical-site-infection-v1
ID:
fvrpccivhf6abeth

This page shows the technical details of what happened when the authorised researcher Louis Fisher requested one or more actions to be run against real patient data within a secure environment.

By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.

The output security levels are:

  • highly_sensitive
    • Researchers can never directly view these outputs
    • Researchers can only request code is run against them
  • moderately_sensitive
    • Can be viewed by an approved researcher by logging into a highly secure environment
    • These are the only outputs that can be requested for public release via a controlled output review service.

Jobs

  • Action:
    generate_dataset_mandatory_2024-04_12months
    Status:
    Pending
    Job identifier:
    6cg7jnznoe7ijbyx
    Status message:
    waiting_on_db_workers: Waiting on available database workers
  • Action:
    table0
    Status:
    Pending
    Job identifier:
    uwymnwh5m7hckgtw
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    table0_pcsc
    Status:
    Pending
    Job identifier:
    mojgo65o53dmpyme
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    table10
    Status:
    Pending
    Job identifier:
    fnae75oi3hqzrmty
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    table3
    Status:
    Pending
    Job identifier:
    ft3ugepfyxfr32zx
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    table11
    Status:
    Pending
    Job identifier:
    d5rxdk3blelkvv2i
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    table1a
    Status:
    Pending
    Job identifier:
    bj2lrc5au6mghklj
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    table1b_pcsc
    Status:
    Pending
    Job identifier:
    2fidfhobl5v25bhk
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    table9a
    Status:
    Pending
    Job identifier:
    lthhzzeajy7s5t3i
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    parse_procedures_mandatory_2024-04_12months
    Status:
    Pending
    Job identifier:
    43yd4afvlcj3mspf
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    table_procedures_multitype_mandatory
    Status:
    Pending
    Job identifier:
    syqn3xqdjoovrcgp
    Status message:
    waiting_on_dependencies: Waiting on dependencies

Pipeline

Show project.yaml
version: '5.0'
actions:

  # ####################################################################

  # DO NOT EDIT project.yaml DIRECTLY

  # This file is created by create_project_actions.py

  # Edit and run create_project_actions.py to update the project.yaml

  # ####################################################################

  # Generate input_2024-04_12months
  generate_dataset_2024-04_12months:
    run: ehrql:v1 generate-dataset analysis/dataset_definition/dataset_definition.py --dummy-tables dummy_tables --output output/dataset_definition/input_2024-04_12months.csv.gz -- --index_date "2024-04" --span_months 12
    outputs:
      highly_sensitive:
        dataset: output/dataset_definition/input_2024-04_12months.csv.gz

  parse_procedures_2024-04_12months:
    run: python:v2 python analysis/dataset_definition/parse_procedure_events.py --input output/dataset_definition/input_2024-04_12months.csv.gz --output output/dataset_definition/input_2024-04_12months_procedures.csv.gz
    needs:
    - generate_dataset_2024-04_12months
    outputs:
      highly_sensitive:
        procedures: output/dataset_definition/input_2024-04_12months_procedures.csv.gz

  # Generate input_2015-04_120months
  generate_dataset_2015-04_120months:
    run: ehrql:v1 generate-dataset analysis/dataset_definition/dataset_definition.py --dummy-tables dummy_tables --test-data-file analysis/dataset_definition/test_dataset_definition.py --output output/dataset_definition/input_2015-04_120months.csv.gz -- --index_date "2015-04" --span_months 120
    outputs:
      highly_sensitive:
        dataset: output/dataset_definition/input_2015-04_120months.csv.gz

  parse_procedures_2015-04_120months:
    run: python:v2 python analysis/dataset_definition/parse_procedure_events.py --input output/dataset_definition/input_2015-04_120months.csv.gz --output output/dataset_definition/input_2015-04_120months_procedures.csv.gz
    needs:
    - generate_dataset_2015-04_120months
    outputs:
      highly_sensitive:
        procedures: output/dataset_definition/input_2015-04_120months_procedures.csv.gz

  # Generate input_mandatory_2024-04_12months
  generate_dataset_mandatory_2024-04_12months:
    run: ehrql:v1 generate-dataset analysis/dataset_definition/dataset_definition.py --dummy-tables dummy_tables --test-data-file analysis/dataset_definition/test_dataset_definition_mandatory.py --output output/dataset_definition/input_mandatory_2024-04_12months.csv.gz -- --index_date "2024-04" --span_months 12 --procedure_metadata "codelists/procedure_codes_metadata_mandatory.json"
    outputs:
      highly_sensitive:
        dataset: output/dataset_definition/input_mandatory_2024-04_12months.csv.gz

  parse_procedures_mandatory_2024-04_12months:
    run: python:v2 python analysis/dataset_definition/parse_procedure_events.py --input output/dataset_definition/input_mandatory_2024-04_12months.csv.gz --output output/dataset_definition/input_mandatory_2024-04_12months_procedures.csv.gz
    needs:
    - generate_dataset_mandatory_2024-04_12months
    outputs:
      highly_sensitive:
        procedures: output/dataset_definition/input_mandatory_2024-04_12months_procedures.csv.gz

  table_procedures_multitype_mandatory:
    run: python:v2 python analysis/tables/table_procedures_multitype_mandatory.py
    needs:
    - parse_procedures_mandatory_2024-04_12months
    outputs:
      moderately_sensitive:
        type_counts: output/tables/table_procedures_multitype_mandatory_type_counts.csv
        multi_type_counts: output/tables/table_procedures_multitype_mandatory_multi_type_counts.csv
        type_counts_round5: output/tables/table_procedures_multitype_mandatory_type_counts_round5.csv
        multi_type_counts_round5: output/tables/table_procedures_multitype_mandatory_multi_type_counts_round5.csv

  # Generate table0
  table0:
    run: python:v2 python analysis/tables/table0.py --index_date 2024-04 --span 12
    needs:
    - generate_dataset_mandatory_2024-04_12months
    - parse_procedures_mandatory_2024-04_12months
    outputs:
      moderately_sensitive:
        table0: output/tables/table0_mandatory_2024-04_12months.csv
        table0_round5: output/tables/table0_mandatory_2024-04_12months_round5.csv

  # Generate table1a
  table1a:
    run: python:v2 python analysis/tables/table1a.py --index_date 2024-04 --span 12
    needs:
    - generate_dataset_mandatory_2024-04_12months
    - parse_procedures_mandatory_2024-04_12months
    outputs:
      moderately_sensitive:
        table1a: output/tables/table1a_mandatory_2024-04_12months.csv
        table1a_round5: output/tables/table1a_mandatory_2024-04_12months_round5.csv

  # Generate table3
  table3:
    run: python:v2 python analysis/tables/table3.py --index_date 2024-04 --span 12
    needs:
    - generate_dataset_mandatory_2024-04_12months
    - parse_procedures_mandatory_2024-04_12months
    outputs:
      moderately_sensitive:
        table3: output/tables/table3_mandatory_2024-04_12months.csv
        table3_round5: output/tables/table3_mandatory_2024-04_12months_round5.csv

  # Generate table9a
  table9a:
    run: python:v2 python analysis/tables/table9a.py --index_date 2024-04 --span 12
    needs:
    - generate_dataset_mandatory_2024-04_12months
    - parse_procedures_mandatory_2024-04_12months
    outputs:
      moderately_sensitive:
        table9a: output/tables/table9a_mandatory_2024-04_12months.csv
        table9a_round5: output/tables/table9a_mandatory_2024-04_12months_round5.csv

  # Generate table10
  table10:
    run: python:v2 python analysis/tables/table10.py --index_date 2024-04 --span 12
    needs:
    - generate_dataset_mandatory_2024-04_12months
    - parse_procedures_mandatory_2024-04_12months
    outputs:
      moderately_sensitive:
        table10: output/tables/table10_mandatory_2024-04_12months.csv
        table10_round5: output/tables/table10_mandatory_2024-04_12months_round5.csv

  # Generate table11
  table11:
    run: python:v2 python analysis/tables/table11.py --index_date 2024-04 --span 12
    needs:
    - generate_dataset_mandatory_2024-04_12months
    - parse_procedures_mandatory_2024-04_12months
    outputs:
      moderately_sensitive:
        table11: output/tables/table11_mandatory_2024-04_12months.csv
        table11_round5: output/tables/table11_mandatory_2024-04_12months_round5.csv

  # Generate table0_pcsc
  table0_pcsc:
    run: python:v2 python analysis/tables/table0_pcsc.py --index_date 2024-04 --span 12
    needs:
    - generate_dataset_mandatory_2024-04_12months
    - parse_procedures_mandatory_2024-04_12months
    outputs:
      moderately_sensitive:
        table0_pcsc: output/tables/table0_pcsc_mandatory_2024-04_12months.csv
        table0_pcsc_round5: output/tables/table0_pcsc_mandatory_2024-04_12months_round5.csv

  # Generate table1b_pcsc
  table1b_pcsc:
    run: python:v2 python analysis/tables/table1b_pcsc.py --index_date 2024-04 --span 12
    needs:
    - generate_dataset_mandatory_2024-04_12months
    - parse_procedures_mandatory_2024-04_12months
    outputs:
      moderately_sensitive:
        table1b_pcsc: output/tables/table1b_pcsc_mandatory_2024-04_12months.csv
        table1b_pcsc_round5: output/tables/table1b_pcsc_mandatory_2024-04_12months_round5.csv

Job statistics

Status Count Percentage
Pending 11 100%
Running 0 0%
Succeeded 0 0%
Failed 0 0%

0 / 11 (0%) complete

Timeline

  • Created:

  • Runtime:

These timestamps are generated and stored using the UTC timezone on the TPP backend.

Job request

Status
Pending
Backend
TPP
Requested by
Louis Fisher
Branch
main
Force run dependencies
No
Git commit hash
95c05f7
Requested actions
  • generate_dataset_mandatory_2024-04_12months
  • parse_procedures_mandatory_2024-04_12months
  • table_procedures_multitype_mandatory
  • table0
  • table1a
  • table3
  • table9a
  • table10
  • table11
  • table0_pcsc
  • table1b_pcsc

Code comparison

Compare the code used in this job request