Skip to content

Job request: 27353

Organisation:
NICE
Workspace:
nice001-osteo-mta
ID:
ppdefneqor2lobuy

This page shows the technical details of what happened when the authorised researcher Meghna Dey requested one or more actions to be run against real patient data within a secure environment.

By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.

The output security levels are:

  • highly_sensitive
    • Researchers can never directly view these outputs
    • Researchers can only request code is run against them
  • moderately_sensitive
    • Can be viewed by an approved researcher by logging into a highly secure environment
    • These are the only outputs that can be requested for public release via a controlled output review service.

Jobs

  • Action:
    generate_wrist_candidates
    Status:
    Succeeded
    Job identifier:
    zlhl44tzxampxlzo
  • Action:
    generate_vertebral_candidates
    Status:
    Succeeded
    Job identifier:
    u24nu76ml6okzv3a
  • Action:
    generate_prox_humerus_candidates
    Status:
    Succeeded
    Job identifier:
    hwloduw365ysq5ev
  • Action:
    prepare_prox_humerus_selection_qa
    Status:
    Pending
    Job identifier:
    6eboi4auwwrc3eld
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    check_vertebral_index_selection
    Status:
    Pending
    Job identifier:
    xj5njf4cu4pnikrb
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    prepare_vertebral_selection_qa
    Status:
    Pending
    Job identifier:
    2xnt33it3bsaq7ol
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    select_wrist_index_event
    Status:
    Pending
    Job identifier:
    jve2ji5hft7wz3hb
    Status message:
    waiting_on_workers: Waiting on available workers
  • Action:
    check_wrist_index_selection
    Status:
    Pending
    Job identifier:
    q2j6awhhdcrj2nzh
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    prepare_wrist_selection_qa
    Status:
    Pending
    Job identifier:
    q5molp7hmijquigd
    Status message:
    waiting_on_dependencies: Waiting on dependencies
  • Action:
    select_vertebral_index_event
    Status:
    Pending
    Job identifier:
    byysbkrh5efrycpw
    Status message:
    waiting_on_workers: Waiting on available workers
  • Action:
    select_prox_humerus_index_event
    Status:
    Pending
    Job identifier:
    pdgfwgq6kb6b73at
    Status message:
    waiting_on_workers: Waiting on available workers
  • Action:
    check_prox_humerus_index_selection
    Status:
    Pending
    Job identifier:
    d7zo2nddt4nhgm5t
    Status message:
    waiting_on_dependencies: Waiting on dependencies

Pipeline

Show project.yaml
version: '5.0'

actions:
  generate_dataset:
    run: ehrql:v1 generate-dataset analysis/dataset_definition.py --test-data-file analysis/test_dataset_definition.py --output output/dataset.csv.gz
    outputs:
      highly_sensitive:
        dataset: output/dataset.csv.gz

  select_hip_index_event:
    run: python:v2 python analysis/select_hip_index_event.py
    needs: [generate_dataset]
    outputs:
      highly_sensitive:
        selected_cases: output/selected_hip_index_cases.csv
        selection_qa: output/selected_hip_index_cases_qa.csv

  check_hip_index_selection:
    run: python:v2 python analysis/check_hip_index_selection.py
    needs:
      - generate_dataset
      - select_hip_index_event
    outputs:
      highly_sensitive:
        selection_check: output/hip_index_selection_check.txt

  prepare_hip_selection_qa:
    run: python:v2 python analysis/prepare_selection_qa.py hip
    needs:
      - select_hip_index_event
      - check_hip_index_selection
    outputs:
      moderately_sensitive:
        selection_qa: output/selected_hip_index_cases_qa_sdc.csv

  generate_wrist_candidates:
    run: ehrql:v1 generate-dataset analysis/dataset_definition_wrist.py --test-data-file analysis/test_dataset_definition_wrist.py --output output/wrist_candidates.csv.gz
    outputs:
      highly_sensitive:
        wrist_candidates: output/wrist_candidates.csv.gz

  select_wrist_index_event:
    run: python:v2 python analysis/select_wrist_index_event.py
    needs: [generate_wrist_candidates]
    outputs:
      highly_sensitive:
        selected_cases: output/selected_wrist_index_cases.csv
        selection_qa: output/selected_wrist_index_cases_qa.csv

  check_wrist_index_selection:
    run: python:v2 python analysis/check_wrist_index_selection.py
    needs:
      - generate_wrist_candidates
      - select_wrist_index_event
    outputs:
      highly_sensitive:
        selection_check: output/wrist_index_selection_check.txt

  prepare_wrist_selection_qa:
    run: python:v2 python analysis/prepare_selection_qa.py wrist
    needs:
      - select_wrist_index_event
      - check_wrist_index_selection
    outputs:
      moderately_sensitive:
        selection_qa: output/selected_wrist_index_cases_qa_sdc.csv

  generate_vertebral_candidates:
    run: ehrql:v1 generate-dataset analysis/dataset_definition_vertebral.py --test-data-file analysis/test_dataset_definition_vertebral.py --output output/vertebral_candidates.csv.gz
    outputs:
      highly_sensitive:
        vertebral_candidates: output/vertebral_candidates.csv.gz

  select_vertebral_index_event:
    run: python:v2 python analysis/select_vertebral_index_event.py
    needs: [generate_vertebral_candidates]
    outputs:
      highly_sensitive:
        selected_cases: output/selected_vertebral_index_cases.csv
        selection_qa: output/selected_vertebral_index_cases_qa.csv

  check_vertebral_index_selection:
    run: python:v2 python analysis/check_vertebral_index_selection.py
    needs:
      - generate_vertebral_candidates
      - select_vertebral_index_event
    outputs:
      highly_sensitive:
        selection_check: output/vertebral_index_selection_check.txt

  prepare_vertebral_selection_qa:
    run: python:v2 python analysis/prepare_selection_qa.py vertebral
    needs:
      - select_vertebral_index_event
      - check_vertebral_index_selection
    outputs:
      moderately_sensitive:
        selection_qa: output/selected_vertebral_index_cases_qa_sdc.csv

  generate_prox_humerus_candidates:
    run: ehrql:v1 generate-dataset analysis/dataset_definition_prox_humerus.py --test-data-file analysis/test_dataset_definition_prox_humerus.py --output output/prox_humerus_candidates.csv.gz
    outputs:
      highly_sensitive:
        prox_humerus_candidates: output/prox_humerus_candidates.csv.gz

  select_prox_humerus_index_event:
    run: python:v2 python analysis/select_prox_humerus_index_event.py
    needs: [generate_prox_humerus_candidates]
    outputs:
      highly_sensitive:
        selected_cases: output/selected_prox_humerus_index_cases.csv
        selection_qa: output/selected_prox_humerus_index_cases_qa.csv

  check_prox_humerus_index_selection:
    run: python:v2 python analysis/check_prox_humerus_index_selection.py
    needs:
      - generate_prox_humerus_candidates
      - select_prox_humerus_index_event
    outputs:
      highly_sensitive:
        selection_check: output/prox_humerus_index_selection_check.txt

  prepare_prox_humerus_selection_qa:
    run: python:v2 python analysis/prepare_selection_qa.py prox_humerus
    needs:
      - select_prox_humerus_index_event
      - check_prox_humerus_index_selection
    outputs:
      moderately_sensitive:
        selection_qa: output/selected_prox_humerus_index_cases_qa_sdc.csv

Job statistics

Status Count Percentage
Pending 9 75%
Running 0 0%
Succeeded 3 25%
Failed 0 0%

3 / 12 (25%) complete

Timeline

  • Created:

  • Started:

  • Runtime: 01:45:37

These timestamps are generated and stored using the UTC timezone on the TPP backend.

Job request

Status
Running
Backend
TPP
Workspace
nice001-osteo-mta
Requested by
Meghna Dey
Branch
cohortbuild_md
Force run dependencies
No
Git commit hash
735d298
Requested actions
  • prepare_wrist_selection_qa
  • prepare_vertebral_selection_qa
  • prepare_prox_humerus_selection_qa

Code comparison

Compare the code used in this job request