Job request: 27353
- Organisation:
- NICE
- Workspace:
- nice001-osteo-mta
- ID:
- ppdefneqor2lobuy
This page shows the technical details of what happened when the authorised researcher Meghna Dey requested one or more actions to be run against real patient data within a secure environment.
By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.
The output security levels are:
-
highly_sensitive
- Researchers can never directly view these outputs
- Researchers can only request code is run against them
-
moderately_sensitive
- Can be viewed by an approved researcher by logging into a highly secure environment
- These are the only outputs that can be requested for public release via a controlled output review service.
Jobs
-
- Action:
- generate_wrist_candidates
- Status:
- Succeeded
- Job identifier:
-
zlhl44tzxampxlzo
-
- Action:
- generate_vertebral_candidates
- Status:
- Succeeded
- Job identifier:
-
u24nu76ml6okzv3a
-
- Action:
- generate_prox_humerus_candidates
- Status:
- Succeeded
- Job identifier:
-
hwloduw365ysq5ev
-
- Action:
- prepare_prox_humerus_selection_qa
- Status:
- Pending
- Job identifier:
-
6eboi4auwwrc3eld - Status message:
- waiting_on_dependencies: Waiting on dependencies
-
- Action:
- check_vertebral_index_selection
- Status:
- Pending
- Job identifier:
-
xj5njf4cu4pnikrb - Status message:
- waiting_on_dependencies: Waiting on dependencies
-
- Action:
- prepare_vertebral_selection_qa
- Status:
- Pending
- Job identifier:
-
2xnt33it3bsaq7ol - Status message:
- waiting_on_dependencies: Waiting on dependencies
-
- Action:
- select_wrist_index_event
- Status:
- Pending
- Job identifier:
-
jve2ji5hft7wz3hb - Status message:
- waiting_on_workers: Waiting on available workers
-
- Action:
- check_wrist_index_selection
- Status:
- Pending
- Job identifier:
-
q2j6awhhdcrj2nzh - Status message:
- waiting_on_dependencies: Waiting on dependencies
-
- Action:
- prepare_wrist_selection_qa
- Status:
- Pending
- Job identifier:
-
q5molp7hmijquigd - Status message:
- waiting_on_dependencies: Waiting on dependencies
-
- Action:
- select_vertebral_index_event
- Status:
- Pending
- Job identifier:
-
byysbkrh5efrycpw - Status message:
- waiting_on_workers: Waiting on available workers
-
- Action:
- select_prox_humerus_index_event
- Status:
- Pending
- Job identifier:
-
pdgfwgq6kb6b73at - Status message:
- waiting_on_workers: Waiting on available workers
-
- Action:
- check_prox_humerus_index_selection
- Status:
- Pending
- Job identifier:
-
d7zo2nddt4nhgm5t - Status message:
- waiting_on_dependencies: Waiting on dependencies
Pipeline
Show project.yaml
version: '5.0'
actions:
generate_dataset:
run: ehrql:v1 generate-dataset analysis/dataset_definition.py --test-data-file analysis/test_dataset_definition.py --output output/dataset.csv.gz
outputs:
highly_sensitive:
dataset: output/dataset.csv.gz
select_hip_index_event:
run: python:v2 python analysis/select_hip_index_event.py
needs: [generate_dataset]
outputs:
highly_sensitive:
selected_cases: output/selected_hip_index_cases.csv
selection_qa: output/selected_hip_index_cases_qa.csv
check_hip_index_selection:
run: python:v2 python analysis/check_hip_index_selection.py
needs:
- generate_dataset
- select_hip_index_event
outputs:
highly_sensitive:
selection_check: output/hip_index_selection_check.txt
prepare_hip_selection_qa:
run: python:v2 python analysis/prepare_selection_qa.py hip
needs:
- select_hip_index_event
- check_hip_index_selection
outputs:
moderately_sensitive:
selection_qa: output/selected_hip_index_cases_qa_sdc.csv
generate_wrist_candidates:
run: ehrql:v1 generate-dataset analysis/dataset_definition_wrist.py --test-data-file analysis/test_dataset_definition_wrist.py --output output/wrist_candidates.csv.gz
outputs:
highly_sensitive:
wrist_candidates: output/wrist_candidates.csv.gz
select_wrist_index_event:
run: python:v2 python analysis/select_wrist_index_event.py
needs: [generate_wrist_candidates]
outputs:
highly_sensitive:
selected_cases: output/selected_wrist_index_cases.csv
selection_qa: output/selected_wrist_index_cases_qa.csv
check_wrist_index_selection:
run: python:v2 python analysis/check_wrist_index_selection.py
needs:
- generate_wrist_candidates
- select_wrist_index_event
outputs:
highly_sensitive:
selection_check: output/wrist_index_selection_check.txt
prepare_wrist_selection_qa:
run: python:v2 python analysis/prepare_selection_qa.py wrist
needs:
- select_wrist_index_event
- check_wrist_index_selection
outputs:
moderately_sensitive:
selection_qa: output/selected_wrist_index_cases_qa_sdc.csv
generate_vertebral_candidates:
run: ehrql:v1 generate-dataset analysis/dataset_definition_vertebral.py --test-data-file analysis/test_dataset_definition_vertebral.py --output output/vertebral_candidates.csv.gz
outputs:
highly_sensitive:
vertebral_candidates: output/vertebral_candidates.csv.gz
select_vertebral_index_event:
run: python:v2 python analysis/select_vertebral_index_event.py
needs: [generate_vertebral_candidates]
outputs:
highly_sensitive:
selected_cases: output/selected_vertebral_index_cases.csv
selection_qa: output/selected_vertebral_index_cases_qa.csv
check_vertebral_index_selection:
run: python:v2 python analysis/check_vertebral_index_selection.py
needs:
- generate_vertebral_candidates
- select_vertebral_index_event
outputs:
highly_sensitive:
selection_check: output/vertebral_index_selection_check.txt
prepare_vertebral_selection_qa:
run: python:v2 python analysis/prepare_selection_qa.py vertebral
needs:
- select_vertebral_index_event
- check_vertebral_index_selection
outputs:
moderately_sensitive:
selection_qa: output/selected_vertebral_index_cases_qa_sdc.csv
generate_prox_humerus_candidates:
run: ehrql:v1 generate-dataset analysis/dataset_definition_prox_humerus.py --test-data-file analysis/test_dataset_definition_prox_humerus.py --output output/prox_humerus_candidates.csv.gz
outputs:
highly_sensitive:
prox_humerus_candidates: output/prox_humerus_candidates.csv.gz
select_prox_humerus_index_event:
run: python:v2 python analysis/select_prox_humerus_index_event.py
needs: [generate_prox_humerus_candidates]
outputs:
highly_sensitive:
selected_cases: output/selected_prox_humerus_index_cases.csv
selection_qa: output/selected_prox_humerus_index_cases_qa.csv
check_prox_humerus_index_selection:
run: python:v2 python analysis/check_prox_humerus_index_selection.py
needs:
- generate_prox_humerus_candidates
- select_prox_humerus_index_event
outputs:
highly_sensitive:
selection_check: output/prox_humerus_index_selection_check.txt
prepare_prox_humerus_selection_qa:
run: python:v2 python analysis/prepare_selection_qa.py prox_humerus
needs:
- select_prox_humerus_index_event
- check_prox_humerus_index_selection
outputs:
moderately_sensitive:
selection_qa: output/selected_prox_humerus_index_cases_qa_sdc.csv
Job statistics
| Status | Count | Percentage |
|---|---|---|
| Pending | 9 | 75% |
| Running | 0 | 0% |
| Succeeded | 3 | 25% |
| Failed | 0 | 0% |
3 / 12 (25%) complete
Timeline
-
Created:
-
Started:
-
Runtime: 01:45:37
These timestamps are generated and stored using the UTC timezone on the TPP backend.
Job request
- Status
-
Running
- Backend
- TPP
- Workspace
- nice001-osteo-mta
- Requested by
- Meghna Dey
- Branch
- cohortbuild_md
- Force run dependencies
- No
- Git commit hash
- 735d298
- Requested actions
-
-
prepare_wrist_selection_qa -
prepare_vertebral_selection_qa -
prepare_prox_humerus_selection_qa
-
Code comparison
Compare the code used in this job request