Job request: 16458
- Organisation:
- DataLab
- Workspace:
- opensafely-internal-interactive
- ID:
- ivn4yccjtag54sql
This page shows the technical details of what happened when authorised researcher Lucy B requested one or more actions to be run against real patient data in the project, within a secure environment.
By cross-referencing the indicated Requested Actions with the
Pipeline section below, you can infer what
security level
various outputs were written to. Outputs marked as
highly_sensitive
can never be viewed directly by a researcher; they can only
request that code runs against them. Outputs marked as
moderately_sensitive
can be viewed by an approved researcher by logging into a highly
secure environment. Only outputs marked as
moderately_sensitive
can be requested for release to the public, via a controlled
output review service.
Jobs
-
- Job identifier:
-
3n7dym2vh62m33kn
-
- Job identifier:
-
snqpa2zl3al7f3dr
-
- Job identifier:
-
o2rhervewuom4y5t
-
- Job identifier:
-
ylerdorcz3budguh
-
- Job identifier:
-
w2e4ksjlzrsb7hle
-
- Job identifier:
-
2kdrtkx3yn4u4giq
-
- Job identifier:
-
p4zzrunnterecul6
-
- Job identifier:
-
caeilf2wnuctn4sw
-
- Job identifier:
-
wzf33wkf6xa7nlfr
Pipeline
Show project.yaml
version: '3.0'
expectations:
population_size: 1000
actions:
generate_study_population_ethnicity_01GVRBWFGVNW3JC0JNXJZJMS1Y:
run: cohortextractor:latest generate_cohort
--study-definition study_definition_ethnicity
--param end_date="2023-03-08"
--output-dir output/01GVRBWFGVNW3JC0JNXJZJMS1Y --output-format=csv.gz
outputs:
highly_sensitive:
cohort: output/01GVRBWFGVNW3JC0JNXJZJMS1Y/input_ethnicity.csv.gz
generate_study_population_01GVRBWFGVNW3JC0JNXJZJMS1Y:
run: cohortextractor:latest generate_cohort
--study-definition study_definition
--param codelist_1_path="codelists/codelist_1.csv"
--param codelist_1_type="medication"
--param codelist_2_path="codelists/codelist_2.csv"
--param codelist_2_type="event"
--param codelist_1_frequency="monthly"
--param time_value="3"
--param time_scale="weeks"
--param time_event="before"
--param codelist_2_comparison_date="end_date"
--param operator="AND"
--param population="all"
--param breakdowns="sex,ethnicity,age"
--index-date-range="2022-09-09 to 2023-03-08 by month"
--output-dir=output/01GVRBWFGVNW3JC0JNXJZJMS1Y
--output-format=csv.gz
outputs:
highly_sensitive:
cohort: output/01GVRBWFGVNW3JC0JNXJZJMS1Y/input_*.csv.gz
join_cohorts_01GVRBWFGVNW3JC0JNXJZJMS1Y:
run: >
cohort-joiner:v0.0.38
--lhs output/01GVRBWFGVNW3JC0JNXJZJMS1Y/input_20*.csv.gz
--rhs output/01GVRBWFGVNW3JC0JNXJZJMS1Y/input_ethnicity.csv.gz
--output-dir output/01GVRBWFGVNW3JC0JNXJZJMS1Y/joined
needs: [generate_study_population_01GVRBWFGVNW3JC0JNXJZJMS1Y, generate_study_population_ethnicity_01GVRBWFGVNW3JC0JNXJZJMS1Y]
outputs:
highly_sensitive:
cohort: output/01GVRBWFGVNW3JC0JNXJZJMS1Y/joined/input_20*.csv.gz
generate_measures_01GVRBWFGVNW3JC0JNXJZJMS1Y:
run: >
python:latest -m analysis.measures
--breakdowns="sex,ethnicity,age"
--input_dir="output/01GVRBWFGVNW3JC0JNXJZJMS1Y/joined"
--measure="med_review"
needs: [join_cohorts_01GVRBWFGVNW3JC0JNXJZJMS1Y]
outputs:
moderately_sensitive:
measure: output/01GVRBWFGVNW3JC0JNXJZJMS1Y/joined/measure*rate.csv
decile_measure: output/01GVRBWFGVNW3JC0JNXJZJMS1Y/joined/measure*rate_deciles.csv
top_5_table_01GVRBWFGVNW3JC0JNXJZJMS1Y:
run: >
python:latest python analysis/top_5.py
--codelist-1-path="codelists/codelist_1.csv"
--codelist-2-path="codelists/codelist_2.csv"
--output-dir="output/01GVRBWFGVNW3JC0JNXJZJMS1Y"
needs: [generate_measures_01GVRBWFGVNW3JC0JNXJZJMS1Y]
outputs:
moderately_sensitive:
tables: output/01GVRBWFGVNW3JC0JNXJZJMS1Y/joined/top_5*.csv
deciles_chart_01GVRBWFGVNW3JC0JNXJZJMS1Y:
run: >
deciles-charts:v0.0.33
--input-files output/01GVRBWFGVNW3JC0JNXJZJMS1Y/joined/measure_practice_rate_deciles.csv
--output-dir output/01GVRBWFGVNW3JC0JNXJZJMS1Y/joined
config:
show_outer_percentiles: true
tables:
output: true
charts:
output: true
needs: [generate_measures_01GVRBWFGVNW3JC0JNXJZJMS1Y]
outputs:
moderately_sensitive:
deciles_charts: output/01GVRBWFGVNW3JC0JNXJZJMS1Y/joined/deciles_*.*
plot_measure_01GVRBWFGVNW3JC0JNXJZJMS1Y:
run: >
python:latest python analysis/plot_measures.py
--breakdowns="sex,ethnicity,age"
--output-dir output/01GVRBWFGVNW3JC0JNXJZJMS1Y
needs: [generate_measures_01GVRBWFGVNW3JC0JNXJZJMS1Y]
outputs:
moderately_sensitive:
measure: output/01GVRBWFGVNW3JC0JNXJZJMS1Y/plot_measure*.png
event_counts_01GVRBWFGVNW3JC0JNXJZJMS1Y:
run: >
python:latest python analysis/event_counts.py --input_dir="output/01GVRBWFGVNW3JC0JNXJZJMS1Y/joined" --output_dir="output/01GVRBWFGVNW3JC0JNXJZJMS1Y"
needs: [join_cohorts_01GVRBWFGVNW3JC0JNXJZJMS1Y]
outputs:
moderately_sensitive:
measure: output/01GVRBWFGVNW3JC0JNXJZJMS1Y/event_counts.json
generate_report_01GVRBWFGVNW3JC0JNXJZJMS1Y:
run: >
python:latest python analysis/render_report.py
--output-dir="output/01GVRBWFGVNW3JC0JNXJZJMS1Y"
--report-title="DMARDs & Care planning medication review simple reference set - NHS Digital"
--population="all"
--breakdowns="sex,ethnicity,age"
--codelist-1-name="DMARDs"
--codelist-2-name="Care planning medication review simple reference set - NHS Digital"
--codelist-1-link="opensafely/dmards/2020-06-23"
--codelist-2-link="opensafely/care-planning-medication-review-simple-reference-set-nhs-digital/61b13c39"
--time-value="3"
--time-scale="weeks"
--time-event="before"
--start-date="2022-09-09"
--end-date="2023-03-08"
needs: [event_counts_01GVRBWFGVNW3JC0JNXJZJMS1Y, deciles_chart_01GVRBWFGVNW3JC0JNXJZJMS1Y, top_5_table_01GVRBWFGVNW3JC0JNXJZJMS1Y, plot_measure_01GVRBWFGVNW3JC0JNXJZJMS1Y]
outputs:
moderately_sensitive:
notebook: output/01GVRBWFGVNW3JC0JNXJZJMS1Y/report.html
Timeline
-
Created:
-
Started:
-
Finished:
-
Runtime: 03:22:17
These timestamps are generated and stored using the UTC timezone on the TPP backend.
Job information
- Status
-
Failed
- Backend
- TPP
- Workspace
- opensafely-internal-interactive
- Requested by
- Lucy B
- Branch
- main
- Force run dependencies
- Yes
- Git commit hash
- 37dd102
- Requested actions
-
-
run_all
-