Job request: 17036
- Organisation:
- Bennett Institute
- Workspace:
- the-impact-of-covid-19-on-prescribing-of-antimicrobials-interactive
- ID:
- 5av44r3y5yyrbwaz
This page shows the technical details of what happened when the authorised researcher Brian MacKenna (PHC) requested one or more actions to be run against real patient data within a secure environment.
By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.
The output security levels are:
-
highly_sensitive
- Researchers can never directly view these outputs
- Researchers can only request code is run against them
-
moderately_sensitive
- Can be viewed by an approved researcher by logging into a highly secure environment
- These are the only outputs that can be requested for public release via a controlled output review service.
Jobs
-
- Job identifier:
-
dwlu3rgk5yj5edex
-
- Job identifier:
-
tl6fr6cdjxtmhxqq
-
- Job identifier:
-
mha3dodypzux4v66
-
- Job identifier:
-
bif2uljfzm2hexek
-
- Job identifier:
-
hsxj6akfwteuc4wv
-
- Job identifier:
-
chlsadtjxvbhc2wa
-
- Job identifier:
-
rzxwuxwlzyoqyzdd
-
- Job identifier:
-
75azot4comoal4gu
-
- Job identifier:
-
3qw3zpc2hmzqdawy
Pipeline
Show project.yaml
version: '3.0'
expectations:
population_size: 1000
actions:
generate_study_population_ethnicity_01GXRGPJJKRJB2GQWFWWBCH43Z:
run: cohortextractor:latest generate_cohort
--study-definition study_definition_ethnicity
--param end_date="2023-04-05"
--output-dir output/01GXRGPJJKRJB2GQWFWWBCH43Z --output-format=csv.gz
outputs:
highly_sensitive:
cohort: output/01GXRGPJJKRJB2GQWFWWBCH43Z/input_ethnicity.csv.gz
generate_study_population_01GXRGPJJKRJB2GQWFWWBCH43Z:
run: cohortextractor:latest generate_cohort
--study-definition study_definition
--param codelist_1_path="interactive_codelists/codelist_1.csv"
--param codelist_1_type="medication"
--param codelist_2_path="interactive_codelists/codelist_2.csv"
--param codelist_2_type="event"
--param codelist_1_frequency="monthly"
--param time_value="10"
--param time_scale="years"
--param time_event="before"
--param codelist_2_comparison_date="end_date"
--param operator="AND"
--param population="adults"
--param breakdowns="sex,age,ethnicity,imd,region"
--index-date-range="2019-09-01 to 2023-04-05 by month"
--output-dir=output/01GXRGPJJKRJB2GQWFWWBCH43Z
--output-format=csv.gz
outputs:
highly_sensitive:
cohort: output/01GXRGPJJKRJB2GQWFWWBCH43Z/input_*.csv.gz
join_cohorts_01GXRGPJJKRJB2GQWFWWBCH43Z:
run: >
cohort-joiner:v0.0.38
--lhs output/01GXRGPJJKRJB2GQWFWWBCH43Z/input_20*.csv.gz
--rhs output/01GXRGPJJKRJB2GQWFWWBCH43Z/input_ethnicity.csv.gz
--output-dir output/01GXRGPJJKRJB2GQWFWWBCH43Z/joined
needs: [generate_study_population_01GXRGPJJKRJB2GQWFWWBCH43Z, generate_study_population_ethnicity_01GXRGPJJKRJB2GQWFWWBCH43Z]
outputs:
highly_sensitive:
cohort: output/01GXRGPJJKRJB2GQWFWWBCH43Z/joined/input_20*.csv.gz
generate_measures_01GXRGPJJKRJB2GQWFWWBCH43Z:
run: >
python:latest -m analysis.measures
--breakdowns="sex,age,ethnicity,imd,region"
--input_dir="output/01GXRGPJJKRJB2GQWFWWBCH43Z/joined"
--measure="med_review"
needs: [join_cohorts_01GXRGPJJKRJB2GQWFWWBCH43Z]
outputs:
moderately_sensitive:
measure: output/01GXRGPJJKRJB2GQWFWWBCH43Z/joined/measure*rate.csv
decile_measure: output/01GXRGPJJKRJB2GQWFWWBCH43Z/joined/measure*rate_deciles.csv
top_5_table_01GXRGPJJKRJB2GQWFWWBCH43Z:
run: >
python:latest python analysis/top_5.py
--codelist-1-path="interactive_codelists/codelist_1.csv"
--codelist-2-path="interactive_codelists/codelist_2.csv"
--output-dir="output/01GXRGPJJKRJB2GQWFWWBCH43Z"
needs: [generate_measures_01GXRGPJJKRJB2GQWFWWBCH43Z]
outputs:
moderately_sensitive:
tables: output/01GXRGPJJKRJB2GQWFWWBCH43Z/joined/top_5*.csv
deciles_chart_01GXRGPJJKRJB2GQWFWWBCH43Z:
run: >
deciles-charts:v0.0.33
--input-files output/01GXRGPJJKRJB2GQWFWWBCH43Z/joined/measure_practice_rate_deciles.csv
--output-dir output/01GXRGPJJKRJB2GQWFWWBCH43Z/joined
config:
show_outer_percentiles: true
tables:
output: true
charts:
output: true
needs: [generate_measures_01GXRGPJJKRJB2GQWFWWBCH43Z]
outputs:
moderately_sensitive:
deciles_charts: output/01GXRGPJJKRJB2GQWFWWBCH43Z/joined/deciles_*.*
plot_measure_01GXRGPJJKRJB2GQWFWWBCH43Z:
run: >
python:latest python analysis/plot_measures.py
--breakdowns="sex,age,ethnicity,imd,region"
--output-dir output/01GXRGPJJKRJB2GQWFWWBCH43Z
needs: [generate_measures_01GXRGPJJKRJB2GQWFWWBCH43Z]
outputs:
moderately_sensitive:
measure: output/01GXRGPJJKRJB2GQWFWWBCH43Z/plot_measure*.png
event_counts_01GXRGPJJKRJB2GQWFWWBCH43Z:
run: >
python:latest python analysis/event_counts.py --input_dir="output/01GXRGPJJKRJB2GQWFWWBCH43Z/joined" --output_dir="output/01GXRGPJJKRJB2GQWFWWBCH43Z"
needs: [join_cohorts_01GXRGPJJKRJB2GQWFWWBCH43Z]
outputs:
moderately_sensitive:
measure: output/01GXRGPJJKRJB2GQWFWWBCH43Z/event_counts.json
generate_report_01GXRGPJJKRJB2GQWFWWBCH43Z:
run: >
python:latest python analysis/render_report.py
--output-dir="output/01GXRGPJJKRJB2GQWFWWBCH43Z"
--report-title="Doxycycline (tetracyclines) & Chronic obstructive pulmonary disease (COPD) codes"
--population="adults"
--breakdowns="sex,age,ethnicity,imd,region"
--codelist-1-name="Doxycycline (tetracyclines)"
--codelist-2-name="Chronic obstructive pulmonary disease (COPD) codes"
--codelist-1-link="user/alexorlek/doxycycline-tetracyclines/4458c45a"
--codelist-2-link="nhsd-primary-care-domain-refsets/copd_cod/20210127"
--time-value="10"
--time-scale="years"
--time-event="before"
--start-date="2019-09-01"
--end-date="2023-04-05"
needs: [event_counts_01GXRGPJJKRJB2GQWFWWBCH43Z, deciles_chart_01GXRGPJJKRJB2GQWFWWBCH43Z, top_5_table_01GXRGPJJKRJB2GQWFWWBCH43Z, plot_measure_01GXRGPJJKRJB2GQWFWWBCH43Z]
outputs:
moderately_sensitive:
notebook: output/01GXRGPJJKRJB2GQWFWWBCH43Z/report.html
Timeline
-
Created:
-
Started:
-
Finished:
-
Runtime: 20:50:50
These timestamps are generated and stored using the UTC timezone on the TPP backend.
Job request
- Status
-
Succeeded
- Backend
- TPP
- Requested by
- Brian MacKenna (PHC)
- Branch
- main
- Force run dependencies
- Yes
- Git commit hash
- 18ea823
- Requested actions
-
-
run_all
-
Code comparison
Compare the code used in this job request