Job request: 23917
- Organisation:
- King's College London
- Workspace:
- incidence_longtermconditions
- ID:
- 5yksnpetdr3ag6oh
This page shows the technical details of what happened when the authorised researcher Mark Russell requested one or more actions to be run against real patient data within a secure environment.
By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.
The output security levels are:
-
highly_sensitive
- Researchers can never directly view these outputs
- Researchers can only request code is run against them
-
moderately_sensitive
- Can be viewed by an approved researcher by logging into a highly secure environment
- These are the only outputs that can be requested for public release via a controlled output review service.
Jobs
-
- Job identifier:
-
onya76terigax2lt - Error:
- cancelled_by_user: Cancelled by user
-
- Job identifier:
-
4araxs4sgdv4fo3p - Error:
- cancelled_by_user: Cancelled by user
-
- Job identifier:
-
s4yx4k7hs5ntugkv - Error:
- cancelled_by_user: Cancelled by user
-
- Job identifier:
-
ncqsxnu6vece2bld - Error:
- cancelled_by_user: Cancelled by user
-
- Job identifier:
-
ckauozbk7fvmiq2i - Error:
- cancelled_by_user: Cancelled by user
-
- Job identifier:
-
ehugfthdawxlak2y - Error:
- cancelled_by_user: Cancelled by user
-
- Job identifier:
-
oh3iefgcxogz2k2e - Error:
- cancelled_by_user: Cancelled by user
-
- Job identifier:
-
5gefk6zpi2afzcqj - Error:
- cancelled_by_user: Cancelled by user
Pipeline
Show project.yaml
version: '3.0'
expectations:
population_size: 10000
actions:
generate_dataset:
run: ehrql:v1 generate-dataset analysis/dataset_definition.py
--output output/dataset_definition.csv
outputs:
highly_sensitive:
cohort: output/dataset_definition.csv
measures_dataset_2015:
run: ehrql:v1 generate-measures analysis/dataset_definition_measures.py
--output output/measures/measures_dataset_2015.csv
--
--start-date "2015-03-01"
--intervals 12
needs: [generate_dataset]
outputs:
highly_sensitive:
measure_csv: output/measures/measures_dataset_2015.csv
measures_dataset_2016:
run: ehrql:v1 generate-measures analysis/dataset_definition_measures.py
--output output/measures/measures_dataset_2016.csv
--
--start-date "2016-03-01"
--intervals 12
needs: [generate_dataset]
outputs:
highly_sensitive:
measure_csv: output/measures/measures_dataset_2016.csv
measures_dataset_2017:
run: ehrql:v1 generate-measures analysis/dataset_definition_measures.py
--output output/measures/measures_dataset_2017.csv
--
--start-date "2017-03-01"
--intervals 12
needs: [generate_dataset]
outputs:
highly_sensitive:
measure_csv: output/measures/measures_dataset_2017.csv
measures_dataset_2018:
run: ehrql:v1 generate-measures analysis/dataset_definition_measures.py
--output output/measures/measures_dataset_2018.csv
--
--start-date "2018-03-01"
--intervals 12
needs: [generate_dataset]
outputs:
highly_sensitive:
measure_csv: output/measures/measures_dataset_2018.csv
measures_dataset_2019:
run: ehrql:v1 generate-measures analysis/dataset_definition_measures.py
--output output/measures/measures_dataset_2019.csv
--
--start-date "2019-03-01"
--intervals 12
needs: [generate_dataset]
outputs:
highly_sensitive:
measure_csv: output/measures/measures_dataset_2019.csv
measures_dataset_2020:
run: ehrql:v1 generate-measures analysis/dataset_definition_measures.py
--output output/measures/measures_dataset_2020.csv
--
--start-date "2020-03-01"
--intervals 12
needs: [generate_dataset]
outputs:
highly_sensitive:
measure_csv: output/measures/measures_dataset_2020.csv
measures_dataset_2021:
run: ehrql:v1 generate-measures analysis/dataset_definition_measures.py
--output output/measures/measures_dataset_2021.csv
--
--start-date "2021-03-01"
--intervals 12
needs: [generate_dataset]
outputs:
highly_sensitive:
measure_csv: output/measures/measures_dataset_2021.csv
measures_dataset_2022:
run: ehrql:v1 generate-measures analysis/dataset_definition_measures.py
--output output/measures/measures_dataset_2022.csv
--
--start-date "2022-03-01"
--intervals 12
needs: [generate_dataset]
outputs:
highly_sensitive:
measure_csv: output/measures/measures_dataset_2022.csv
run_incidence_graphs:
run: stata-mp:latest analysis/100_incidence_graphs.do
needs: [measures_dataset_2015, measures_dataset_2016, measures_dataset_2017, measures_dataset_2018, measures_dataset_2019, measures_dataset_2020, measures_dataset_2021, measures_dataset_2022]
outputs:
moderately_sensitive:
log1: logs/descriptive_tables.log
figure1: output/figures/incidence_*.svg
figure2: output/figures/prevalence_*.svg
figure3: output/figures/inc_comp_*.svg
figure4: output/figures/prev_comp_*.svg
figure5: output/figures/inc_adj_*.svg
figure6: output/figures/inc_ma_sex_*.svg
figure7: output/figures/prev_adj_*.svg
figure8: output/figures/inc_adj_ma_*.svg
figure9: output/figures/inc_adj_ma2_*.svg
figure10: output/figures/adj_ma_sex_*.svg
figure11: output/figures/adj_ma_sex2_*.svg
figure12: output/figures/adj_ma_age_*.svg
data1: output/data/arima_nonstandardised.csv
run_sarima:
run: r:latest analysis/200_sarima.R
needs: [run_incidence_graphs]
outputs:
moderately_sensitive:
log1: logs/sarima_log.txt
figure1: output/figures/observed_*.svg
figure2: output/figures/raw_pre_covid_*.svg
figure3: output/figures/differenced_pre_covid_*.svg
figure4: output/figures/seasonal_pre_covid_*.svg
figure5: output/figures/raw_acf_*.svg
figure6: output/figures/differenced_acf_*.svg
figure7: output/figures/seasonal_acf_*.svg
figure8: output/figures/auto_residuals_*.svg
figure9: output/figures/obs_pred_*.svg
table1: output/tables/change_incidence_byyear.csv
table2: output/tables/values_*.csv
Timeline
-
Created:
-
Started:
-
Finished:
-
Runtime: 12:28:31
These timestamps are generated and stored using the UTC timezone on the TPP backend.
Job request
- Status
-
Failed
- Backend
- TPP
- Workspace
- incidence_longtermconditions
- Requested by
- Mark Russell
- Branch
- main
- Force run dependencies
- No
- Git commit hash
- 1b35ff8
- Requested actions
-
-
run_all
-
Code comparison
Compare the code used in this job request