Job request: 2481
- Organisation:
- Bennett Institute
- Workspace:
- comparative-ve-research_main
- ID:
- mjimmqn4cw3zpqxj
This page shows the technical details of what happened when the authorised researcher Will Hulme requested one or more actions to be run against real patient data within a secure environment.
By cross-referencing the list of jobs with the pipeline section below, you can infer what security level the outputs were written to.
The output security levels are:
-
highly_sensitive
- Researchers can never directly view these outputs
- Researchers can only request code is run against them
-
moderately_sensitive
- Can be viewed by an approved researcher by logging into a highly secure environment
- These are the only outputs that can be requested for public release via a controlled output review service.
Jobs
-
- Job identifier:
-
klwux2oczacsbbez
-
- Job identifier:
-
pbnqzsg2n3mrj2lz
-
- Job identifier:
-
2z25rz373cawmyjq
-
- Job identifier:
-
gbcjlcgtsjnlsa6t
-
- Job identifier:
-
5aiead4f2f45muas
-
- Job identifier:
-
4m6n6hgv6ps5a3an
-
- Job identifier:
-
grbtjixpqbbozxb4
-
- Job identifier:
-
gdp5qc6pzv2luh4q
-
- Job identifier:
-
w5j7gvfvzphdiw4a
-
- Job identifier:
-
xodptoinkphcrjpd
Pipeline
Show project.yaml
version: '3.0'
expectations:
population_size: 100000
actions:
design:
run: r:latest analysis/process/design.R
outputs:
moderately_sensitive:
metadata: output/data/metadata*
extract:
run: cohortextractor:latest generate_cohort --study-definition study_definition --output-format feather
outputs:
highly_sensitive:
cohort: output/input.feather
data_process:
run: r:latest analysis/process/data_process.R
needs: [extract]
outputs:
highly_sensitive:
data1: output/data/data_processed.rds
data2: output/data/data_long_vax_dates.rds
data_properties:
run: r:latest analysis/process/data_properties.R output/data/data_processed.rds output/data_properties
needs: [data_process]
outputs:
moderately_sensitive:
datasummary: output/data_properties/data*.txt
data_selection:
run: r:latest analysis/process/data_selection.R
needs: [data_process]
outputs:
highly_sensitive:
data_allvax: output/data/data_cohort_allvax.rds
data: output/data/data_cohort.rds
moderately_sensitive:
flow: output/data/flowchart.csv
descr_table1:
run: r:latest analysis/descriptive/table1.R
needs: [design, data_selection]
outputs:
moderately_sensitive:
html: output/descriptive/tables/table1.html
csv: output/descriptive/tables/table1.csv
#######################################
## MATCHING
#######################################
# data_selection:
# run: r:latest analysis/process/data_selection.R
# needs: [data_process]
# outputs:
# highly_sensitive:
# data_az: output/data/data_vax_az_withoutdate.csv
# data_pfizer: output/data/data_vax_pfizer_withoutdate.csv
# data_az_date: output/data/data_vax_az_withdate.csv
# data_pfizer_date: output/data/data_vax_pfizer_withdate.csv
#
# matchwithoutdate_recipients:
# run: python:latest python analysis/matching/matchwithoutdate.py
# needs: [data_selection]
# outputs:
# highly_sensitive:
# cases: output/data/matched_cases_withoutdate.csv
# matches: output/data/matched_matches_withoutdate.csv
# combined: output/data/matched_combined_withoutdate.csv
# moderately_sensitive:
# report: output/data/matching_report_withoutdate.txt
#
# matchwithoutdate_process:
# run: r:latest analysis/matching/match_process.R withoutdate
# needs: [design, matchwithoutdate_recipients, data_selection]
# outputs:
# highly_sensitive:
# data: output/data/data_matches_withoutdate.rds
# moderately_sensitive:
# report: output/matching/matching_balance_withoutdate.html
#
#
# matchwithdate_recipients:
# run: python:latest python analysis/matching/matchwithdate.py
# needs: [data_selection]
# outputs:
# highly_sensitive:
# cases: output/data/matched_cases_withdate.csv
# matches: output/data/matched_matches_withdate.csv
# combined: output/data/matched_combined_withdate.csv
# moderately_sensitive:
# report: output/data/matching_report_withdate.txt
#
#
# matchwithdate_process:
# run: r:latest analysis/matching/match_process.R withdate
# needs: [design, matchwithdate_recipients, data_selection]
# outputs:
# highly_sensitive:
# data: output/data/data_matches_withdate.rds
# moderately_sensitive:
# report: output/matching/matching_balance_withdate.html
#######################################
## COMPARATIVE EFFECTIVENESS MODELS
## positive test outcome
#######################################
model_calendar_postest:
run: r:latest analysis/models/model_cox_calendar.R postest
needs: [design, data_selection]
outputs:
highly_sensitive:
data: output/postest/data_cox_split.rds
models: output/postest/model*.rds
moderately_sensitive:
logs: output/postest/log*.txt
report_calendar_postest:
run: r:latest analysis/models/report_cox.R postest
needs: [design, model_calendar_postest]
outputs:
moderately_sensitive:
figure: output/postest/forest*.svg
table: output/postest/estimates*.csv
model_calendar_covidadmitted:
run: r:latest analysis/models/model_cox_calendar.R covidadmitted
needs: [design, data_selection]
outputs:
highly_sensitive:
data: output/covidadmitted/data_cox_split.rds
models: output/covidadmitted/model*.rds
moderately_sensitive:
logs: output/covidadmitted/log*.txt
report_calendar_covidadmitted:
run: r:latest analysis/models/report_cox.R covidadmitted
needs: [design, model_calendar_covidadmitted]
outputs:
moderately_sensitive:
figure: output/covidadmitted/forest*.svg
table: output/covidadmitted/estimates*.csv
Timeline
-
Created:
-
Started:
-
Finished:
-
Runtime: 01:37:29
These timestamps are generated and stored using the UTC timezone on the TPP backend.
Job request
- Status
-
Succeeded
- Backend
- TPP
- Workspace
- comparative-ve-research_main
- Requested by
- Will Hulme
- Branch
- main
- Force run dependencies
- Yes
- Git commit hash
- c9cd4d2
- Requested actions
-
-
run_all
-
Code comparison
Compare the code used in this job request