Diagnostic Evidence Workshops
Wednesday, 26 September 2018 to Friday, 28 September 2018
Hosted by email@example.com
The NIHR Community Healthcare MIC is pleased to offer a series of workshops for 2018 that will build on the educational programme previously delivered by NIHR DEC Oxford. Running sequentially, the workshops will provide an introduction to evaluation of diagnostics (day 1), cost-effectiveness analysis of diagnostic tests for development and adoption (day 2), and statistical methods for diagnostic accuracy in medical research (day 3). These short courses have been developed as workshops which can be taken individually or combined depending on the requirements of the student. The workshops will be taught by front-line MIC researchers together with colleagues from industry, NICE and the NIHR.
Aimed at all professionals working on diagnostic tests including those working in industry, academia, research funding and regulatory affairs, these workshops will provide delegates with a variety of talks and workshops on what evidence is needed to obtain regulatory approval, how NICE evaluates new diagnostic technology, how to collect evidence to support adoption in routine clinical practice and different study designs, cost effectiveness analysis and statistical methods for evaluating diagnostic accuracy.
Bookings will open shortly, but if you are interested in attending, please join our mailing list.
Introduction to evaluation of diagnostics
The opening workshop of the series will provide participants with an overview of the components which one might employ for the evaluation of diagnostic tests, including health economics, basic statistics, searching for evidence and study design. We will be joined by tutors from the diagnostics industry and NIHR who will explore the challenges of seeking regulatory approval and will discuss sources of funding respectively.
Cost-effectiveness analysis of diagnostic tests for development and adoption.
This one day course aims to explain how cost-effectiveness analysis of diagnostic tests is conducted and used in the research, development and evaluation of diagnostics. It is aimed at those involved in the development and evaluation of diagnostics, in both academic and commercial settings.
Statistical methods for diagnostic accuracy in medical research
This one day course is predominately designed for researchers who want to analyse their own diagnostic accuracy data. Typically, this will be analysis on results from research carried out in an early development/exploratory phase but the methods covered will also be applicable to research in an advanced stage where tests are studied in a clinical setting. The course content is geared towards teaching “how to” rather than “why” and will make extensive use of practical sessions so that participants can gain hands-on experience of analysing diagnostic accuracy data. In the practical sessions, participants will use the free statistical software R (https://cran.r-project.org/) for completing the analyses.
Participants should have a basic understanding of statistics up to the level of confidence intervals and p values. A rudimentary knowledge of the basics of diagnostic accuracy would be advantageous but it is not necessary as we will revise the basics in the first session. Participants will be expected to bring their own laptops and have R and RStudio installed.
By taking this course:
The course will consist of four sessions with demonstrations and practical exercises. Participants will revise their understanding of common measures of diagnostic accuracy, learn how to calculate measures of diagnostic accuracy from data and quantify uncertainty in their estimates. Then learn when and how you should use ROC analysis, how to compare two diagnostic tests and finish with methods for finding optimal thresholds.
Course content in detail
1. Single summary estimates of diagnostic accuracy.
- Common measures of DA - sensitivity, specificity,
- Other summary measures- Diagnostic odds ratio, Youden’s index. Etc.
- LR+ and LR-
- Bayes theorem, PPV and NPV and prevalence
- Simple sample sizes calculations.
2. Receiver operating characteristic
- ROC space and ROC curves (pros and cons)
- Area under the curve measures (partial area under the curve)
- Smooth (parametric) ROC curves
3. Hypothesis tests for comparing the accuracy of two tests
- Tests based on either sensitivity or specificity
- Comparing two ROC AUC’s curves
- Paired and non-paired designs
4. Methods for finding optimal thresholds.
- Methods based on sensitivity and specificity alone
- Optimal thresholds based on costs (weighting for false pos and false negs)
- Graphical summaries (Net-benefit measure etc)