Skip to main content Skip to navigation

ES98E-10 Scientific Machine Learning

Department
School of Engineering
Level
Taught Postgraduate Level
Module leader
James Kermode
Credit value
10
Module duration
10 weeks
Assessment
60% coursework, 40% exam
Study location
University of Warwick main campus, Coventry

Introductory description

This module provides students with knowledge in the modern field of scientific machine learning, which is a fusion of scientific computing and machine learning.

Module aims

Understand how to use a variety of statistical and machine learning techniques to train models which combine data-driven and mechanics models and assess their ability to make useful predictions.

Outline syllabus

This is an indicative module outline only to give an indication of the sort of topics that may be covered. Actual sessions held may differ.

  • Advanced Gaussian process regresion techniques such as sparse GP regression and the Kennedy-O'Hagan approach to model discrepancy.
  • Dimensionality reduction as a tool for data analysis (PCA, kPCA, active subspaces)
  • Neural networks and deep neural networks
  • Neural differential equations and physics informed neural networks
  • Advanced approximate Bayesian inference: variational inference, expectation maximisation, etc.

Learning outcomes

By the end of the module, students should be able to:

  • Apply deep neural networks to accelerate scientific computing and interpret the results
  • Synthesise neural network and mechanistic models and apply them to perform scientific machine learning
  • Evaluate advanced inference techniques such as variational inference work and critique when they can be applied
  • Recognise, formulate, analyse and interpret machine learning solutions to scientific problems
  • Critique the application of machine learning methods to cutting edge problems in scientific computing

Indicative reading list

Bishop, Pattern Recognition and Machine Learning
MacKay, Information Theory, Pattern Recognition and Learning Algorithms
Rasmussen and Willians, Gaussian Processes for Machine Learning
Gelman, Bayesian Data Analysis
Hastie, The Elements of Statistical Learning: Data Mining, Inference and Prediction

View reading list on Talis Aspire

Interdisciplinary

The programme recruits students with backgrounds across the physical and mathematical sciences, including engineering, and will provide an interdisciplinary perspective on predictive modelling.

Scientific machine learning is a fusion of scientific computing and machine learning, drawing from mathematics, statistics and the modelling of physical phenomena across a wide range of application domains.

Subject specific skills

  • Machine learning
  • Computational statistics
  • Predictive modelling
  • Fusion of advanced data analysis and mathematical modelling techniques

Transferable skills

  • Data analysis and modelling
  • Oral presentation skills
  • Scientific computing

Study time

Type Required
Lectures 6 sessions of 2 hours (12%)
Supervised practical classes 5 sessions of 2 hours (10%)
Private study 78 hours (78%)
Total 100 hours

Private study description

Students will work independently to complete the assignments outside of the workshops and to prepare for the viva.

Costs

No further costs have been identified for this module.

You must pass all assessment components to pass the module.

Assessment group D
Weighting Study time Eligible for self-certification
Computer Laboratory Assignments 60% Yes (extension)

4 x 1 page assignments based upon lecture topic and computer laboratory work

Oral Examination 40% No
  1. Student presentation of how scientific machine learning is relevant to their research project and other interests
  2. Unseen questions, based on a pre-circulated list of general topics aligned with the lectures and laboratory sessions
Feedback on assessment

Annotation of computer workbooks with feedback on individual questions
Written feedback from examiners of viva voce exam

Past exam papers for ES98E

Courses

This module is Optional for:

  • TPXA-F344 Postgraduate Taught Modelling of Heterogeneous Systems
    • Year 1 of F344 Modelling of Heterogeneous Systems (MSc)
    • Year 2 of F344 Modelling of Heterogeneous Systems (MSc)
  • TPXA-F345 Postgraduate Taught Modelling of Heterogeneous Systems (PGDip)
    • Year 1 of F345 Modelling of Heterogeneous Systems (PGDip)
    • Year 2 of F345 Modelling of Heterogeneous Systems (PGDip)