Concepts of Machine Learning

Module outline

Using a combination of lectures and lab work, the module covers bio-inspired machine learning paradigms giving students knowledge of advanced features of various methods at the theoretical and practical levels. This is an MSc level module which is also offered to undergraduate students.

Aims

The module covers computational algorithms for learning from data, data-driven decision making and complex problem solving. It provides an introduction to machine learning methods, such as neural networks, fuzzy logic, fuzzy clustering, bio-inspired computing, and covers basic concepts of feature selection and generalisation.

Learning Outcomes

• Discuss essential facts, concepts, principles and theories of machine learning.
• Discus fundamental issues relating to the design and implementation of systems that employ machine learning
• Apply theoretical understanding of machine learning paradigms to solve data modelling, classification and decision making problems.
• Recognise social, ethical & professional issues and risk involved in the application and use of machine learning methods.
• Recognise and analyse specifications appropriate to specific problems and plan strategies for their solution.
• Describe the process involved in the effective deployment of machine learning.
• Evaluate machine learning methods in terms of general quality attributes and possible trade-offs presented within the given problem.

Syllabus

• Learning from data

• Feature selection and generalisation

• Supervised and unsupervised learning methods, and clustering as an unsupervised learning problem

• Fuzzy logic and fuzzy clustering

• Deep networks:architectures and learning algorithms

• Natural computing: genetic algorithms, evolutionary algorithms, evolution strategies, swarm intelligence

• Advanced learning and evolution schemes: ensembles, boosting, hybrid algorithms, neuro-evolution

Prerequisites

No specific module is pre- or co- requisite but knowledge of calculus and linear algebra is essential as the module uses mathematical concepts, such as vector, matrices and their operations, functions and graphs, gradient, derivative. The module also uses trigonometry concepts, statistical concepts and the notion of probability, data structures, first-order and second-order optimisation methods and general algorithmic concepts. MATLAB and Python are used in the labs.

Timetable

All dates and timetables are listed in the programme handbooks of individual programmes.

Coursework

There is no coursework element for undergaduate students.

Assessment

Two-hour written examination (100%)

Recommended reading

• S. Marsland, Machine Learning: an Algorithmic Perspective, CRC Press.
• M. Negnevitsky, Artificial Intelligence: a Guide to Intelligent Systems, Addison Wesley.
• E. Alpaydin, Introduction to Machine Learning, MIT Press.
• R. Rojas, Neural Networks-A Systematic Introduction. Available online at: http://page.mi.fu-berlin.de/rojas/neural/
• S. Theodoridis, K. Koutroumbas, Pattern Recognition, Academic Press.

• S. Boyd, L. Vandenberghe, Convex Optimization, Cambridge University Press. Available online at: https://web.stanford.edu/~boyd/cvxbook/

• R. Battiti, First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method, Neural Computation 4(2). Available online at: https://www.researchgate.net/publication/2498372_First-_and_Second-Order_Methods_for_Learning_Between_Steepest_Descent_and_Newton's_Method

• L. Bottou, F.E. Curtis, J. Nocedal, Optimization Methods for Large-Scale Machine Learning. Available online at: https://arxiv.org/pdf/1606.04838.pdf

• Students will be pointed to papers available online and other Web resources on the subject.