MACHINE LEARNING IN SUPPORT OF COMPUTATIONAL AND THEORETICAL SCIENCES
The goal of the programme is to strengthen machine learning (ML) collaboration in NITheCS in two ways:
- ML research: development of new, specialised machine learning techniques.
- ML as a tool: applying machine learning for scientific modelling applications.
Collaborating Researchers:
- Marelie Davel (PI), North-West University
- Stefan Lotz (PI), South African National Space Agency
- Cleo Conacher, Stellenbosch University
- Thipe Modipa, University of Limpopo
- Deshen Moodley, University of Cape Town
- Chris Oosthuizen, University of Cape Town
- Simon Ramalepe, University of Limpopo
- Stefan Schoombie, University of Cape Town
- Jonathan Shock, University of Cape Town
- Ilya Sinayskiy, University of KwaZulu-Natal
- Bruce Watson, Stellenbosch University
PI – Principal investigator (programme manager)
Projects
Knowledge Discovery in Time Series Data
Machine learning techniques play an increasing role in assisting scientists and engineers in knowledge discovery: obtaining novel information from large, possibly complex data sets. Many practically important tasks, such as weather prediction, financial forecasting, or speech processing, are modelled using time series information. Knowledge discovery in time series data is an active field of research, with techniques such as feature attribution used to gain new insights into the underlying processes being modelled.
Machine Learning Forum
The programme aims to grow a forum for cross-cutting projects executed in other NITheCS focus areas, where those projects rely on machine learning expertise.
Membership
The programme is open to all NITheCS Associates who currently work in machine learning, or are interested in ML approaches in their research.
Events – 2023
December
NITheCS ML @ SACAIR: A one-day workshop will be hosted at the SACAIR 2023 conference on 5 December 2023. For more information, visit the conference website:
● SACAIR 2023
● Link to ML workshop at SACAIR 2023
September
Marelie Davel (programme PI) showcased this research programme at the Deep Learning Indaba in Accra, Ghana through a poster presentation.
August
Stefan Lotz (programme PI) presented a talk on “Interpretable Machine Learning for Time Series Data” (view slides) at the second Workshop on Machine Learning, Data Mining and Data Assimilation in Geospace (LMAG 2023), 21 – 25 August 2023, Johns Hopkins University Applied Physics Laboratory, Maryland, USA.
Events – 2022
December
NITheCS ML @ SACAIR: A research programme year-end workshop was hosted at the SACAIR 2022 conference on 6 December 2022. Titled “Knowledge Discovery in Time Series Data”, the workshop brought together interested researchers in this field to share their recent findings and views. For more information, visit the conference website.
September
Stefan Lotz hosted a NITheCS colloquium on 19 September 2022.
Abstract | Video | Slides
March
The first workshop of the NITheCS Machine Learning programme took place virtually on 10 March 2022. The PIs introduced the project and its two streams, and participants shared their current ML-related work.
Publications
Interpretability of deep learning models
Jacques P. Beukes, Stefan Lotz and Marelie H. Davel, “Pairwise networks for feature ranking of a geomagnetic storm model”, South African Computer Journal, Vol 32, no2, pp35-55, December 2020.
Coenraad Mouton and Marelie H. Davel, “Exploring layerwise decision making in DNNs”, Artificial Intelligence Research (SACAIR 2021), Communications in Computer and Information Science, Vol 1551, pp 140-155, January 2022.
Marelie H. Davel, Stefan Lotz, Marthinus W. Theunissen, Almaro de Villiers, Chara Grant, Randle Rabe, Stefan Schoombie and Cleo Conacher, “Knowledge Discovery in Time Series Data“, Deep Learning Indaba Conference, Ghana, September 2023
Modelling time series data
Walter Heymans, Marelie H. Davel and Charl van Heerden, “Efficient acoustic feature transformation in mismatched environments using a Guided-GAN“, Speech Communication, Vol 143, pp 10-20, September 2022.
Marko Oosthuizen, Alwyn Hoffman and Marelie H. Davel, “A comparative study of graph neural network speed prediction during periods of congestion”, in Proc. 14th Int. Conf. on Neural Computation Theory and Applications (NCTA 2022), pp 331-338, October 2022
Thipe Modipa and Marelie H. Davel, “Two Sepedi‑English code‑switched speech corpora“, Language Resources and Evaluation, Vol 56, no 3, pp 703-727, September 2022..
Edrich Fourie, Jaco Versfeld, and Marelie H. Davel. “Neural speech processing for whale call detection”, Artificial Intelligence Research (SACAIR2022), Communications in Computer and Information Science, Vol 1734, pp 276-290, December 2022.
Walter Heymans, Marelie H Davel, and Charl van Heerden. “Multi-style training for South African call centre audio“, Artificial Intelligence Research, Communications in Computer and Information Science, Vol 1551, pp 111–124, September 2022.
Kimara Naicker, Ilya Sinayskiy, and Francesco Petruccione. “Machine learning for excitation energy transfer dynamics“, Physical Review Research, Vol 4, no 3: 033175, September 2022.
Kimara Naicker, Ilya Sinayskiy, and Francesco Petruccione. “Statistical and machine learning models for prediction of long-time excitation energy transfer dynamics“. arXiv preprint, 2022.
Other applications of machine learning
Andrew Oosthuizen, Marelie H. Davel and Albert Helberg, “Multi-Layer Perceptron for Channel State Information Estimation: Design Considerations “, in Proc. Southern Africa Telecommunication Networks and Applications Conference (SATNAC 2022), pp 94-99, August 2022.
Marthinus W. Theunissen, Coenraad Mouton and Marelie H. Davel, “The Missing Margin: How Sample Corruption Affects Distance to the Boundary in ANNs”, Artificial Intelligence Research (SACAIR2022), Communications in Computer and Information Science, Vol 1734, pp 78-92, Dec 2022.
Andrew J. Oosthuizen, Albert S.J. Helberg and Marelie H. Davel, “Adversarial Training for Channel State Information Estimation in LTE Multi-Antenna Systems”. Artificial Intelligence Research (SACAIR2022), Communications in Computer and Information Science, Vol 1734, pp 3-17.