Browsing by Author "Popp, Matthias"

Now showing 1 - 2 of 2

Open Access
Comprehensive Support of the Lifecycle of Machine Learning Models in Model Management Systems
(2019) Popp, Matthias
Today, Machine Learning (ML) is entering many economic and scientific fields. The lifecycle of ML models includes data pre-processing to transform raw data into features, training a model with the features, and providing the model to answer predictive queries. The challenge is to ensure accurate predictions by continuously updating the model with automatic or manual retraining. To be aware of all changes, e.g. datasets and parameters, it is required to store metadata over the entire ML lifecycle. In this thesis we present a concept and system for comprehensive support of the ML lifecycle. The concept includes a metadata schema, as well as a solution to collect and enrich the metadata. The metadata schema contains information about the experiment, runs, executions, executables and common artifacts in ML such as datasets, models, and metrics. The stored information can be used for comparisons, re-iterations, and backtracking of ML experiments. We achieve this by tracking the lineage of ML pipeline steps and collecting metadata such as hyperparameters. Furthermore, a prototype is implemented to demonstrate and evaluate the concept. A case study, based on a selected scenario, serves as the basis for a qualitative assessment. The case study shows that the concept meets all the requirements and is therefore a suitable approach to comprehensively support ML model lifecycle.
Open Access
Visualization of performance antipattern detection results
(2018) Popp, Matthias
In many cases developers do not understand appearing performance problems after the implementation or some changes. The problems can often be traced back to same root causes, which are present in many different software systems. Some of these problems are collected and analyzed, called anti-patterns, and can be detected by software diagnosis tools. Thus, organizations are using application performance management (APM) tools, to detect bottlenecks and other performance problems in their product. To support the developers, this thesis will deal with visualization of detected anti-patterns. Information about the anti-pattern, individual data from the system under test (SUT) to understand the problem and their solutions are a part of the report. The result of the work will be a prototype framework, which uses available diagnosis and APM results to generate the visualized based report, e.g. stack traces and time series.