Browsing by Author "Schulz, Henning"

Now showing 1 - 2 of 2

Open Access
Automated generation of tailored load tests for continuous software engineering
(2021) Schulz, Henning; Hoorn, André van (Dr.-Ing.)
Continuous software engineering (CSE) aims to produce high-quality software through frequent and automated releases of concurrently developed services. By replaying workloads that are representative of the production environment, load testing can identify quality degradation under realistic conditions. The literature proposes several approaches that extract representative workload models from recorded data. However, these approaches contradict CSE's high pace and automation in three aspects: they require manual parameterization, generate resource-intensive system-level load tests, and lack the means to select appropriate periods from the temporally varying production workload to justify time-consuming testing. This dissertation addresses the automated generation of tailored load tests to reduce the time and resources required for CSE-integrated testing. The tailoring needs to consider the services of interest and select the most relevant workload periods based on their context, such as the presence of a special sale when testing a webshop. Also, we intend to support experts and non-experts with a high degree of automation and abstraction. We develop and evaluate description languages, algorithms, and an automated load test generation approach that integrates workload model extraction, clustering, and forecasting. The evaluation comprises laboratory experiments, industrial case studies, an expert survey, and formal proofs. Our results show that representative context-tailored load tests can be generated by learning a workload model incrementally, enriching it with contextual information, and predicting the expected workload using time series forecasting. For further tailoring the load tests to services, we propose extracting call hierarchies from recorded invocation traces. Dedicated models of evolving manual parameterizations automate the generation process and restore the representativeness of the load tests. Furthermore, the integration of our approach with an automated execution framework enables load testing for non-experts. Following open-science practices, we provide supplementary material online. The proposed approach is a suitable solution for the described problem. Future work should refine specific building blocks the approach leverages. These blocks are the clustering and forecasting techniques from existing work, which we have assessed to be limited for predicting sharply fluctuating workloads, such as load spikes.
Open Access
ContinuITy - automatisiertes Performance-Testen in der kontinuierlichen Softwareentwicklung : Abschlussbericht
(2020) Angerstein, Tobias; Heger, Christoph; Hoorn, André van; Okanović, Dušan; Schulz, Henning; Siegl, Stefan; Wert, Alexander
Ziel des Forschungsprojekts ContinuITy war die Entwicklung eines Ansatzes und entsprechender Werkzeugunterstützung zum automatisierten Performance-Testen - eingebettet in Prozesse und Infrastruktur der kontinuierlichen Softwareentwicklung. Ziel ist durch Ausnutzung von kontinuierlich aufgezeichneten Messdaten aus dem Produktivbetrieb, automatisiert effizientes und nachhaltiges Lasttesten zu gewährleisten und in die kontinuierliche Softwareentwicklung zu integrieren. Lasttests werden automatisiert aus Messdaten extrahiert und evolviert. Lasttests werden durch eine modulare Beschreibungssprache definiert und können durch zusätzliche Semantik - z. B. über Testart und -ziele - angereichert werden. Im Rahmen der Automatisierung des Softwareerstellungsprozesses (Continuous Delivery) erfolgt eine Auswahl relevanter Lasttests, die Erkennung von Regressionen und deren Diagnose. Basierend auf der Beschreibung der Aufgabenstellung und der Voraussetzungen fasst dieser Bericht die durchgeführten Aktivitäten und wesentlichen Ergebnisse zusammen.