University of Groningen Continuous integration and delivery applied to large-scale software-intensive embedded systems Martensson, Torvald

(1)

University of Groningen

Continuous integration and delivery applied to large-scale software-intensive embedded

systems

Martensson, Torvald

IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document version below.

Document Version

Publisher's PDF, also known as Version of record

Publication date: 2019

Link to publication in University of Groningen/UMCG research database

Citation for published version (APA):

Martensson, T. (2019). Continuous integration and delivery applied to large-scale software-intensive embedded systems. University of Groningen.

Copyright

Other than for strictly personal use, it is not permitted to download or to forward/distribute the text or part of it without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license (like Creative Commons).

Take-down policy

If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim.

Downloaded from the University of Groningen/UMCG research database (Pure): http://www.rug.nl/research/portal. For technical reasons the number of authors shown on this cover page is limited to 10 maximum.

(2)

Continuous Integration

and Delivery Applied to

Large-Scale Software-Intensive

Embedded Systems

PhD thesis

to obtain the degree of PhD at the

University of Groningen

on the authority of the

Rector Magnificus Prof. E. Sterken

and in accordance with

the decision by the College of Deans.

This thesis will be defended in public on

Monday 8 April 2019 at 11.00 hours

by

Per Torvald Mårtensson

born on 31 October 1972

in Hammarby, Sweden

(3)

Supervisor

Prof. J. Bosch

Co-supervisor

Prof. H. Holmström Olsson

Assessment Committee

Prof. P. Avgeriou

Prof. I. Crnkovic

Prof. T. Mikkonen

(4)

Continuous Integration and Delivery

Applied to Large-Scale Software-Intensive

Embedded Systems

(5)

2

ISBN 978-94-034-1399-0 (printed version) ISBN 978-94-034-1398-3 (electronic version)

(6)

3

Abstract

Software development has become one of the world’s most important technologies. In parallel with the emergence of software development itself, development methodologies have evolved from the stage-gated waterfall model to more adaptive development frameworks such as XP and Scrum. As a part of XP and other agile methodologies, continuous integration and continuous delivery were introduced to mitigate problems with a long and unpredictable integration process at the final stage of a project.

Companies that develop large-scale software-intensive embedded systems develop software systems combined with electronic and mechanical systems. These companies can also utilize the benefits from continuous integration and continuous delivery, but only if continuous integration and continuous delivery could be adapted to challenges and limitations introduced by large-scale and by proximity to hardware. In response to this, this thesis presents solutions for how continuous integration and delivery should be applied to large-scale software-intensive embedded systems.

The results from the research studies presented in this thesis are based on data from eight case study companies. The studies are based on quantitative data (in one case from 2,000 engineers) and on qualitative data from interviews and workshops (six studies including more than 20 participants). The studies also include three systematic literature reviews and a systematic mapping study, in total covering 191 publications.

The first part of this thesis identifies the problems that must be taken into account when applying continuous integration to large-scale software-intensive embedded systems. This is followed by definitions and interpretations of continuous integration and continuous delivery applicable to development of large-scale software systems. Finally, the key contributions of the research presented in this thesis are two models and a method, which will help organizations struggling with challenges related to scale and proximity to hardware to better implementations of continuous integration and continuous delivery. These contributions are valuable for both researchers and practitioners, as they provide a systematic approach rather than making changes blindly and hoping for the best. The key contributions of this thesis are:

· The EMFIS model, which allows companies to explicate a representation of the organization’s current situation regarding twelve continuous integration impediments, and visualizes what the organization must focus on in order to enable more frequent integration of software.

· The TAS model, which shows how the continuous integration and delivery pipeline can be designed to include test activities that support four stakeholder interests, including unit/component tests and system tests, automated testing and manual testing, and tests executed in simulated environments and on real hardware. · A test method for exploratory testing of large-scale systems, which incorporates

exploratory testing as a test activity in the continuous integration and delivery pipeline. The test method is designed to complement automated testing, and to provide different feedback and insights than the results from an automated test case.

(7)

4

Acknowledgements

My interest in writing my first a research paper came from curiosity – I wanted to learn more. This evolved to a series of papers where I have had the opportunity to compare several case study companies, and identify the mechanisms in play. All of this has to a great extent been possible due to that I met Jan Bosch.

Jan has, as my promotor and mentor, always been available for questions and advice, and our bi-weekly “check-in” meetings have often been one of the highlights of my week. I really appreciate Jan’s honesty, his undivided support and his ability to be completely present and focused in a conversation – no matter where he is. Jan also introduced me to Daniel Ståhl, with whom I have done almost all my research projects. I am very grateful that I have the opportunity to work with Daniel, as I believe we complement each other in different ways, and at the same time tend to boost each other’s productivity.

I have been privileged to pursue my research in parallel with my work at Saab AB – primarily revolving around systems integration and system testing of large-scale software systems. The research projects have been directly connected to my day-job at Saab, but Saab has also supported my attendance to conferences including all travel costs. I would like to especially thank Henric Andersson, Erik Herzog, Malin Holmgren Adolfsson and Tommy Linderstam for their help and their support.

I am grateful to all people, both researchers and practitioners, who have generously shared their knowledge and experiences with me at conferences and other meetings. I would like to particularly thank Baldvin Gislason Bern, Michael Felderer, Gert Frost, Antonio Martini, Kristian Sandahl, Anna Sandberg and Peter Thorngren.

Warm thanks also to my co-promotor Helena Holmström Olsson, who has always been supportive and encouraging, in particular during the ideation of the EMFIS model and during the work with this thesis. I would also like to thank the talented individuals I have had the pleasure to work with as co-authors: Pär Hammarström and Daniel Ståhl. Last but certainly not least, I wish to thank my family: my wife and my three children. Research and other types of work are inspiring and sometimes close to addictive. But at the same time, those things would be worth very little if I did not have you in my life. Thank you for our great vacations, our Friday night movies, our weekday dinners, and everything else.

(8)

5

University of Groningen Continuous integration and delivery applied to large-scale software-intensive embedded systems Martensson, Torvald

University of Groningen

Continuous integration and delivery applied to large-scale software-intensive embedded

systems

Martensson, Torvald

Continuous Integration

and Delivery Applied to

Large-Scale Software-Intensive

Embedded Systems

PhD thesis

to obtain the degree of PhD at the

University of Groningen

on the authority of the

Rector Magnificus Prof. E. Sterken

and in accordance with

the decision by the College of Deans.

This thesis will be defended in public on

Monday 8 April 2019 at 11.00 hours

by

Per Torvald Mårtensson

born on 31 October 1972

in Hammarby, Sweden

Supervisor

Prof. J. Bosch

Co-supervisor

Prof. H. Holmström Olsson

Assessment Committee

Prof. P. Avgeriou

Prof. I. Crnkovic

Prof. T. Mikkonen

Continuous Integration and Delivery

Applied to Large-Scale Software-Intensive

Embedded Systems

Abstract

Acknowledgements

Table of Contents