In-depth interview results

6.3.1.1. New quality assurance process with the new system

In order to gain insight into the assessment of the new quality assurance process, the following question was asked. "What do you think of this new quality assurance process? Will it lead to better/worse quality assurance compared to the current process? "

All respondents think that the new quality assurance process will lead to better quality assurance compared to the current process. They are all positive about the new system and new process. The Bekkerveld contractor said the following about this:

“I think quality assurance will be better, because you can create a more complete overview easily and the output is also much better with the floor plans, and you can include unlimited photos, which you can always retrieve in the future if problems arise or if a client has questions or doubts.”

Site Manager - Bekkerveld

The reasons why respondents found the new quality assurance process better were as follows.

The new QA protocol is simpler and therefore more user-friendly. It also works faster than the current system and process. According to the respondents, this also makes them more inclined to carry out the quality assurance process. The output of this new system and process is also better than the previous one, since a file is now built up with photos linked to the floor plans, and data can always be retrieved.

In order to gain insight into the positive and negative experiences with this new quality assurance process, the following question was asked. "What are your positive and negative experiences with this new quality assurance process at the construction site compared to the current process?"

Page 92 of 282 The positive experiences with the new quality assurance process at the construction site in comparison to the current process are the following aspects. As mentioned above, the ease of use of the new process is seen as user-friendly. It was also felt to be positive that quality inspections can be carried out more quickly than under the old system and that there is clearer recording than under the current system. Two respondents mentioned that the inspection lists in the new system should be made project-specific, in order to make the system even more user-friendly and enjoyable to use. The Bekkerveld site supervisor said the following about this:

“In order to get a positive assessment from the work floor, it is very important that the various checklists are made project-specific and are discussed with the operational side beforehand.

Trying to remove unnecessary items as much as possible, I think, this adds a lot to the ease and pleasure of using the programme.”

Site Manager - Bekkerveld

The fact that there are multiple applications in the same system is also considered a positive thing. Two respondents also thought it was positive that all data such as drawings, photos and 3D models could be quickly accessed from different types of devices, such as phones, tablets or computers. Furthermore, the AR functionality was experienced as positive and employees were enthusiastic that it could be shown visually in this way.

The negative experience with the new quality assurance process at the construction site compared to the current process is, for two respondents, the energy they have to put into changing systems. And having to learn the system all over again. The planner in Bekkerveld said the following about this:

“The acceptance aspect is actually a difficult one, because you are actually switching software again, while if the other one always worked, but there were problems and you switch to something new, then everyone has to switch and then everyone has to learn the programme again, so you notice some resistance at first, and that is purely due to the knowledge that they do not have yet.”

Planner - Bekkerveld

Page 93 of 282 6.3.1.2. AR Functionality

To gain insight into the assessment of the Augmented Reality functionality, the following question was asked. "What do you think of the Augmented Reality functionality? Will it lead to better/worse visual control compared to the current way of visual control?"

All respondents believe that visual inspection with Augmented Reality functionality is better than the current method. Two respondents mentioned as a condition for this that the building should be fully worked out in 3D. In Figure 25 the site manager in Bekkerveld carries out a visual inspection using AR, and he said the following about this:

“I think it is a lot better, especially because you get a much more complete insight, even if you are only halfway through your processes, so you can recognise bottlenecks sooner, but the condition is that it is all very well taken into account in 3D.”

Site Manager – Bekkerveld

The reasons why the respondents found the new visual inspection through AR better were as follows. The respondents concluded that AR allows for a much more complete understanding of the building, even if you are only halfway through your processes. It also allows you to see how something is put together more quickly. According to the respondents, this clear insight makes it possible to identify bottlenecks at an earlier stage. One respondent also mentioned that the AR functionality is a pleasant addition to work instructions.

To gain insight into what the positive and negative experiences are with this new visual control through AR, the following question was asked. "What are your positive and negative experiences with Augmented Reality functionality on the construction site compared to the current way of visual control?"

The positive experiences with the AR functionality on the building site compared to the current visual inspection are the following. It is seen as an addition compared to the current way. The reason for this is that you can immediately see visually on the building site what parts are there and how it is put together. The foreman at the Theater aan de Parade said the following about this:

“Normally I would look in the 3D file, and then go outside to check. But now you have that model with you on the building site. So I think it's a good thing that I can actually project the 3D model onto the building site itself.”

Foreman – Theater aan de Parade

Figure 25 - Experiment Visual Control

Page 94 of 282 For one respondent, the negative experience with AR functionality on the construction site in comparison to the current visual inspection is that it is somewhat more difficult to position the model correctly for the AR functionality. That remains the only piece of manual work where one has to be careful not to make a quick mistake. And it is important that only the foreman or supervisor applies it, and not everyone so that it is used and positioned correctly.

To gain insight into the extent to which Augmented Reality contributes to the visual understanding of a construction project compared to the current way, the following question was asked. "To what extent does Augmented Reality contribute in visually understanding a construction project compared to the current visual control?"

The respondents believe that Augmented Reality contributes to the visualisation of a construction project compared to the current way of doing things. They also said that it improves speed and the timely identification of problems. It also gives a better idea of what it will all look like in the initial phase and where problems may arise during implementation. The use of AR means that you no longer have to go to the construction site with 2D drawings and have to fill in your 3D experience yourself. According to the supervisor of Theater aan de Parade, it contributes especially well to complex construction projects. He said the following about this:

“I think especially with complex construction work or whatever it may be, it helps if you can put it into practice, if you can see the work that you have to assemble.”

Site manager – Theater aan de Parade

Page 95 of 282 6.3.1.3. New WKB act

To gain insight into the extent this proposed QA protocol contributes to compliance with the new WKB Act, the following question was asked. "Are you aware of what the new WKB Act entails? If so, to what extent do you think that this proposed new process and new system contribute to compliance with this new Act?"

Three of the five respondents are familiar with the new WKB Act. All respondents with knowledge of the new Act concluded that the new process and the new system are helping to comply with the new WKB Act. This is because the new process and the new system allow for everything to be recorded digitally, and for everything to be stored coherently in a file. The practical situation can be properly recorded by linking it to the execution situation. The planner of Sporthal Plus said the following about this:

“This new system, as it is now set up, certainly contributes to compliance with this new law.”

Planner – Sporthal Plus

The Bekkerveld site manager did state, however, that as a condition for complying with this new law, all parties within the construction project must be able to work with the same programme. He said the following about this:

“I do think that this new proposed new process and new system will help to comply with this law, but then they all have to be willing and able to go along with the same programme. Then the subcontractor has to adapt to it, make the programme his own and also have the means to use it outside.”

Site Manager - Bekkerveld

To gain insight into what the respondents think of the new content of the inspection lists and whether this complies with the new WKB Act, the following question was asked. "What do you think of the new content of the inspection lists and to what extent would it comply with this new law?"

All respondents thought the new content of the inspection lists was good, but they did mention a few conditions. For example, the auxiliary and subcontractors must be properly supervised to ensure that they continue to monitor and record their activities properly. And the inspection lists should be made project-specific in terms of content. The site manager for the Theater aan de Parade says the following about the inspection lists:

“The inspection lists that we have just made seem to me to be complete, especially of steel construction, and on the basis of them you can go around the drawing, you can make comments, identify problems, possibly multiple problems, multiple locations on the drawing specifically.”

Page 96 of 282 Site Manager – Theater aan de Parade

The new content of the inspection lists will largely comply with the new law, according to the site manager of Bekkerveld and the site manager of Theater aan de Parade. It is not yet clear whether this content of the inspection lists fully complies with the new law. However, it has been said that the inspection lists are a big step forward compared to how things were recorded in the past.

To gain insight into the extent to which functionalities are still lacking in the system in order to comply with the new WKB Act, the following question was asked. "To what extent do you still miss some functionalities in the system to comply with the new WKB Act? And if so, which functionalities do you miss?"

All respondents believe that the system will comply with the new WKB Act, but they do not have full knowledge of the new Act and make this statement on the basis of largely understanding what the new Act implies. The site manager of Theater aan de Parade said the following about this:

“As far as I know the law, this seems to me to be more than enough to record it properly. And think also especially of the fact that during the process, snapshots, temporary products, the status of the construction can be clicked, secured, before someone else continues with it.”

Site Manager – Theater aan de Parade

Some functionalities were considered missed, which are not related to compliance with the new law. For example, the functionality to link a task or inspection list to multiple locations on the drawing or on the building is missed. Secondly and finally, it was indicated that a structure with a time schedule that shows what and when something must be done is missed. Also here the possibility to give a notification to the person responsible for carrying out a quality inspection is missed.

6.4. Sub-conclusions

The new proposed quality assurance protocol was validated through an experiment. The validation of the QA protocol provided insight into how the proposed protocol works in practice. The validation was first carried out by means of the survey, followed by in-depth interviews for a more detailed validation.

Based on the results of the survey, which are included in Appendix I, it can be concluded that the QA protocol has been set up in accordance with the new WKB Act. It can also be concluded that the new QA system functionalities work better than the current QA system. The new QA system functionalities also work well in the new QA protocol. The new QA user experiences work better than in the current system, and the new user experiences are also found to work

Page 97 of 282 well in the QA protocol. The AR functionality was found to be a great addition, where the predefined benefits were confirmed in the validation.

With the in-depth interviews, three different aspects of the new QA protocol were validated, namely the new overall QA process, the AR functionality, and whether the new QA protocol will comply with the new WKB Act.

Based on the in-depth interviews, the new quality assurance process will lead to better quality assurance compared to the current process. Several reasons have been given by the participants why this new QA process works better than the current process. The first reason why respondents found the new quality assurance process better is because it is simpler and works faster and is, therefore, more user-friendly. Furthermore, the new quality inspections can be carried out quicker than the current inspection. The second reason is that the output of the QA protocol is better and clearer because it digitally builds up a file where pictures can be linked to the floor plan. The third reason is that all project data is easily accessible from all types of devices, with the data also being visually clear. For improvement, it is recommended to make the inspection lists even more project-specific, in order to make the system even more user-friendly and enjoyable. As a disadvantage of the change to a new QA protocol, energy has to be put into learning the new system.

Based on the in-depth interviews, the visual inspection with the Augmented Reality functionality is better than the current method of visual inspection. But a condition for this statement is that the building is fully developed in 3D. The visual inspection with AR contributes especially well to complex construction projects. Several reasons have been given by the participants why this AR visual inspection works better than the current visual inspection. The first reason why the respondents found the new visual inspection through AR better is because the AR functionality allows for a much more complete understanding of the building, even if you are only halfway through your processes. There is a more complete understanding because it is visible how something is put together more quickly with a clear insight and contributes to the visualisation of a construction project compared to the current visual inspection. It also provides the possibility to immediately visually see on the construction site what parts it contains. The second reason is that by having this clear insight, bottlenecks can be identified at an earlier stage. This is due to the fact that there is a better idea of the building through AR, whereby possible problems can already be identified in an early stage that may occur during the execution phase. The third reason is that it improves the speed of visual inspection. A disadvantage of the AR functionality is that the positioning of the model on the construction site is somewhat difficult, so careful positioning of the 3D model is required to avoid problems. It is also recommended that only the foreman or supervisor should use it so that it is used correctly. Furthermore, as an addition to the AR function for visual inspection, it is mentioned that the AR functionality is a pleasant addition to work instructions.

Page 98 of 282 Based on the in-depth interviews, all respondents with knowledge of the new Act concluded that the new process and the new system are helping to comply with the new WKB act. This statement is on the basis of largely understanding what the new Act implies. As a condition for complying with this new law, all parties within the construction project must be able to work with the same programme. Several reasons have been given by the participants why this new QA protocol will help to comply with the new WKB act. The first reason is that the new process and the new system allow for everything to be recorded digitally, and for everything to be stored coherently in a file. And where the practical situation can be properly recorded by linking it to the execution situation. The second reason is that respondents consider the new content of the inspection lists to be satisfactory. But there are some conditions for this, firstly that the site manager and subcontractors must be properly supervised to ensure that they continue to monitor and record their activities properly. And secondly that the inspection lists should be made project-specific in terms of content that complies with the new law.

Some functionalities were considered missed, which are not related to compliance with the new law. The functionality to link a task or inspection list to multiple locations on the drawing or on the building is missed. And a structure with a time schedule that shows what and when something must be done is missed. Also, the possibility to give a notification to the person responsible for carrying out a quality inspection is missed.

Based on this validation, it can be concluded that the designed QA protocol meets the improvement with regard to the predefined functionalities and the process. It can also be concluded that the use of the designed QA protocol will lead to better quality assurance

Based on this validation, it can be concluded that the designed QA protocol meets the improvement with regard to the predefined functionalities and the process. It can also be concluded that the use of the designed QA protocol will lead to better quality assurance