University of Limerick Institutional Repository

The impact of group size on software architecture evaluation: a controlled experiment

DSpace Repository

Show simple item record Ali Babar, Muhammad Kitchenham, Barbara 2011-07-20T15:19:53Z 2011-07-20T15:19:53Z 2007
dc.description peer-reviewed en_US
dc.description.abstract Background: An important element in scenario-based architecture evaluation is the development of scenario profiles by stakeholders working in groups. In practice groups can vary in size from 2 to 20 people. Currently, there is no empirical evidence about the impact of group size on the scenario development activity. Goal: Our experimental goal was to investigate the impact of group size on the quality of scenario profiles developed by different sizes of groups. Experimental design: We had 165 subjects, who were randomly assigned to 10 groups of size 3, 13 groups of size 5, and 10 groups of size 7. Participants were asked to develop scenario profiles. After the experiment each participant completed a questionnaire aimed at identifying their opinion of the group activity. Result: The average quality score for group scenario profiles for 3 person groups was 362.4, for groups of 5 person groups was 534.23 and for 7 person groups was. 444.5. The quality of scenario profiles for groups of size 5 was significantly greater than the quality of scenario profiles for groups of size 3 (p=0.025), but there was no difference between the size 3 and size 7 groups. However, participants in groups of size 3 had a significantly better opinion of the group activity outcome and their personal interaction with their group than participants in groups of size 5 or 7. Conclusion: Our results suggest that the quality of the output from a group does not increase linearly with group size. However, individual participants prefer small groups. This means there is a trade-off between group output quality and the personal experience of group members. en_US
dc.language.iso eng en_US
dc.publisher IEEE Computer Society en_US
dc.relation.ispartofseries First international symposium on empirical software engineering and measurement;pp. 420-429
dc.rights ©2007 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE. en_US
dc.subject Architecture evaluation en_US
dc.subject scenario development en_US
dc.subject quality attributes en_US
dc.subject controlled experiments en_US
dc.title The impact of group size on software architecture evaluation: a controlled experiment en_US
dc.type Conference item en_US
dc.type.supercollection all_ul_research en_US
dc.type.supercollection ul_published_reviewed en_US
dc.type.restriction none en
dc.contributor.sponsor SFI

Files in this item

This item appears in the following Collection(s)

Show simple item record

Search ULIR


My Account