Exploring Potentials of Process Reflection to Support Communities of Small Volunteer Groups Alexander Nolte University of Pittsburgh, Pittsburgh PA 15213, USA Carnegie Mellon University, Pittsburgh PA 15260, USA anolte@cmu.edu Abstract. Volunteers groups provide a large variety of valuable services for local communities, global non-profit organizations and online production communi- ties. While larger volunteer groups and online communities enjoy the benefit of an underlying organizational structure that supports the organization of their ac- tivities, small volunteer groups usually lack this type of support. We conducted an exploratory study of five student organizations from two large North Ameri- can universities to assess how they currently organize their activities and to iden- tify potentials to support them. Our findings indicate a lack of both internal and external procedures. Based on our findings we discuss a community-based ap- proach to support process reflection. Keywords: volunteer collaboration, exploration, loosely coupled groups, pro- cess reflection. 1 Introduction Volunteer groups are a cornerstone of society. They provide a large variety of valuable services that range from large short-term efforts to long term support for local commu- nities. Examples for such efforts are support for elections [1], disaster relief [21], sports events [6], local food supply [23], local political activism [20], online production com- munities [24] and student organizations [10]. Most research investigating such volun- teer groups focuses on understanding individual motivations [3, 19] to attract more vol- unteers or on providing means to improve volunteer retention behavior [9, 18]. There are however also studies that focus on how volunteer groups organize. Non- profit organizations typically employ a coordinator that splits larger efforts into man- ageable tasks which are then distributed to volunteers and carried out by them [8, 11]. Similarly open source and online production communities are usually led by a core group that takes over coordination tasks while the remaining volunteers decide for themselves which tasks they would like to carry out [2, 14]. Both thus have an under- lying infrastructure that they build their efforts on. Our work however focuses on small local volunteer that are not typically built on a stable infrastructure. Such groups are usually formed by individuals that are enthusias- tic about a certain cause or issue and that share common values [3, 22]. They thus focus 2 most of their energy on the common cause at hand while not spending too much effort on planning the way their organization operates. They also commonly have to deal with a high turnover in membership. It thus does not seem feasible for them to focus on coordination approaches that are based on cycles of observing, analyzing, designing and structuring activities as can be found in the context of process management [7, 15]. Such groups however still need to coordinate their activities in order to reach their de- sired goals. In order to identify suitable means of supporting such groups to develop stable and effective practices we conducted an exploratory interview study with officers of five student organizations from two large North American universities. Our study revealed that the organizations we studied mainly focus on organizing events throughout the year. Our findings also validate our initial assumptions that there is a lack of coordination especially between groups and frequent membership turnover. These aspects combined lead to a fragmented and largely episodic way of coordination that is mainly based on individual experiences. Based on these findings we propose an approach that combines a set of standard practices for each organization based on ex- isting documentation and communication traces. These practices can subsequently be visualized and shared among a community of similar organizations in order to reflect on them. This approach can thus enable groups to continuously improve, to support the transition between membership generations and raise awareness about events and the way they are organized beyond the confines of individual groups. 2 Case study To uncover how small volunteer groups operate we conducted an exploratory interview study with officers of student organizations from two large North American Universi- ties. In the following we will report on the context of the study and our means of data collection and analysis. 2.1 Study context Student organizations are volunteer groups that are created and run by students for students. They are usually connected to a specific school or department in a university. Every student organization creates its own mission based on the common interest of their creators and members (c.f. Table 1). In order to be recognized by the university and to receive funding, every student organization has to attain a certain number of members (usually ten) and run an annual election for a leadership board. A leadership board commonly consists of a president, vice-president and a business manager (c.f. S01 to S04 in Table 1). Some student organizations also have larger leadership boards (c.f. S05 in Table 1). Neither leadership nor members receive any monetary compensa- tion for their service in a student organization. Table 1. Student organizations analyzed. ID Goal / mission Interview participants S01 Support women in Information Sciences President and 3 Business manager S02 Support doctoral students in Information Sciences President S03 Support students in Library Sciences President and Business manager S04 Support international students in Information Sciences President and Vice-president S05 Support local community organizations by providing Board members data-driven services 2.2 Data collection and analysis We designed our interview study to gain an understanding of how student organiza- tions operate. The interview protocol consequently focuses on specific activities that were conducted by members and leaders of an organization (e.g. “Please provide a short description of an activity [you recently (co-)organized].”). It also includes ques- tions about individual motivations to join alongside antecedents of retention behavior [3, 9, 18, 19]. We interviewed a total of ten officers from five different student organi- zations (c.f. Table 1). The interviews lasted between 40 and 57 minutes each. We transcribed and coded the interviews using a coding scheme that covers basic aspects of coordination (actors, activities and resources [5]) alongside motivation and satisfaction. Our data analysis started with two researchers independently applying the coding scheme to the same part of the first interview. Afterwards we calculated the inter-coder agreement based on Cohens-Kappa [4] for each code and discussed those with low scores in order to reach a common understanding about how to apply each code. After three rounds both researchers coded the remainder of the data. Following the guidelines by Landis and Koch [13], we found moderate (0.41 – 0.60) to substantial (0.61 – 0.80) scores for Cohens-Kappa for all relevant codes. The complete interview protocol, coding scheme and scores can be obtained by the authors upon request. 3 Findings As expected we found a large variety of motivations for individuals to participate in student organizations. These range from identifying with the values of the group, fos- tering individual careers, interest in the topic of the organization, previous bonds with members, networking, having fun and gaining new skills. These motivations mainly matched with the nature of the respective organization (e.g. organizations that are more career oriented attract members that state fostering their career as their main motivation: “This organization provided an opportunity for networking”). The main activity of the groups we studied evolved around the organization of events (“my responsibilities are primarily to organize and oversee [...] events”). Some organ- izations also engage in projects to support local communities (“[they] wanted to make sure that their current clubs and the clubs that they are building are in the places where they are most needed”, I8). 4 When analyzing how student organizations plan and execute their activities we found that they all follow a similar structure based on the following four steps: Initia- tion, planning meeting, task distribution and follow-up. While those steps are common among all student organizations, there is a considerable difference between how they are executed in detail. For some particular events task development is described as “kind of a routine” because these events are “hosted […] annually […] during the year”. There are however also events that are not part of the regular event calendar. For such events student organizations typically use a different approach that starts e.g. with a “brainstorming and some realistic talk about what we [can] get done” before devel- oping tasks. After the task have been developed they are typically distributed in a democratic way (“sort of self-picking”). When it comes to coordinating task execu- tion the different student organizations take different approaches. Some assign a des- ignated coordinator for an event (“I was in charge of organizing everything”) while most organizations take an approach where “tasks are divided once and considered done afterwards” (I6). This approach however proved to be risky since people are not always reliable and commit to tasks that they do not carry out (“There are some people that commit to something and still don't make it”) which consequently led to frustration. In addition to the organization of events which mainly takes place internally, student organizations occasionally also work with external partners. Such activities mainly in- volve the respective school a student organization is registered in. All student organi- zations have to hold elections, register in a school (“we had to reregister our student organization”) and deal with the process of reimbursement of expenses for events (“I handle all the reimbursements”). All of the student organizations at the same school have to go through the same process. There is however no exchange of practices be- tween student organizations. Every organizations develops their own way of dealing with these tasks. Moreover, it is usually the responsibility of a single member of the leadership team to “deal with reimbursements” and that member conducts the process in a way that appears to be feasible for her / him. However, when that member leaves the organization, the respective knowledge becomes lost, and the incoming member has to start from scratch (“when I leave it will be kind of a bummer for the next president to realize how to do that”) since such practices are commonly not documented. Frequent membership turnover is a common characteristic of volunteer groups and student organizations are no exception. It is thus surprising that there seems to be no strategy in place to organize turnover effectively. Some organizations have acknowl- edged this problem and try to solve it by “trying [...] to create documents describing what we did to start the organization” or by organizing a “leadership retreat [...]to connect the incoming board members [...] with the outgoing ones”. These activities are however limited to single organizations and not shared between them. Throughout the interviews it became clear that there is a desire among the members of the student organizations we studied to improve the way they organize activities (“I think that we could have been more on top”, “I think as an organization [...] we could be doing better”). Some organizations are even trying to address this issue by creating documentation or organizing transfer events like the aforementioned leadership retreat. These efforts are however still fragmented and not shared between organizations. 5 4 Implications and outlook Our findings indicate that the student organizations we analyzed operate in similar ways and face similar issues. They mainly focus on organizing events. For recurring events some organizations follow established practices while most events are organized in a hands-on way with no clear process or guidance. In addition, we found that established practices are based on the experiences of individual members and are hardly docu- mented. This makes the departure of experienced members hard to overcome. Moreo- ver, every organization develops, cultivates and continuously reinvents their own prac- tices and does not share them with similar organizations. It is thus likely that different organization make similar mistakes. Student organizations also have to cooperate with externals partners on several oc- casions. The most common external partner in our case is the respective school the organization is registered in. Despite these activities being practically identical between student organizations, each organization develops their own approaches towards them which leads to the same previously discussed issues. Our findings indicate a potential for process improvement particularly between stu- dent organizations. Especially processes that all organization have in common such as registering an organization or asking for reimbursement could and should become com- mon practice across organizations. It is however unlikely that student organizations will engage in formal cycles of process analysis and improvement. We thus propose an ap- proach that is built on analyzing existing data from group communication tools such as Slack and planning documents such as Google Documents and Spreadsheets. This anal- ysis will inform the creation of simple process diagrams which include sequences of activities, involved actors and resources required [12]. We propose an easy to use and easy to learn modeling notation such as SeeMe [12] in order to reduce the additional cognitive overhead of having to interpret complicated business process diagrams. We are confident that members of student organizations can use such models even if they are not experts in creating and using models because research has shown that people are capable of using and modifying simple models of processes they are familiar with [17]. The diagrams can be viewed, shared, discussed and refined by multiple student organizations through discussions on models using a web based graphical modeling tool [16]. The aim of visualizing the processes is to increase awareness about practices beyond the boundaries of a single student organization. This allows for a broader audi- ence to discuss and reflect practices which helps to improve and spread them. Refined processes can then subsequently be implemented e.g. as a combination of Google Spreadsheets which feed a connected Slack bot. Our approach poses minimal additional overhead since most organizations use some form of documentation to track activities already. It does however allow them to discuss and reflect about their activities which will support student organizations to overcome ineffective and error prone practices. 6 References 1. Boulus-Rødje, N., Bjorn, P.: Design Challenges in Supporting Distributed Knowledge: An Examination of Organizing Elections. In: Proceedings of the 33rd An- nual ACM Conference on Human Factors in Computing Systems. pp. 3137–3146 ACM (2015). 2. Cataldo, M., Herbsleb, J.D.: Communication networks in geographically dis- tributed software development. In: Proceedings of the 2008 ACM conference on Com- puter supported cooperative work. pp. 579–588 ACM (2008). 3. Clary, E.G. et al.: Volunteers’ motivations: A functional strategy for the re- cruitment, placement, and retention of volunteers. Nonprofit Manag. Leadersh. 2, 4, 333–350 (1992). 4. Cohen, J.: Weighted kappa: Nominal scale agreement provision for scaled dis- agreement or partial credit. Psychol. Bull. 70, 4, 213 (1968). 5. Crowston, K., Osborn, C.S.: A coordination theory approach to process de- scription and redesign. (1998). 6. Cuskelly, G. et al.: Volunteer management practices and volunteer retention: A human resource management approach. Sport Manag. Rev. 9, 2, 141–163 (2006). 7. Dumas, M. et al.: Fundamentals of Business Process Management. Springer (2013). 8. Farrell, J.M. et al.: Volunteer motivation, satisfaction, and management at an elite sporting competition. J. Sport Manag. 12, 4, 288–300 (1998). 9. Galindo-Kuhn, R., Guzley, R.M.: The Volunteer Satisfaction Index. J. Soc. Serv. Res. 28, 1, 45–68 (2002). 10. Harper, S.R., Quaye, S.J.: Student organizations as venues for Black identity expression and development among African American male student leaders. J. Coll. Stud. Dev. 48, 2, 127–144 (2007). 11. Harrison, D.A.: Volunteer motivation and attendance decisions: Competitive theory testing in multiple samples from a homeless shelter. J. Appl. Psychol. 80, 3, 371 (1995). 12. Herrmann, T.: SeeMe in a nutshell - the semi-structured, socio-technical mod- eling method. (2006). 13. Landis, J.R., Koch, G.G.: The measurement of observer agreement for cate- gorical data. biometrics. 159–174 (1977). 14. Liao, Q.V. et al.: Improvising Harmony: Opportunities for Technologies to Support Crowd Orchestration. Urbana. 51, 61801 (2016). 15. Mendling, J.: Foundations of Business Process Modeling. In: Syed, M.R. and Syed, S.N. (eds.) Handbook of Research on Modern Systems Analysis and Design Technologies and Applications. pp. 189–222 IGI Global (2010). 16. Nolte, A., Herrmann, T.: Facilitating Participation of Stakeholders during Pro- cess Analysis and Design. In: COOP 2016 - Proceedings of the 12th International Con- ference on the Design of Cooperative Systems. pp. 225–241 Springer International Pub- lishing (2016). 7 17. Nolte, A., Prilla, M.: Anyone can use models: Potentials, requirements and support for non-expert model interaction. Int. J. E-Collab. Spec. Issue Collab. Usage Dev. Models. 9, 4, 45–60 (2013). 18. Pearce, J.L.: Volunteers: The organizational behavior of unpaid workers. Routledge (1993). 19. Preist, C. et al.: Competing or aiming to be average?: normification as a means of engaging digital volunteers. In: Proceedings of the 17th ACM conference on Com- puter supported cooperative work & social computing. pp. 1222–1233 ACM (2014). 20. Saeed, S. et al.: Analyzing political activists’ organization practices: findings from a long term case study of the european social forum. Comput. Support. Coop. Work CSCW. 20, 4–5, 265–304 (2011). 21. Soden, R., Palen, L.: Infrastructure in the Wild: What Mapping in Post-Earth- quake Nepal Reveals About Infrastructural Emergence. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. pp. 2796–2807 ACM (2016). 22. Zhu, H. et al.: Organizing without formal organization: group identification, goal setting and social modeling in directing online production. In: Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. pp. 935–944 ACM (2012). 23. Greece: Social Kitchen - the Other Person - Al Jazeera English, http://www.aljazeera.com/indepth/inpictures/2015/09/greece-social-kitchen-person- 150921110028671.html. 24. Wikipedia, https://www.wikipedia.org/.