Towards a Framework for Analytics-driven Domain-speci c Mashup Environments

Abstract

Mashup environments enable end users to directly engage in the design process of the information system. Traditional mashup technology o ers users generic components and therefore targets technically skilled people. Recent research investigates domain-speci c mashup platforms with the aim to be easier to understand and use. We present a proposal for research towards a generic framework that supports the design of domain-speci c mashup environments through native analytics.

Keywords

• Evolutionary Information Systems
• Secondary Design
• Mashups

-

In this paper, we conceive of an information system as consisting of human beings and/or machines that are interconnected via communication relationships and that produce and/or use information [ 1 ]. Accordingly, we interpret an educational information system as a sub-part of a computer-based organizational information system where educational processes are at the center of attention. Core processes include learning, coaching, assessment and delivery of learning content [ 2 ]; supporting processes are e.g. authoring of learning material, development of learning applications or administration processes.

The traditional mindset considers the technological part of an information system as being designed by software developers and used by end-users. The concept of secondary design, however, interprets end-users as \designers in their own right", who are actively engaged in the design and modi cation of the information system within the context of use [ 3 ]. This is particularly desirable because organizations, and therefore their processes, are necessarily constantly evolving due to an ever-changing environment. This in turn demands for highly tailorable technology [ 4 ] that can be continuously and substantially adapted by its stakeholders, particularly by domain experts. In line with [ 5 ], we use the term Evolutionary Educational Information System (EEIS)1 to refer to this class of educational information systems. 1 \Evolutionary Information Systems" should be understood as an emerging research eld that is currently developed and explored at our institute in a joint research e ort of several researchers (see also [ 5 ]). The hereby proposed research into mashup environments by the author is embedded within this conceptual frame.

Problem Areas and State of the Art

In [ 5 ], we have tried to identify three highly relevant dimensions within the research eld around evolutionary systems, thus providing the overall directions for further investigation { and the broader frame for the hereby proposed research: D1 { Systematic discovery of improvement potentials within the system. D2 { Incremental application of corresponding modi cations into the system.

D3 { Inclusion of stakeholders into the continuous design process of the system. With respect to these objectives the emerging mashup paradigm [ 6 ] promises a possible solution space. In line with our notion of EEISs, a mashup environment comprises a mashup platform plus organizational structures and actors [ 7 ]. A mashup platform is a tailorable technology [ 4 ] that allows end users to create, use, modify and exchange mashups. Mashups are personalized, situational applications created by end users by dynamically combining web resources to address the current needs of a person or community [ 7 ]. An enterprise mashup stack comprises three central technological concepts, i.e. web-based resources, which are virtualized into widgets and nally combined on demand into mashups [ 7, 8 ]. In general, mashup platforms contribute to the area of D2 by providing a means to adapt a system's behavior. In providing a means for end user programming [ 9 ], mashup environments tackle problem area D3. Furthermore, being frequently used for situational reporting and analytics, mashup platforms can generally contribute to research direction D1, thus enabling a \business intelligence for the masses" concept [ 7 ].

Recent e orts investigate Domain-speci c Mashup Platforms, hence aim to apply the concept of domain-speci c languages [ 10 ] to the mashup paradigm (see e.g. [ 11 ]). Here, the main goal remains to make the mashup experience as simple as possible for the end user. This is attempted by providing easy-to-understand domain-speci c components instead of domain-agnostic generic components. For example, \ResEval Mash" [ 11 ] represents a domain-speci c mashup platform for conducting research evaluation. 3

Research Questions and Challenges

As we position this research within the eld of Evolutionary Information Systems, we ultimately aim at enabling secondary design within an EEISs in a uni ed approach. We strive to integrate techniques from the broad elds of analytics [ 12 ], domain-speci c languages and mashup technologies in a comprehensive framework. Within the mindset we have sketched so far, we formulate both a high-level research question and an incomplete set of derived sub-questions. How should a framework be designed that supports domain experts in their secondary design of Domain-speci c Mashup Environments through analytics within the context of an Evolutionary Educational Information System? tu We are going to search for an answer to this question by investigating the related phenomena within the Technology Enhanced Learning (TEL) domain. Therefore, we consider relevant educational stakeholders (e.g. developers of learning resources, e-learning assistants, teachers) as the domain experts, and the systems that we have direct access to2 as the EEISs. Within an abductive re ection process, several more concrete subquestions arise. Note, however, that this tentative set is expected to be extended and amended in the course of our design-oriented research e ort.

{ What should be designed in the primary design process, and what should be intentionally left to the secondary design of the domain experts? { How can we enable secondary design of the Domain-speci c Mashup Environments (DSMEs) and still preserve control of the system functions? { How should one account for and deal with \transitive secondary design", i.e. when the secondary design process of domain experts actually acts as primary design for the secondary design of other end-user groups? { What is a suitable \gentle slope" [ 13 ] deployment process for the incremental, evolutionary establishment of such mashup environments within an EEIS? { How can we incorporate analytics to facilitate the emergence and sustainable integration of a DSMEs within an EEIS? 4

A Framework for Analytics-driven Domain-speci c

Mashup Environments

We aim to tackle the identi ed problems by means of a design-oriented research approach [ 14 ]. In this section, we sketch a tentative solution suggestion. In a nutshell, the proposed solution shall be manifested in the form of a highly tailorable framework that empowers domain experts to design and maintain DSMEs based on analytics. Our domain-aware and design-oriented research approach implicitly requires us to construct and deploy working software within an EEIS, which implies technological and organizational opportunities and constraints. The actual implementation is particularly important, as its continuous introspection within the EEISs is essential for developing and evaluating it. The intention is to develop software within the technological framework that runs our real world learning platforms. In particular, this stack comprises the dotLRN learning management system that is based on the OpenACS community framework, which in turn relies on NaviServer, PostgreSQL and the Next Scripting Framework3. 4.1

Objectives of the Solution

The overall goal of e orts in the eld of EEISs is to make progress with respect to the three research directions (D1{D3). In addition to that, we present here a list 2 These are Learn@WU (see https://learn.wu.ac.at) and LMS.at (see https://lms.at), large learning platforms of the WU Vienna and for Austrian schools, respectively. 3 Please refer to the respective web sites: http://dotlrn.org, http://openacs.org, http://naviserver.sourceforge.net, http://postgresql.org, http://next-scripting.org. of relevant high-level objectives of this concrete research e ort. For brevity, typical requirements known from the eld of software engineering (e.g. performance, scalability, usability, etc.) and from research projects (e.g. rigorous architectural design decisions, openness, etc.) are not mentioned explicitly.

High Tailorability for Enabling Secondary Design of DSMEs. Our main objective is to design, develop, and deploy a framework that allows diverse stakeholders within an EEIS to collaboratively construct mashup environments speci cally tailored to their respective domains and needs. Thus, the design decisions made in the course of the construction of the framework shall account for the concept of secondary design. Firstly, this includes a generic infrastructure that allows technical experts to develop and integrate internal or external resources and make them available for the domain experts in the form of \virtualized components" (widgets) [ 7 ]. Secondly, it requires means for the domain experts to derive or introduce domain-speci c components. Thirdly, end users within the organization should be enabled to e ciently nd, evaluate, and use these tailored domain-speci c components (widgets, mashups, and resources).

Native Analytics. The need for analytics is especially true for Evolutionary Information Systems (EISs), which strive to enable secondary design and therefore require means for investigating and interpreting the system's behavior in a quanti able manner. Firstly, as a basis, data generated by (instantiations of) the framework shall follow clear semantics (e.g. via collaboratively de ned ontologies) in order to facilitate data mining techniques [ 15 ]. Secondly, the framework shall facilitate domain-relevant analytics, e.g. via collaboratively-annotated situational analytics mashups. This is intended to support a continuous evaluation of the mashup environment and its underlying processes for all its stakeholders, ultimately contributing to D1.

Incremental Applicability. We state the applicability and deployability of the framework within an existing EEIS as an important objective (see D2), both from a technological and an organizational perspective. The latter demands a \gentle slope" system [ 13 ] that can be incrementally learned by the domain experts. Therefore, means for the inclusion or transformation of (legacy) components and artifacts from the existing system shall be considered. 4.2

Contributions

The hereby proposed research e ort is intended to contribute to the eld of information systems research and to relevant reference disciplines and sub-areas such as TEL, domain-speci c software engineering and learning analytics. The contributions, i.e. additions to the knowledge base, are going to be artifacts [ 14, 16 ], and in particular open source software. The artifacts, which embody the new knowledge, are going to comprise (i) design principles for the construction of DSMEs within EEISs; (ii) concrete models describing the constructed environments and abstract models that generalize from these; (iii) experiences from and methods for constructing such environments.

A Pluralistic Design-oriented Research Con guration

In general, research is \an activity that contributes to the understanding of a phenomenon" [ 14, 17 ]. In design-oriented research, these phenomena are partly created by the researcher [ 14 ]. The construction process is supposed to reveal design principles that can be applied to a class of similar systems [ 18 ]. Numerous process models can be found in the literature, from \micro-scale" cognitive models [ 19 ] over \project-scale" [ 20, 21 ] to \macro-scale" aggregate models applicable to e orts of multiple research communities [ 14 ]. However, a common scheme among these process models remains. After some form of problem awareness or trigger, the researcher iteratively switches between constructive and evaluative activities. The construction allows for creativity, nevertheless design decisions must be grounded in the knowledge base and be made explicit [ 22 ].

A range of di erent qualitative and quantitative evaluation approaches [ 17 ] seems appropriate for the various parts of this research. Ultimately, the created artifacts are going to be evaluated against the de ned goals and objectives. For example, while the architecture of the system will be evaluated by means of expert reviews, interviews or con rmatory focus groups [ 17 ] with domain experts will be considered for evaluating the appropriateness of the system for the business environment. As our intention is to natively incorporate analytics, we expect to be able to directly gain useful quantitative usage data. 6

Conclusion and Outlook

We have presented our intention to succeed with research into DSMEs. We believe that incorporating analytics into these systems has the potential to make them even more useful and e ective and can help to tackle some of the problems that arise within EEISs. We conclude this paper with a research agenda. M1 { Tentative Design. A crucial rst step is to further elaborate the solution suggestion to result in a tentative design [ 14 ]. We expect this to include design principles, high level architectural models, and user interface mockups. M2 { Mashup Platform Prototype. As a basis for further developments, we plan to implement a prototype of a exible mashup platform based on and integrated with our existing EEISs.

M3 { DSMEs Prototype. This iteration of the prototype development shall actually enable domain experts to design DSMEs.

M4 { Analytics-based DSMEs Prototype. In this phase we are going to enhance the process of designing DSMEs by using analytics.

M5 { Evaluation. While various evaluation activities will have already happened at this stage, we will nally evaluate the prototype within its environment for its appropriateness to tackle the overall problem areas and de ned objectives (see Sections 2 and 4). To this end, a framework for continuous evaluation is intended to be designed and included from the beginning. The activities preceding each milestone are expected to take us about two months, and we plan at least one publication as a result.

References

1. Hansen , H.R. , Neumann , G.: Wirtschaftsinformatik 1 . UTB, Stuttgart ( 2009 )

2. Tyler , J. et al.: 1484 .1 - IEEE Standard for Learning Technology - Learning Technology Systems Architecture (LTSA) . IEEE Computer Society ( 2003 )

3. Germonprez , M. , Hovorka , D. , Gal , U. : Secondary Design: A Case of Behavioral Design Science Research . Journal of the Association for Information Systems . 12 , 10 , 662{ 683 ( 2011 )

4. Germonprez , M. , Hovorka , D. , Collopy , F. : A Theory of Tailorable Technology Design . Journal of the Association for Information Systems . 8 , 6 , 351{ 367 ( 2007 )

5. Neumann , G. , Aram , M. , Sobernig , S. : Evolutionary Business Information Systems. [forthcoming] ( 2013 )

6. Hoyer , V. , Fischer , M. : Market Overview of Enterprise Mashup Tools . In: Bouguettaya, A. et al. (eds.) Service-Oriented Computing ICSOC 2008 . pp. 708721 Springer Berlin Heidelberg ( 2008 )

7. Pahlke , I. , Wolf , M. Enterprise Mashup Systems as Platform for Situational Applications - Bene ts and Challenges in the Business Domain . Business & Information Systems Engineering. 2 , 5 , 305{ 315 ( 2010 )

8. Hoyer , V. , Stanoesvka-Slabeva , K. , Janner , T. , Schroth , C. : Enterprise Mashups: Design Principles towards the Long Tail of User Needs . In: Proceedings of the 2008 IEEE International Conference on Services Computing (SCC 2008 ), 601 { 602 . ( 2008 )

9. Cypher , A. et al.: No Code Required: Giving Users Tools to Transform the Web . Morgan Kaufmann ( 2010 )

10. Fowler , M. : Domain-Speci c Languages . Addison-Wesley Professional ( 2010 )

11. Soi , S. : Domain Speci c Mashup Platforms as a Service . PhD Dissertation . DISI - University of Trento ( 2013 )

12. Long , P. , Siemens , G.: Penetrating the Fog: Analytics in Learning and Education . Educause Review 09/10 2011 ( 2011 )

13. MacLean , A. , Carter , K. , Lvstrand , L. , Moran , T. : User-tailorable systems: pressing the issues with buttons . In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ( 1990 )

14. Vaishnavi , V.K. , Kuechler , W. : Design Science Research Methods and Patterns. Auerbach Publications ( 2007 )

15. Van der Aalst , W. M. P. : Process Mining. Springer, Berlin Heidelberg ( 2011 )

16. March , S.T., Smith , G.F. : Design and natural science research on information technology . Decision Support Systems . 15 , 4 , 251{ 266 ( 1995 )

17. Hevner , A. , Chatterjee , S. : Design Research in Information Systems: Theory and Practice . Springer ( 2010 )

18. Sein , M.K. , Henfridsson , O. , Purao , S. , Rossi , M. , Lindgren , R.. : Action Design Research. MIS Quarterly . 35 , 1 , 37{ 56 ( 2011 )

19. Takeda , H. , Veerkamp , P. , Tomiyama , T. , Yoshikawa , H.: Modeling Design Processes . AI Mag . 11 , 4 , 37{ 48 ( 1990 )

20. Pe ers, K. , Tuunanen , T. , Rothenberger , M.A. , Chatterjee , S. : A Design Science Research Methodology for Information Systems Research. Journal of Management Information Systems . 24 , 3 , 45{ 77 ( 2007 )

21. Nunamaker , J.F. , J. , Chen , M. : Systems development in information systems research . Proceedings of the 23rd Annual HICSS , 1990 . pp. 631 {640 vol. 3 ( 1990 )

22. Schermann , M. , Gehlert , A. , Krcmar , H. , Pohl , K. : Justifying design decisions with theory-based design principles . In: ECIS 2009 Proceedings . ( 2009 )