A Rule-based Engine to support a Framework for the Experimental Validation of Domain Specific Languages

• Autor(a) principal: Rosa, Sara Russo
• Data de Publicação: 2017
• Tipo de documento: Dissertação
• Idioma: eng
• Título da fonte: Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
• Texto Completo: http://hdl.handle.net/10362/30064
• topic: Domain Specific Languages; Languages Evaluation; Software Language Engineering; Tool Support; Usability; Validation Rules; Domínio/Área Científica::Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática

Software systems are widely used in people daily routines and responsibilities, therefore, systems need to be developed rapidly and efficiently. Domain specific languages (DSLs) are languages that are applied to a specific application domain. Since DSLs provide notations and constructs adapted to a particular domain, they offer gains in expressiveness and ease of use when compared with general-purpose languages (GPLs). Therefore, one of the most important steps in the Software Language Engineering is the evaluation of the languages produced, with the end-users, since the risk of building inappropriate languages, that often do not fit the end users, may decrease productivity. Although DSLs evaluation is one of the most important steps in development process, Software Language Engineers tend to relax the experimental validation of their products due to several reasons like costs (time, means, money, the number of people required, etc.) and required know-how associated with it. The lack of systematic approaches and guidelines to evaluate DSLs, and a comprehensive set of tools may explain this shortcoming in the current state of practice. The Usability Driven DSL development with USE-ME (USE-ME) approach, developed in NOVA-LINCS, "promotes the quality in use of DSLs by building a framework that leverages usability as a main concern". The feedback of the pilot studies was that despite the approach was "more or less easy" to understand it was not easy to model, since "there were too many steps to follow" and the framework did not provide a "guided cycle". So, in order to improve the system usability and the quality of the models produced with USE-ME, we developed a new version of the framework with validation rules implemented with Eclipse Validation Language (EVL) that guide, suggest and validate the Software Language Engineer actions throughout the development process. The validation rules were designed in such a way that the tool educates the user about the process, so that the user makes the best decision regarding his DSL evaluation. We performed two experiments, with different goals. The main goals of the first one was to analyse the effect of validation rules on the USE-ME framework, with respect to their impact on the System Usability Scale, and on the Model Correctness of USE-ME models. We analysed the results and we found evidences of improvements on the System Usability Scale, and on the Model Correctness of models, brought by the addition of the rules. The second experiment was conducted with a research team from Ege University, in Turkey. The main goal of this experiment was to perform a guided evaluation on a DSL related with Multi-Agent Systems, SEA-ML. Since the number of participants was low we cannot draw conclusions regarding this experiment. Despite the significant results from the first experiment further evaluation on the new version of the framework is necessary, this time, with more experienced users and with more complex exercises. With this new experiment, we can compare the results and improve the USE-ME framework.