AETing : an automated exploratory testing strategy based on code evolutioncoverage

Bibliographic Details
Main Author: OLIVEIRA, Marlom Jobsom Dias de
Publication Date: 2020
Format: Master thesis
Language: eng
Source: Repositório Institucional da UFPE
dARK ID: ark:/64986/001300000hgn5
Download full: https://repositorio.ufpe.br/handle/123456789/40070
Summary: Testers face challenges to have their test suites up-to-date with respect to the applica tion source code evolution to be tested. These challenges are greater in a global distributed software development context. The growing daily testing demand also makes it difficult to maintain such suites. These test suites are also continuously automated to save the time of human testers, but they require maintenance as well. Exploratory testing comes as a trade-off between test case maintenance, human expertise, and flexibility. Unfortunately, it is a man ual task in general. In this work, we specifically designed a strategy called AETing. AETing receives Test Scenarios generated by ArcWizard, which are the results of code static analysis that produces screen navigations suggestion that covers code change, and AETing maps such static screen navigations suggestion into concrete code implementation based on Page Objects maintained by Motorola in its testing framework called Page Browser. AETing combines these two resources to generate automated test cases that perform screen navigations and Monkey testing aiming to maximize coverage of code changes evolution between two versions of a given Android application. We developed and evaluated our approach in a real testing opera tion environment related to Motorola Mobility, through a partnership between CIn-UFPE and this company supported by the Informatics Law. The evaluation consisted of testing four dif ferent Motorola Android applications. Through the evaluation, we obtained promising results concerning the comparison between AETing and expert exploratory testers’ code coverage. We discuss in detail how AETing works and the results achieved.
id UFPE_9d5fabf04eb27f8faee52083090c2b25
oai_identifier_str oai:repositorio.ufpe.br:123456789/40070
network_acronym_str UFPE
network_name_str Repositório Institucional da UFPE
repository_id_str 2221
spelling AETing : an automated exploratory testing strategy based on code evolutioncoverageEngenharia de Software e Linguagens de ProgramaçãoTeste de interface gráficaTeste de AndroidGeração de casos de testes automáticosTesters face challenges to have their test suites up-to-date with respect to the applica tion source code evolution to be tested. These challenges are greater in a global distributed software development context. The growing daily testing demand also makes it difficult to maintain such suites. These test suites are also continuously automated to save the time of human testers, but they require maintenance as well. Exploratory testing comes as a trade-off between test case maintenance, human expertise, and flexibility. Unfortunately, it is a man ual task in general. In this work, we specifically designed a strategy called AETing. AETing receives Test Scenarios generated by ArcWizard, which are the results of code static analysis that produces screen navigations suggestion that covers code change, and AETing maps such static screen navigations suggestion into concrete code implementation based on Page Objects maintained by Motorola in its testing framework called Page Browser. AETing combines these two resources to generate automated test cases that perform screen navigations and Monkey testing aiming to maximize coverage of code changes evolution between two versions of a given Android application. We developed and evaluated our approach in a real testing opera tion environment related to Motorola Mobility, through a partnership between CIn-UFPE and this company supported by the Informatics Law. The evaluation consisted of testing four dif ferent Motorola Android applications. Through the evaluation, we obtained promising results concerning the comparison between AETing and expert exploratory testers’ code coverage. We discuss in detail how AETing works and the results achieved.Testadores enfrentam desafios para ter suas suítes de testes atualizadas em relação à evolução do código fonte da aplicação a ser testada. Estes desafios são maiores dentro de um contexto de desenvolvimento de software globalmente distribuído. A crescente demanda diária por testes também torna difícil a manutenção de tais suítes. Estas suítes de testes são, também, continuamente automatizadas para economizar tempo dos testadores humanos, mas elas também requerem manutenção. O teste exploratório vem como um balanceamento en tre manutenção de casos de testes e a experiência humana e flexibilidade. Infelizmente, em geral, esta é uma atividade manual. Neste trabalho nós desenvolvemos especificamente uma estratégia chamada AETing. AETing recebe Test Scenarios gerados por ArcWizard, que são resultados de análise estática de código que produz sugestões de navegação de tela que co brem mudança de código, e AETing mapeia tais sugestões estáticas de navegações de tela em implementação concreta de código baseado em Page Objects mantidos pela Motorola em seu framework de teste chamado Page Browser. AETing comina estes dois recursos para gerar casos de testes automatizados que executam navegações de tela e teste de Monkey objeti vando maximizar a cobertura da evolução da mudança de código entre duas versões de uma dada aplicação Android. Nós desenvolvemos e avaliamos nossa abordagem em um ambiente operacional real de teste relacionado à Motorola Mobility, através de um convênio entre o CIn-UFPE e esta empresa apoiado pela Lei de Informática. A avaliação consistiu em testar quatro diferentes aplicações Android da Motorola. Através da avaliação nós obtivemos resul tados promissores relativos à comparação entre a cobetura de código alcançada por AETing e testadores exploratórios experientes. Nós discutimos em detalhes como AETing funciona e os resultados alcançados.Universidade Federal de PernambucoUFPEBrasilPrograma de Pos Graduacao em Ciencia da ComputacaoMOTA, Alexandre Cabralhttp://lattes.cnpq.br/6841603670343463http://lattes.cnpq.br/2794026545404598OLIVEIRA, Marlom Jobsom Dias de2021-05-13T17:28:55Z2021-05-13T17:28:55Z2020-12-23info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfOLIVEIRA, Marlom Jobsom Dias de. AETing : an automated exploratory testing strategy based on code evolutioncoverage. 2020. Dissertação (Mestrado em Ciência da Computação) - Universidade Federal de Pernambuco, Recife, 2020.https://repositorio.ufpe.br/handle/123456789/40070ark:/64986/001300000hgn5engAttribution-NonCommercial-NoDerivs 3.0 Brazilhttp://creativecommons.org/licenses/by-nc-nd/3.0/br/info:eu-repo/semantics/openAccessreponame:Repositório Institucional da UFPEinstname:Universidade Federal de Pernambuco (UFPE)instacron:UFPE2021-05-14T05:16:54Zoai:repositorio.ufpe.br:123456789/40070Repositório InstitucionalPUBhttps://repositorio.ufpe.br/oai/requestattena@ufpe.bropendoar:22212021-05-14T05:16:54Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)false
dc.title.none.fl_str_mv AETing : an automated exploratory testing strategy based on code evolutioncoverage
title AETing : an automated exploratory testing strategy based on code evolutioncoverage
spellingShingle AETing : an automated exploratory testing strategy based on code evolutioncoverage
OLIVEIRA, Marlom Jobsom Dias de
Engenharia de Software e Linguagens de Programação
Teste de interface gráfica
Teste de Android
Geração de casos de testes automáticos
title_short AETing : an automated exploratory testing strategy based on code evolutioncoverage
title_full AETing : an automated exploratory testing strategy based on code evolutioncoverage
title_fullStr AETing : an automated exploratory testing strategy based on code evolutioncoverage
title_full_unstemmed AETing : an automated exploratory testing strategy based on code evolutioncoverage
title_sort AETing : an automated exploratory testing strategy based on code evolutioncoverage
author OLIVEIRA, Marlom Jobsom Dias de
author_facet OLIVEIRA, Marlom Jobsom Dias de
author_role author
dc.contributor.none.fl_str_mv MOTA, Alexandre Cabral
http://lattes.cnpq.br/6841603670343463
http://lattes.cnpq.br/2794026545404598
dc.contributor.author.fl_str_mv OLIVEIRA, Marlom Jobsom Dias de
dc.subject.por.fl_str_mv Engenharia de Software e Linguagens de Programação
Teste de interface gráfica
Teste de Android
Geração de casos de testes automáticos
topic Engenharia de Software e Linguagens de Programação
Teste de interface gráfica
Teste de Android
Geração de casos de testes automáticos
description Testers face challenges to have their test suites up-to-date with respect to the applica tion source code evolution to be tested. These challenges are greater in a global distributed software development context. The growing daily testing demand also makes it difficult to maintain such suites. These test suites are also continuously automated to save the time of human testers, but they require maintenance as well. Exploratory testing comes as a trade-off between test case maintenance, human expertise, and flexibility. Unfortunately, it is a man ual task in general. In this work, we specifically designed a strategy called AETing. AETing receives Test Scenarios generated by ArcWizard, which are the results of code static analysis that produces screen navigations suggestion that covers code change, and AETing maps such static screen navigations suggestion into concrete code implementation based on Page Objects maintained by Motorola in its testing framework called Page Browser. AETing combines these two resources to generate automated test cases that perform screen navigations and Monkey testing aiming to maximize coverage of code changes evolution between two versions of a given Android application. We developed and evaluated our approach in a real testing opera tion environment related to Motorola Mobility, through a partnership between CIn-UFPE and this company supported by the Informatics Law. The evaluation consisted of testing four dif ferent Motorola Android applications. Through the evaluation, we obtained promising results concerning the comparison between AETing and expert exploratory testers’ code coverage. We discuss in detail how AETing works and the results achieved.
publishDate 2020
dc.date.none.fl_str_mv 2020-12-23
2021-05-13T17:28:55Z
2021-05-13T17:28:55Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv OLIVEIRA, Marlom Jobsom Dias de. AETing : an automated exploratory testing strategy based on code evolutioncoverage. 2020. Dissertação (Mestrado em Ciência da Computação) - Universidade Federal de Pernambuco, Recife, 2020.
https://repositorio.ufpe.br/handle/123456789/40070
dc.identifier.dark.fl_str_mv ark:/64986/001300000hgn5
identifier_str_mv OLIVEIRA, Marlom Jobsom Dias de. AETing : an automated exploratory testing strategy based on code evolutioncoverage. 2020. Dissertação (Mestrado em Ciência da Computação) - Universidade Federal de Pernambuco, Recife, 2020.
ark:/64986/001300000hgn5
url https://repositorio.ufpe.br/handle/123456789/40070
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidade Federal de Pernambuco
UFPE
Brasil
Programa de Pos Graduacao em Ciencia da Computacao
publisher.none.fl_str_mv Universidade Federal de Pernambuco
UFPE
Brasil
Programa de Pos Graduacao em Ciencia da Computacao
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFPE
instname:Universidade Federal de Pernambuco (UFPE)
instacron:UFPE
instname_str Universidade Federal de Pernambuco (UFPE)
instacron_str UFPE
institution UFPE
reponame_str Repositório Institucional da UFPE
collection Repositório Institucional da UFPE
repository.name.fl_str_mv Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)
repository.mail.fl_str_mv attena@ufpe.br
_version_ 1846272496104374272