Scripted UI Testing of Android Apps: A Study on Diffusion, Evolution and Fragility

Tipo di pubblicazione: Articolo in atti di convegno
Tipologia MIUR: Contributo in Atti di Convegno (Proceeding) > Contributo in atti di convegno
Titolo: Scripted UI Testing of Android Apps: A Study on Diffusion, Evolution and Fragility
Autori: Coppola, Riccardo; Morisio, Maurizio; Torchiano, Marco
Autori di ateneo:
Tipo di referee: Esperti anonimi
Editore: ACM
Titolo del convegno: PROMISE '17
Luogo dell'evento: Toronto (Canada)
Data dell'evento: 2017
Abstract: Background. Evidence suggests that mobile applications are not thoroughly tested as their desktop counterparts. In particular GUI testing is generally limited. Like web-based applications, mobile apps suffer from GUI test fragility, i.e. GUI test classes failing due to minor modifications in the GUI, without the application functionalities being altered. Aims. The objective of our study is to examine the diffusion of GUI testing on Android, and the amount of changes required to keep test classes up to date, and in particular the changes due to GUI test fragility. We define metrics to characterize the modifications and evolution of test classes and test methods, and proxies to estimate fragility-induced changes. Method. To perform our experiments, we selected six widely used open-source tools for scripted GUI testing of mobile applications previously described in the literature. We have mined the repositories on GitHub that used those tools, and computed our set of metrics. Results. We found that none of the considered GUI testing frameworks achieved a major diffusion among the open-source Android projects available on GitHub. For projects with GUI tests, we found that test suites have to be modified often, specifically 5%-10% of developers' modified LOCs belong to tests, and that a relevant portion (60% on average) of such modifications are induced by fragility. Conclusions. Fragility of GUI test classes constitute a relevant concern, possibly being an obstacle for developers to adopt automated scripted GUI tests. This first evaluation and measure of fragility of Android scripted GUI testing can constitute a benchmark for developers, and the basis for the definition of a taxonomy of fragility causes, and actionable guidelines to mitigate the issue.
Status: In stampa
Lingua della pubblicazione:
Parole chiave: software evolution, software maintenance, mobile development, automated software testing, gui testing
Dipartimenti (originale): NON SPECIFICATO
Dipartimenti: DAUIN - Dipartimento di Automatica e Informatica
URL correlate:
    Area disciplinare: Area 09 - Ingegneria industriale e dell'informazione > SISTEMI DI ELABORAZIONE DELLE INFORMAZIONI
    Data di deposito: 13 Set 2017 13:05
    Data ultima modifica (IRIS): 13 Set 2017 13:18:16
    Data inserimento (PORTO): 15 Set 2017 02:13
    Link resolver URL: Link resolver link


    [img] PDF (PROMISE_2017_paper_13_6_.pdf) - Preprint
    Accesso al documento: Non visibile (accessibile solo al proprietario del dato)
    Licenza: Non pubblico - Accesso privato / Ristretto.

    Download (376Kb (385815 bytes)) | Spedisci una richiesta all'autore per una copia del documento

    Azioni (richiesto il login)

    Visualizza il documento (riservato amministratori) Visualizza il documento (riservato amministratori)