Special session: how much quality is enough quality? A case for acceptability in approximate designs
Approximate systems are designed to offer improved efficiency with potentially reduced quality of results. Quality of output in these systems is typically quantified in comparison to a precise result using metrics such as RMSE, MAE, PSNR, or application-specific metrics such as structural similarity...
Principais autores: | Felzmann, Isaías Bittencourt, Fabrício Filho, João, Oliveira, Juliane Regina de, Wanner, Lucas Francisco |
---|---|
Formato: | Trabalho Apresentado em Evento |
Idioma: | Inglês |
Publicado em: |
Campo Mourao
2022
|
Assuntos: | |
Acesso em linha: |
http://repositorio.utfpr.edu.br/jspui/handle/1/29755 |
Tags: |
Adicionar Tag
Sem tags, seja o primeiro a adicionar uma tag!
|
id |
riut-1-29755 |
---|---|
recordtype |
dspace |
spelling |
riut-1-297552022-09-28T06:07:13Z Special session: how much quality is enough quality? A case for acceptability in approximate designs Felzmann, Isaías Bittencourt Fabrício Filho, João Oliveira, Juliane Regina de Wanner, Lucas Francisco Teoria da aproximação Imagens digitais Processamento de sinais Energia - Consumo Approximation theory Digital images Signal processing Energy consumption CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO Approximate systems are designed to offer improved efficiency with potentially reduced quality of results. Quality of output in these systems is typically quantified in comparison to a precise result using metrics such as RMSE, MAE, PSNR, or application-specific metrics such as structural similarity of images (SSIM). Furthermore, systems are typically designed to maximize efficiency for a given minimum quality requirement. It is often difficult to determine what this quality requirement should be for an application, let alone a system. Thus, a fixed quality requirement may be overly conservative, and leave optimization opportunities on the table. In this work, we present a different approach to evaluate approximate systems based on the usefulness of results instead of quality. Our method qualitatively determines the acceptability of approximate results within different processing pipelines. To demonstrate the method, we implement three image and signal processing applications featuring scenarios of image classification, image recognition, and frequency estimation. Our results show that designing approximate systems to guarantee acceptability can produce up to 20% more valid results than the conservative quality thresholds commonly adopted in the literature, allowing for higher error rates and, consequently, lower energy cost. 2022-09-27T17:01:34Z 5000 2022-09-27T17:01:34Z 2021-10-24 conferenceObject FELZMANN, Isaías; FABRÍCIO FILHO, João; OLIVEIRA, Juliane Regina de; WANNER, Lucas. Special session: how much quality is enough quality? A case for acceptability in approximate designs. In: INTERNATIONAL CONFERENCE ON COMPUTER DESIGN, 39., 2021, Storrs. Anais eletrônicos […]. Los Alamitos: IEEE Computer Society, Conference Publishing Services, 2021. p. 5-8. DOI: 10.1109/ICCD53106.2021.00013. Disponível em: https://ieeexplore.ieee.org/document/9643638. Acesso em: 09 jun. 2022. 9781665432191 2576-6996 http://repositorio.utfpr.edu.br/jspui/handle/1/29755 10.1109/ICCD53106.2021.00013 eng International Conference on Computer Design https://ieeexplore.ieee.org/document/9643638 embargoedAccess https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9643822 application/pdf Campo Mourao Estados unidos |
institution |
Universidade Tecnológica Federal do Paraná |
collection |
RIUT |
language |
Inglês |
topic |
Teoria da aproximação Imagens digitais Processamento de sinais Energia - Consumo Approximation theory Digital images Signal processing Energy consumption CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO |
spellingShingle |
Teoria da aproximação Imagens digitais Processamento de sinais Energia - Consumo Approximation theory Digital images Signal processing Energy consumption CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO Felzmann, Isaías Bittencourt Fabrício Filho, João Oliveira, Juliane Regina de Wanner, Lucas Francisco Special session: how much quality is enough quality? A case for acceptability in approximate designs |
description |
Approximate systems are designed to offer improved efficiency with potentially reduced quality of results. Quality of output in these systems is typically quantified in comparison to a precise result using metrics such as RMSE, MAE, PSNR, or application-specific metrics such as structural similarity of images (SSIM). Furthermore, systems are typically designed to maximize efficiency for a given minimum quality requirement. It is often difficult to determine what this quality requirement should be for an application, let alone a system. Thus, a fixed quality requirement may be overly conservative, and leave optimization opportunities on the table. In this work, we present a different approach to evaluate approximate systems based on the usefulness of results instead of quality. Our method qualitatively determines the acceptability of approximate results within different processing pipelines. To demonstrate the method, we implement three image and signal processing applications featuring scenarios of image classification, image recognition, and frequency estimation. Our results show that designing approximate systems to guarantee acceptability can produce up to 20% more valid results than the conservative quality thresholds commonly adopted in the literature, allowing for higher error rates and, consequently, lower energy cost. |
format |
Trabalho Apresentado em Evento |
author |
Felzmann, Isaías Bittencourt Fabrício Filho, João Oliveira, Juliane Regina de Wanner, Lucas Francisco |
author_sort |
Felzmann, Isaías Bittencourt |
title |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
title_short |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
title_full |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
title_fullStr |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
title_full_unstemmed |
Special session: how much quality is enough quality? A case for acceptability in approximate designs |
title_sort |
special session: how much quality is enough quality? a case for acceptability in approximate designs |
publisher |
Campo Mourao |
publishDate |
2022 |
citation |
FELZMANN, Isaías; FABRÍCIO FILHO, João; OLIVEIRA, Juliane Regina de; WANNER, Lucas. Special session: how much quality is enough quality? A case for acceptability in approximate designs. In: INTERNATIONAL CONFERENCE ON COMPUTER DESIGN, 39., 2021, Storrs. Anais eletrônicos […]. Los Alamitos: IEEE Computer Society, Conference Publishing Services, 2021. p. 5-8. DOI: 10.1109/ICCD53106.2021.00013. Disponível em: https://ieeexplore.ieee.org/document/9643638. Acesso em: 09 jun. 2022. 9781665432191 2576-6996 10.1109/ICCD53106.2021.00013 |
url |
http://repositorio.utfpr.edu.br/jspui/handle/1/29755 |
_version_ |
1805318189078282240 |
score |
10,814766 |