Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders
Main Author: | |
---|---|
Publication Date: | 2021 |
Format: | Doctoral thesis |
Language: | por |
Source: | Repositório Institucional da UFPel - Guaiaca |
Download full: | http://guaiaca.ufpel.edu.br/handle/prefix/8176 |
Summary: | The Versatile Video Coding (VVC) standard was developed to supply the current demand for the upcoming video applications, enabling higher compression performance than previous video coding standards and high versatility to adapt to different types of applications and videos. VVC brings several innovations and enhancements in the coding modules, including larger block sizes, more flexible block partitioning, more angular intra-frame prediction modes, affine motion compensation, and multiple transform selection. Although VVC can provide a high compression performance, these new tools significantly increased the encoding effort. This Thesis proposes timesaving solutions to reduce the encoding effort of the VVC intra-frame prediction. A performance analysis of VVC intra-frame prediction is firstly presented to identify the most time-consuming modules that must be prioritized to accomplish the objective of this work. Subsequently, timesaving solutions based on heuristic and machine learning approaches are presented regarding different intra-frame prediction steps of VVC encoding, including block partitioning of luminance and chrominance samples, mode selection of luminance samples, and the transform selection of luminance samples. It was possible to achieve between 8.5% and 61.3% of encoding time reduction with Bjontegaard Delta Bit Rate (BDBR) ranging from 0.4% to 2.4%. These solutions presented competitive results when compared to the related works. |
id |
UFPL_adf93d8d72f15ccc564b1a585a1d6587 |
---|---|
oai_identifier_str |
oai:guaiaca.ufpel.edu.br:prefix/8176 |
network_acronym_str |
UFPL |
network_name_str |
Repositório Institucional da UFPel - Guaiaca |
repository_id_str |
|
spelling |
2022-02-16T12:56:40Z2022-02-16T12:56:40Z2021-12-13SALDANHA, Mário Roberto de Freitas. Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders. Orientador: Luciano Agostini. 2021. 134f. Tese (Doutorado) – Programa de Pós-Graduação em Computação, Centro de Desenvolvimento Tecnológico, Universidade Federal de Pelotas, Pelotas, 2021.http://guaiaca.ufpel.edu.br/handle/prefix/8176The Versatile Video Coding (VVC) standard was developed to supply the current demand for the upcoming video applications, enabling higher compression performance than previous video coding standards and high versatility to adapt to different types of applications and videos. VVC brings several innovations and enhancements in the coding modules, including larger block sizes, more flexible block partitioning, more angular intra-frame prediction modes, affine motion compensation, and multiple transform selection. Although VVC can provide a high compression performance, these new tools significantly increased the encoding effort. This Thesis proposes timesaving solutions to reduce the encoding effort of the VVC intra-frame prediction. A performance analysis of VVC intra-frame prediction is firstly presented to identify the most time-consuming modules that must be prioritized to accomplish the objective of this work. Subsequently, timesaving solutions based on heuristic and machine learning approaches are presented regarding different intra-frame prediction steps of VVC encoding, including block partitioning of luminance and chrominance samples, mode selection of luminance samples, and the transform selection of luminance samples. It was possible to achieve between 8.5% and 61.3% of encoding time reduction with Bjontegaard Delta Bit Rate (BDBR) ranging from 0.4% to 2.4%. These solutions presented competitive results when compared to the related works.O padrão de Codificação de Vídeo Versátil, do inglês Versatile Video Coding (VVC), foi desenvolvido para atender a demanda atual relacionada às aplicações de vídeo, fornecendo maior eficiência de compressão quando comparado a padrões anteriores de codificação e alta versatilidade para se adaptar a diferentes tipos de aplicações e vídeos. O VVC insere várias inovações e melhoramentos nos módulos de codificação, incluindo blocos de tamanhos maiores, particionamento de bloco mais flexível, mais modos angulares para a predição intra-quadro, compensação de movimento afim, e seleção múltipla de transformadas. Embora o VVC seja capaz de fornecer alta eficiência de compressão, essas novas ferramentas aumentaram o esforço de codificação significativamente. Esta Tese propõe soluções eficientes para reduzir o esforço de codificação da predição intra-quadro do VVC. Uma análise de performance da predição intra-quadro do VVC é apresentada inicialmente para identificar os módulos que consomem mais tempo e que devem ser priorizadas para alcançar o objetivo do trabalho. Posteriormente, soluções para redução do tempo de codificação baseadas em heurísticas e em aprendizado de máquina são apresentadas, considerando diferentes etapas da predição intra-quadro do codificador VVC, incluindo o particionamento de bloco das amostras de luminância e de crominância, a seleção de modo de amostras de luminância e a seleção de transformada de amostras de luminância. Foi possível alcançar entre 8,5% e 61,3% de redução no tempo de codificação com o Bjontegaard Delta Bit Rate (BDBR) variando de 0,4% a 2,4%. Essas soluções apresentaram resultados competitivos quando comparados aos trabalhos relacionados.Sem bolsaporUniversidade Federal de PelotasPrograma de Pós-Graduação em ComputaçãoUFPelBrasilCentro de Desenvolvimento TecnológicoCNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAOComputaçãoVideo codingVVCIntra-frame predictionEncoding time savingMachine learningCodificação de vídeosPredição intra-quadroRedução do tempo de codificaçãoAprendizado de máquinaExploration of encoding time reduction solutions for intra-frame prediction of VVC encodersExploração de soluções de redução de tempo de codificação para a predição intra-quadro do codificador VVCinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesishttp://lattes.cnpq.br/2632487542026298http://lattes.cnpq.br/9604735363839730Sanchez, Gustavo Freitashttp://lattes.cnpq.br/8246561866162562Marcon, César Augusto Missiohttp://lattes.cnpq.br/8611020242763828Agostini, Luciano VolcanSaldanha, Mário Roberto de Freitasinfo:eu-repo/semantics/openAccessreponame:Repositório Institucional da UFPel - Guaiacainstname:Universidade Federal de Pelotas (UFPEL)instacron:UFPELTEXTTese_Mario_Saldanha.pdf.txtTese_Mario_Saldanha.pdf.txtExtracted texttext/plain263776http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/6/Tese_Mario_Saldanha.pdf.txte3d26a22f0108a1ddc7aaef945eb47d0MD56open accessTHUMBNAILTese_Mario_Saldanha.pdf.jpgTese_Mario_Saldanha.pdf.jpgGenerated Thumbnailimage/jpeg1183http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/7/Tese_Mario_Saldanha.pdf.jpge76f15219465ef1d23c7439ecccfb974MD57open accessORIGINALTese_Mario_Saldanha.pdfTese_Mario_Saldanha.pdfapplication/pdf2699814http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/1/Tese_Mario_Saldanha.pdf4b26e4ca1057bfd0301a4cd7511dffecMD51open accessCC-LICENSElicense_urllicense_urltext/plain; charset=utf-849http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/2/license_url924993ce0b3ba389f79f32a1b2735415MD52open accesslicense_textlicense_texttext/html; charset=utf-80http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/3/license_textd41d8cd98f00b204e9800998ecf8427eMD53open accesslicense_rdflicense_rdfapplication/rdf+xml; charset=utf-80http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/4/license_rdfd41d8cd98f00b204e9800998ecf8427eMD54open accessLICENSElicense.txtlicense.txttext/plain; charset=utf-81866http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/5/license.txt43cd690d6a359e86c1fe3d5b7cba0c9bMD55open accessprefix/81762023-07-13 06:12:14.37open accessoai:guaiaca.ufpel.edu.br:prefix/8176TElDRU7Dh0EgREUgRElTVFJJQlVJw4fDg08gTsODTy1FWENMVVNJVkEKCkNvbSBhIGFwcmVzZW50YcOnw6NvIGRlc3RhIGxpY2Vuw6dhLCB2b2PDqiAobyBhdXRvciAoZXMpIG91IG8gdGl0dWxhciBkb3MgZGlyZWl0b3MgZGUgYXV0b3IpIGNvbmNlZGUgYW8gUmVwb3NpdMOzcmlvIApJbnN0aXR1Y2lvbmFsIG8gZGlyZWl0byBuw6NvLWV4Y2x1c2l2byBkZSByZXByb2R1emlyLCAgdHJhZHV6aXIgKGNvbmZvcm1lIGRlZmluaWRvIGFiYWl4byksIGUvb3UgZGlzdHJpYnVpciBhIApzdWEgcHVibGljYcOnw6NvIChpbmNsdWluZG8gbyByZXN1bW8pIHBvciB0b2RvIG8gbXVuZG8gbm8gZm9ybWF0byBpbXByZXNzbyBlIGVsZXRyw7RuaWNvIGUgZW0gcXVhbHF1ZXIgbWVpbywgaW5jbHVpbmRvIG9zIApmb3JtYXRvcyDDoXVkaW8gb3UgdsOtZGVvLgoKVm9jw6ogY29uY29yZGEgcXVlIG8gRGVwb3NpdGEgcG9kZSwgc2VtIGFsdGVyYXIgbyBjb250ZcO6ZG8sIHRyYW5zcG9yIGEgc3VhIHB1YmxpY2HDp8OjbyBwYXJhIHF1YWxxdWVyIG1laW8gb3UgZm9ybWF0byAKcGFyYSBmaW5zIGRlIHByZXNlcnZhw6fDo28uCgpWb2PDqiB0YW1iw6ltIGNvbmNvcmRhIHF1ZSBvIERlcG9zaXRhIHBvZGUgbWFudGVyIG1haXMgZGUgdW1hIGPDs3BpYSBkZSBzdWEgcHVibGljYcOnw6NvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIAplIHByZXNlcnZhw6fDo28uCgpWb2PDqiBkZWNsYXJhIHF1ZSBhIHN1YSBwdWJsaWNhw6fDo28gw6kgb3JpZ2luYWwgZSBxdWUgdm9jw6ogdGVtIG8gcG9kZXIgZGUgY29uY2VkZXIgb3MgZGlyZWl0b3MgY29udGlkb3MgbmVzdGEgbGljZW7Dp2EuIApWb2PDqiB0YW1iw6ltIGRlY2xhcmEgcXVlIG8gZGVww7NzaXRvIGRhIHN1YSBwdWJsaWNhw6fDo28gbsOjbywgcXVlIHNlamEgZGUgc2V1IGNvbmhlY2ltZW50bywgaW5mcmluZ2UgZGlyZWl0b3MgYXV0b3JhaXMgCmRlIG5pbmd1w6ltLgoKQ2FzbyBhIHN1YSBwdWJsaWNhw6fDo28gY29udGVuaGEgbWF0ZXJpYWwgcXVlIHZvY8OqIG7Do28gcG9zc3VpIGEgdGl0dWxhcmlkYWRlIGRvcyBkaXJlaXRvcyBhdXRvcmFpcywgdm9jw6ogZGVjbGFyYSBxdWUgCm9idGV2ZSBhIHBlcm1pc3PDo28gaXJyZXN0cml0YSBkbyBkZXRlbnRvciBkb3MgZGlyZWl0b3MgYXV0b3JhaXMgcGFyYSBjb25jZWRlciBhbyBEZXBvc2l0YSBvcyBkaXJlaXRvcyBhcHJlc2VudGFkb3MgCm5lc3RhIGxpY2Vuw6dhLCBlIHF1ZSBlc3NlIG1hdGVyaWFsIGRlIHByb3ByaWVkYWRlIGRlIHRlcmNlaXJvcyBlc3TDoSBjbGFyYW1lbnRlIGlkZW50aWZpY2FkbyBlIHJlY29uaGVjaWRvIG5vIHRleHRvIApvdSBubyBjb250ZcO6ZG8gZGEgcHVibGljYcOnw6NvIG9yYSBkZXBvc2l0YWRhLgoKQ0FTTyBBIFBVQkxJQ0HDh8ODTyBPUkEgREVQT1NJVEFEQSBURU5IQSBTSURPIFJFU1VMVEFETyBERSBVTSBQQVRST0PDjU5JTyBPVSBBUE9JTyBERSBVTUEgQUfDik5DSUEgREUgRk9NRU5UTyBPVSBPVVRSTyAKT1JHQU5JU01PLCBWT0PDiiBERUNMQVJBIFFVRSBSRVNQRUlUT1UgVE9ET1MgRSBRVUFJU1FVRVIgRElSRUlUT1MgREUgUkVWSVPDg08gQ09NTyBUQU1Cw4lNIEFTIERFTUFJUyBPQlJJR0HDh8OVRVMgCkVYSUdJREFTIFBPUiBDT05UUkFUTyBPVSBBQ09SRE8uCgpPIERlcG9zaXRhIHNlIGNvbXByb21ldGUgYSBpZGVudGlmaWNhciBjbGFyYW1lbnRlIG8gc2V1IG5vbWUgKHMpIG91IG8ocykgbm9tZShzKSBkbyhzKSBkZXRlbnRvcihlcykgZG9zIGRpcmVpdG9zIAphdXRvcmFpcyBkYSBwdWJsaWNhw6fDo28sIGUgbsOjbyBmYXLDoSBxdWFscXVlciBhbHRlcmHDp8OjbywgYWzDqW0gZGFxdWVsYXMgY29uY2VkaWRhcyBwb3IgZXN0YSBsaWNlbsOnYS4KRepositório InstitucionalPUBhttp://repositorio.ufpel.edu.br/oai/requestrippel@ufpel.edu.br || repositorio@ufpel.edu.br || aline.batista@ufpel.edu.bropendoar:2023-07-13T09:12:14Repositório Institucional da UFPel - Guaiaca - Universidade Federal de Pelotas (UFPEL)false |
dc.title.pt_BR.fl_str_mv |
Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders |
dc.title.alternative.pt_BR.fl_str_mv |
Exploração de soluções de redução de tempo de codificação para a predição intra-quadro do codificador VVC |
title |
Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders |
spellingShingle |
Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders Saldanha, Mário Roberto de Freitas CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO Computação Video coding VVC Intra-frame prediction Encoding time saving Machine learning Codificação de vídeos Predição intra-quadro Redução do tempo de codificação Aprendizado de máquina |
title_short |
Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders |
title_full |
Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders |
title_fullStr |
Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders |
title_full_unstemmed |
Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders |
title_sort |
Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders |
author |
Saldanha, Mário Roberto de Freitas |
author_facet |
Saldanha, Mário Roberto de Freitas |
author_role |
author |
dc.contributor.authorLattes.pt_BR.fl_str_mv |
http://lattes.cnpq.br/2632487542026298 |
dc.contributor.advisorLattes.pt_BR.fl_str_mv |
http://lattes.cnpq.br/9604735363839730 |
dc.contributor.advisor-co1.fl_str_mv |
Sanchez, Gustavo Freitas |
dc.contributor.advisor-co1Lattes.fl_str_mv |
http://lattes.cnpq.br/8246561866162562 |
dc.contributor.advisor-co2.fl_str_mv |
Marcon, César Augusto Missio |
dc.contributor.advisor-co2Lattes.fl_str_mv |
http://lattes.cnpq.br/8611020242763828 |
dc.contributor.advisor1.fl_str_mv |
Agostini, Luciano Volcan |
dc.contributor.author.fl_str_mv |
Saldanha, Mário Roberto de Freitas |
contributor_str_mv |
Sanchez, Gustavo Freitas Marcon, César Augusto Missio Agostini, Luciano Volcan |
dc.subject.cnpq.fl_str_mv |
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO |
topic |
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO Computação Video coding VVC Intra-frame prediction Encoding time saving Machine learning Codificação de vídeos Predição intra-quadro Redução do tempo de codificação Aprendizado de máquina |
dc.subject.por.fl_str_mv |
Computação Video coding VVC Intra-frame prediction Encoding time saving Machine learning Codificação de vídeos Predição intra-quadro Redução do tempo de codificação Aprendizado de máquina |
description |
The Versatile Video Coding (VVC) standard was developed to supply the current demand for the upcoming video applications, enabling higher compression performance than previous video coding standards and high versatility to adapt to different types of applications and videos. VVC brings several innovations and enhancements in the coding modules, including larger block sizes, more flexible block partitioning, more angular intra-frame prediction modes, affine motion compensation, and multiple transform selection. Although VVC can provide a high compression performance, these new tools significantly increased the encoding effort. This Thesis proposes timesaving solutions to reduce the encoding effort of the VVC intra-frame prediction. A performance analysis of VVC intra-frame prediction is firstly presented to identify the most time-consuming modules that must be prioritized to accomplish the objective of this work. Subsequently, timesaving solutions based on heuristic and machine learning approaches are presented regarding different intra-frame prediction steps of VVC encoding, including block partitioning of luminance and chrominance samples, mode selection of luminance samples, and the transform selection of luminance samples. It was possible to achieve between 8.5% and 61.3% of encoding time reduction with Bjontegaard Delta Bit Rate (BDBR) ranging from 0.4% to 2.4%. These solutions presented competitive results when compared to the related works. |
publishDate |
2021 |
dc.date.issued.fl_str_mv |
2021-12-13 |
dc.date.accessioned.fl_str_mv |
2022-02-16T12:56:40Z |
dc.date.available.fl_str_mv |
2022-02-16T12:56:40Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/doctoralThesis |
format |
doctoralThesis |
status_str |
publishedVersion |
dc.identifier.citation.fl_str_mv |
SALDANHA, Mário Roberto de Freitas. Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders. Orientador: Luciano Agostini. 2021. 134f. Tese (Doutorado) – Programa de Pós-Graduação em Computação, Centro de Desenvolvimento Tecnológico, Universidade Federal de Pelotas, Pelotas, 2021. |
dc.identifier.uri.fl_str_mv |
http://guaiaca.ufpel.edu.br/handle/prefix/8176 |
identifier_str_mv |
SALDANHA, Mário Roberto de Freitas. Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders. Orientador: Luciano Agostini. 2021. 134f. Tese (Doutorado) – Programa de Pós-Graduação em Computação, Centro de Desenvolvimento Tecnológico, Universidade Federal de Pelotas, Pelotas, 2021. |
url |
http://guaiaca.ufpel.edu.br/handle/prefix/8176 |
dc.language.iso.fl_str_mv |
por |
language |
por |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.publisher.none.fl_str_mv |
Universidade Federal de Pelotas |
dc.publisher.program.fl_str_mv |
Programa de Pós-Graduação em Computação |
dc.publisher.initials.fl_str_mv |
UFPel |
dc.publisher.country.fl_str_mv |
Brasil |
dc.publisher.department.fl_str_mv |
Centro de Desenvolvimento Tecnológico |
publisher.none.fl_str_mv |
Universidade Federal de Pelotas |
dc.source.none.fl_str_mv |
reponame:Repositório Institucional da UFPel - Guaiaca instname:Universidade Federal de Pelotas (UFPEL) instacron:UFPEL |
instname_str |
Universidade Federal de Pelotas (UFPEL) |
instacron_str |
UFPEL |
institution |
UFPEL |
reponame_str |
Repositório Institucional da UFPel - Guaiaca |
collection |
Repositório Institucional da UFPel - Guaiaca |
bitstream.url.fl_str_mv |
http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/6/Tese_Mario_Saldanha.pdf.txt http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/7/Tese_Mario_Saldanha.pdf.jpg http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/1/Tese_Mario_Saldanha.pdf http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/2/license_url http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/3/license_text http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/4/license_rdf http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/5/license.txt |
bitstream.checksum.fl_str_mv |
e3d26a22f0108a1ddc7aaef945eb47d0 e76f15219465ef1d23c7439ecccfb974 4b26e4ca1057bfd0301a4cd7511dffec 924993ce0b3ba389f79f32a1b2735415 d41d8cd98f00b204e9800998ecf8427e d41d8cd98f00b204e9800998ecf8427e 43cd690d6a359e86c1fe3d5b7cba0c9b |
bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 MD5 MD5 MD5 MD5 |
repository.name.fl_str_mv |
Repositório Institucional da UFPel - Guaiaca - Universidade Federal de Pelotas (UFPEL) |
repository.mail.fl_str_mv |
rippel@ufpel.edu.br || repositorio@ufpel.edu.br || aline.batista@ufpel.edu.br |
_version_ |
1833858455453040640 |