Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders

Bibliographic Details
Main Author: Saldanha, Mário Roberto de Freitas
Publication Date: 2021
Format: Doctoral thesis
Language: por
Source: Repositório Institucional da UFPel - Guaiaca
Download full: http://guaiaca.ufpel.edu.br/handle/prefix/8176
Summary: The Versatile Video Coding (VVC) standard was developed to supply the current demand for the upcoming video applications, enabling higher compression performance than previous video coding standards and high versatility to adapt to different types of applications and videos. VVC brings several innovations and enhancements in the coding modules, including larger block sizes, more flexible block partitioning, more angular intra-frame prediction modes, affine motion compensation, and multiple transform selection. Although VVC can provide a high compression performance, these new tools significantly increased the encoding effort. This Thesis proposes timesaving solutions to reduce the encoding effort of the VVC intra-frame prediction. A performance analysis of VVC intra-frame prediction is firstly presented to identify the most time-consuming modules that must be prioritized to accomplish the objective of this work. Subsequently, timesaving solutions based on heuristic and machine learning approaches are presented regarding different intra-frame prediction steps of VVC encoding, including block partitioning of luminance and chrominance samples, mode selection of luminance samples, and the transform selection of luminance samples. It was possible to achieve between 8.5% and 61.3% of encoding time reduction with Bjontegaard Delta Bit Rate (BDBR) ranging from 0.4% to 2.4%. These solutions presented competitive results when compared to the related works.
id UFPL_adf93d8d72f15ccc564b1a585a1d6587
oai_identifier_str oai:guaiaca.ufpel.edu.br:prefix/8176
network_acronym_str UFPL
network_name_str Repositório Institucional da UFPel - Guaiaca
repository_id_str
spelling 2022-02-16T12:56:40Z2022-02-16T12:56:40Z2021-12-13SALDANHA, Mário Roberto de Freitas. Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders. Orientador: Luciano Agostini. 2021. 134f. Tese (Doutorado) – Programa de Pós-Graduação em Computação, Centro de Desenvolvimento Tecnológico, Universidade Federal de Pelotas, Pelotas, 2021.http://guaiaca.ufpel.edu.br/handle/prefix/8176The Versatile Video Coding (VVC) standard was developed to supply the current demand for the upcoming video applications, enabling higher compression performance than previous video coding standards and high versatility to adapt to different types of applications and videos. VVC brings several innovations and enhancements in the coding modules, including larger block sizes, more flexible block partitioning, more angular intra-frame prediction modes, affine motion compensation, and multiple transform selection. Although VVC can provide a high compression performance, these new tools significantly increased the encoding effort. This Thesis proposes timesaving solutions to reduce the encoding effort of the VVC intra-frame prediction. A performance analysis of VVC intra-frame prediction is firstly presented to identify the most time-consuming modules that must be prioritized to accomplish the objective of this work. Subsequently, timesaving solutions based on heuristic and machine learning approaches are presented regarding different intra-frame prediction steps of VVC encoding, including block partitioning of luminance and chrominance samples, mode selection of luminance samples, and the transform selection of luminance samples. It was possible to achieve between 8.5% and 61.3% of encoding time reduction with Bjontegaard Delta Bit Rate (BDBR) ranging from 0.4% to 2.4%. These solutions presented competitive results when compared to the related works.O padrão de Codificação de Vídeo Versátil, do inglês Versatile Video Coding (VVC), foi desenvolvido para atender a demanda atual relacionada às aplicações de vídeo, fornecendo maior eficiência de compressão quando comparado a padrões anteriores de codificação e alta versatilidade para se adaptar a diferentes tipos de aplicações e vídeos. O VVC insere várias inovações e melhoramentos nos módulos de codificação, incluindo blocos de tamanhos maiores, particionamento de bloco mais flexível, mais modos angulares para a predição intra-quadro, compensação de movimento afim, e seleção múltipla de transformadas. Embora o VVC seja capaz de fornecer alta eficiência de compressão, essas novas ferramentas aumentaram o esforço de codificação significativamente. Esta Tese propõe soluções eficientes para reduzir o esforço de codificação da predição intra-quadro do VVC. Uma análise de performance da predição intra-quadro do VVC é apresentada inicialmente para identificar os módulos que consomem mais tempo e que devem ser priorizadas para alcançar o objetivo do trabalho. Posteriormente, soluções para redução do tempo de codificação baseadas em heurísticas e em aprendizado de máquina são apresentadas, considerando diferentes etapas da predição intra-quadro do codificador VVC, incluindo o particionamento de bloco das amostras de luminância e de crominância, a seleção de modo de amostras de luminância e a seleção de transformada de amostras de luminância. Foi possível alcançar entre 8,5% e 61,3% de redução no tempo de codificação com o Bjontegaard Delta Bit Rate (BDBR) variando de 0,4% a 2,4%. Essas soluções apresentaram resultados competitivos quando comparados aos trabalhos relacionados.Sem bolsaporUniversidade Federal de PelotasPrograma de Pós-Graduação em ComputaçãoUFPelBrasilCentro de Desenvolvimento TecnológicoCNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAOComputaçãoVideo codingVVCIntra-frame predictionEncoding time savingMachine learningCodificação de vídeosPredição intra-quadroRedução do tempo de codificaçãoAprendizado de máquinaExploration of encoding time reduction solutions for intra-frame prediction of VVC encodersExploração de soluções de redução de tempo de codificação para a predição intra-quadro do codificador VVCinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesishttp://lattes.cnpq.br/2632487542026298http://lattes.cnpq.br/9604735363839730Sanchez, Gustavo Freitashttp://lattes.cnpq.br/8246561866162562Marcon, César Augusto Missiohttp://lattes.cnpq.br/8611020242763828Agostini, Luciano VolcanSaldanha, Mário Roberto de Freitasinfo:eu-repo/semantics/openAccessreponame:Repositório Institucional da UFPel - Guaiacainstname:Universidade Federal de Pelotas (UFPEL)instacron:UFPELTEXTTese_Mario_Saldanha.pdf.txtTese_Mario_Saldanha.pdf.txtExtracted texttext/plain263776http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/6/Tese_Mario_Saldanha.pdf.txte3d26a22f0108a1ddc7aaef945eb47d0MD56open accessTHUMBNAILTese_Mario_Saldanha.pdf.jpgTese_Mario_Saldanha.pdf.jpgGenerated Thumbnailimage/jpeg1183http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/7/Tese_Mario_Saldanha.pdf.jpge76f15219465ef1d23c7439ecccfb974MD57open accessORIGINALTese_Mario_Saldanha.pdfTese_Mario_Saldanha.pdfapplication/pdf2699814http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/1/Tese_Mario_Saldanha.pdf4b26e4ca1057bfd0301a4cd7511dffecMD51open accessCC-LICENSElicense_urllicense_urltext/plain; charset=utf-849http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/2/license_url924993ce0b3ba389f79f32a1b2735415MD52open accesslicense_textlicense_texttext/html; charset=utf-80http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/3/license_textd41d8cd98f00b204e9800998ecf8427eMD53open accesslicense_rdflicense_rdfapplication/rdf+xml; charset=utf-80http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/4/license_rdfd41d8cd98f00b204e9800998ecf8427eMD54open accessLICENSElicense.txtlicense.txttext/plain; charset=utf-81866http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/5/license.txt43cd690d6a359e86c1fe3d5b7cba0c9bMD55open accessprefix/81762023-07-13 06:12:14.37open accessoai:guaiaca.ufpel.edu.br:prefix/8176TElDRU7Dh0EgREUgRElTVFJJQlVJw4fDg08gTsODTy1FWENMVVNJVkEKCkNvbSBhIGFwcmVzZW50YcOnw6NvIGRlc3RhIGxpY2Vuw6dhLCB2b2PDqiAobyBhdXRvciAoZXMpIG91IG8gdGl0dWxhciBkb3MgZGlyZWl0b3MgZGUgYXV0b3IpIGNvbmNlZGUgYW8gUmVwb3NpdMOzcmlvIApJbnN0aXR1Y2lvbmFsIG8gZGlyZWl0byBuw6NvLWV4Y2x1c2l2byBkZSByZXByb2R1emlyLCAgdHJhZHV6aXIgKGNvbmZvcm1lIGRlZmluaWRvIGFiYWl4byksIGUvb3UgZGlzdHJpYnVpciBhIApzdWEgcHVibGljYcOnw6NvIChpbmNsdWluZG8gbyByZXN1bW8pIHBvciB0b2RvIG8gbXVuZG8gbm8gZm9ybWF0byBpbXByZXNzbyBlIGVsZXRyw7RuaWNvIGUgZW0gcXVhbHF1ZXIgbWVpbywgaW5jbHVpbmRvIG9zIApmb3JtYXRvcyDDoXVkaW8gb3UgdsOtZGVvLgoKVm9jw6ogY29uY29yZGEgcXVlIG8gRGVwb3NpdGEgcG9kZSwgc2VtIGFsdGVyYXIgbyBjb250ZcO6ZG8sIHRyYW5zcG9yIGEgc3VhIHB1YmxpY2HDp8OjbyBwYXJhIHF1YWxxdWVyIG1laW8gb3UgZm9ybWF0byAKcGFyYSBmaW5zIGRlIHByZXNlcnZhw6fDo28uCgpWb2PDqiB0YW1iw6ltIGNvbmNvcmRhIHF1ZSBvIERlcG9zaXRhIHBvZGUgbWFudGVyIG1haXMgZGUgdW1hIGPDs3BpYSBkZSBzdWEgcHVibGljYcOnw6NvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIAplIHByZXNlcnZhw6fDo28uCgpWb2PDqiBkZWNsYXJhIHF1ZSBhIHN1YSBwdWJsaWNhw6fDo28gw6kgb3JpZ2luYWwgZSBxdWUgdm9jw6ogdGVtIG8gcG9kZXIgZGUgY29uY2VkZXIgb3MgZGlyZWl0b3MgY29udGlkb3MgbmVzdGEgbGljZW7Dp2EuIApWb2PDqiB0YW1iw6ltIGRlY2xhcmEgcXVlIG8gZGVww7NzaXRvIGRhIHN1YSBwdWJsaWNhw6fDo28gbsOjbywgcXVlIHNlamEgZGUgc2V1IGNvbmhlY2ltZW50bywgaW5mcmluZ2UgZGlyZWl0b3MgYXV0b3JhaXMgCmRlIG5pbmd1w6ltLgoKQ2FzbyBhIHN1YSBwdWJsaWNhw6fDo28gY29udGVuaGEgbWF0ZXJpYWwgcXVlIHZvY8OqIG7Do28gcG9zc3VpIGEgdGl0dWxhcmlkYWRlIGRvcyBkaXJlaXRvcyBhdXRvcmFpcywgdm9jw6ogZGVjbGFyYSBxdWUgCm9idGV2ZSBhIHBlcm1pc3PDo28gaXJyZXN0cml0YSBkbyBkZXRlbnRvciBkb3MgZGlyZWl0b3MgYXV0b3JhaXMgcGFyYSBjb25jZWRlciBhbyBEZXBvc2l0YSBvcyBkaXJlaXRvcyBhcHJlc2VudGFkb3MgCm5lc3RhIGxpY2Vuw6dhLCBlIHF1ZSBlc3NlIG1hdGVyaWFsIGRlIHByb3ByaWVkYWRlIGRlIHRlcmNlaXJvcyBlc3TDoSBjbGFyYW1lbnRlIGlkZW50aWZpY2FkbyBlIHJlY29uaGVjaWRvIG5vIHRleHRvIApvdSBubyBjb250ZcO6ZG8gZGEgcHVibGljYcOnw6NvIG9yYSBkZXBvc2l0YWRhLgoKQ0FTTyBBIFBVQkxJQ0HDh8ODTyBPUkEgREVQT1NJVEFEQSBURU5IQSBTSURPIFJFU1VMVEFETyBERSBVTSBQQVRST0PDjU5JTyBPVSBBUE9JTyBERSBVTUEgQUfDik5DSUEgREUgRk9NRU5UTyBPVSBPVVRSTyAKT1JHQU5JU01PLCBWT0PDiiBERUNMQVJBIFFVRSBSRVNQRUlUT1UgVE9ET1MgRSBRVUFJU1FVRVIgRElSRUlUT1MgREUgUkVWSVPDg08gQ09NTyBUQU1Cw4lNIEFTIERFTUFJUyBPQlJJR0HDh8OVRVMgCkVYSUdJREFTIFBPUiBDT05UUkFUTyBPVSBBQ09SRE8uCgpPIERlcG9zaXRhIHNlIGNvbXByb21ldGUgYSBpZGVudGlmaWNhciBjbGFyYW1lbnRlIG8gc2V1IG5vbWUgKHMpIG91IG8ocykgbm9tZShzKSBkbyhzKSBkZXRlbnRvcihlcykgZG9zIGRpcmVpdG9zIAphdXRvcmFpcyBkYSBwdWJsaWNhw6fDo28sIGUgbsOjbyBmYXLDoSBxdWFscXVlciBhbHRlcmHDp8OjbywgYWzDqW0gZGFxdWVsYXMgY29uY2VkaWRhcyBwb3IgZXN0YSBsaWNlbsOnYS4KRepositório InstitucionalPUBhttp://repositorio.ufpel.edu.br/oai/requestrippel@ufpel.edu.br || repositorio@ufpel.edu.br || aline.batista@ufpel.edu.bropendoar:2023-07-13T09:12:14Repositório Institucional da UFPel - Guaiaca - Universidade Federal de Pelotas (UFPEL)false
dc.title.pt_BR.fl_str_mv Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders
dc.title.alternative.pt_BR.fl_str_mv Exploração de soluções de redução de tempo de codificação para a predição intra-quadro do codificador VVC
title Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders
spellingShingle Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders
Saldanha, Mário Roberto de Freitas
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
Computação
Video coding
VVC
Intra-frame prediction
Encoding time saving
Machine learning
Codificação de vídeos
Predição intra-quadro
Redução do tempo de codificação
Aprendizado de máquina
title_short Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders
title_full Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders
title_fullStr Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders
title_full_unstemmed Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders
title_sort Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders
author Saldanha, Mário Roberto de Freitas
author_facet Saldanha, Mário Roberto de Freitas
author_role author
dc.contributor.authorLattes.pt_BR.fl_str_mv http://lattes.cnpq.br/2632487542026298
dc.contributor.advisorLattes.pt_BR.fl_str_mv http://lattes.cnpq.br/9604735363839730
dc.contributor.advisor-co1.fl_str_mv Sanchez, Gustavo Freitas
dc.contributor.advisor-co1Lattes.fl_str_mv http://lattes.cnpq.br/8246561866162562
dc.contributor.advisor-co2.fl_str_mv Marcon, César Augusto Missio
dc.contributor.advisor-co2Lattes.fl_str_mv http://lattes.cnpq.br/8611020242763828
dc.contributor.advisor1.fl_str_mv Agostini, Luciano Volcan
dc.contributor.author.fl_str_mv Saldanha, Mário Roberto de Freitas
contributor_str_mv Sanchez, Gustavo Freitas
Marcon, César Augusto Missio
Agostini, Luciano Volcan
dc.subject.cnpq.fl_str_mv CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
topic CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
Computação
Video coding
VVC
Intra-frame prediction
Encoding time saving
Machine learning
Codificação de vídeos
Predição intra-quadro
Redução do tempo de codificação
Aprendizado de máquina
dc.subject.por.fl_str_mv Computação
Video coding
VVC
Intra-frame prediction
Encoding time saving
Machine learning
Codificação de vídeos
Predição intra-quadro
Redução do tempo de codificação
Aprendizado de máquina
description The Versatile Video Coding (VVC) standard was developed to supply the current demand for the upcoming video applications, enabling higher compression performance than previous video coding standards and high versatility to adapt to different types of applications and videos. VVC brings several innovations and enhancements in the coding modules, including larger block sizes, more flexible block partitioning, more angular intra-frame prediction modes, affine motion compensation, and multiple transform selection. Although VVC can provide a high compression performance, these new tools significantly increased the encoding effort. This Thesis proposes timesaving solutions to reduce the encoding effort of the VVC intra-frame prediction. A performance analysis of VVC intra-frame prediction is firstly presented to identify the most time-consuming modules that must be prioritized to accomplish the objective of this work. Subsequently, timesaving solutions based on heuristic and machine learning approaches are presented regarding different intra-frame prediction steps of VVC encoding, including block partitioning of luminance and chrominance samples, mode selection of luminance samples, and the transform selection of luminance samples. It was possible to achieve between 8.5% and 61.3% of encoding time reduction with Bjontegaard Delta Bit Rate (BDBR) ranging from 0.4% to 2.4%. These solutions presented competitive results when compared to the related works.
publishDate 2021
dc.date.issued.fl_str_mv 2021-12-13
dc.date.accessioned.fl_str_mv 2022-02-16T12:56:40Z
dc.date.available.fl_str_mv 2022-02-16T12:56:40Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv SALDANHA, Mário Roberto de Freitas. Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders. Orientador: Luciano Agostini. 2021. 134f. Tese (Doutorado) – Programa de Pós-Graduação em Computação, Centro de Desenvolvimento Tecnológico, Universidade Federal de Pelotas, Pelotas, 2021.
dc.identifier.uri.fl_str_mv http://guaiaca.ufpel.edu.br/handle/prefix/8176
identifier_str_mv SALDANHA, Mário Roberto de Freitas. Exploration of encoding time reduction solutions for intra-frame prediction of VVC encoders. Orientador: Luciano Agostini. 2021. 134f. Tese (Doutorado) – Programa de Pós-Graduação em Computação, Centro de Desenvolvimento Tecnológico, Universidade Federal de Pelotas, Pelotas, 2021.
url http://guaiaca.ufpel.edu.br/handle/prefix/8176
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de Pelotas
dc.publisher.program.fl_str_mv Programa de Pós-Graduação em Computação
dc.publisher.initials.fl_str_mv UFPel
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv Centro de Desenvolvimento Tecnológico
publisher.none.fl_str_mv Universidade Federal de Pelotas
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFPel - Guaiaca
instname:Universidade Federal de Pelotas (UFPEL)
instacron:UFPEL
instname_str Universidade Federal de Pelotas (UFPEL)
instacron_str UFPEL
institution UFPEL
reponame_str Repositório Institucional da UFPel - Guaiaca
collection Repositório Institucional da UFPel - Guaiaca
bitstream.url.fl_str_mv http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/6/Tese_Mario_Saldanha.pdf.txt
http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/7/Tese_Mario_Saldanha.pdf.jpg
http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/1/Tese_Mario_Saldanha.pdf
http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/2/license_url
http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/3/license_text
http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/4/license_rdf
http://guaiaca.ufpel.edu.br/xmlui/bitstream/prefix/8176/5/license.txt
bitstream.checksum.fl_str_mv e3d26a22f0108a1ddc7aaef945eb47d0
e76f15219465ef1d23c7439ecccfb974
4b26e4ca1057bfd0301a4cd7511dffec
924993ce0b3ba389f79f32a1b2735415
d41d8cd98f00b204e9800998ecf8427e
d41d8cd98f00b204e9800998ecf8427e
43cd690d6a359e86c1fe3d5b7cba0c9b
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFPel - Guaiaca - Universidade Federal de Pelotas (UFPEL)
repository.mail.fl_str_mv rippel@ufpel.edu.br || repositorio@ufpel.edu.br || aline.batista@ufpel.edu.br
_version_ 1833858455453040640