Dynamic Data Translation Method for Data Sharing Platform

Bibliographic Details
Main Author: Santos, Filipe Pereira dos
Publication Date: 2024
Format: Master thesis
Language: eng
Source: Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
Download full: https://hdl.handle.net/10348/12888
Summary: In recent years, there has been a growing IoT field and it is expected to keep growing in the years to come. Currently, this field is estimated to be worth about 240 billion dollars with an expectancy of reaching 520 billion by 2027. In terms of devices, it is estimated that about 13 billion devices are connected with a prospect of reaching 23 billion devices by 2027. The industry value and the number of devices connected show that this is a hot field, and with that, it brings a lot of new players into this field with new data formats, new devices, new innovations in the cloud side, new mobile technologies, new communication protocols, new data protocols, and many other improvements. So, with new devices and new data formats, the problem of data interoperability occurs between devices and cloud platforms, since it is required that data from the devices be interpreted by the platform. This dissertation proposed a way to solve it by creating a component on the cloud side that does the data conversion to a data format that is supported by the cloud platform. For this component to be integrated with a microservices architecture, it was also built a library that use gRPC technology as the technology of communication. The components developed with this library, therefore, receive requests from the other services of the platform via gRPC. With this library, it is possible to develop components that, expeditiously, receive requests from clients, perform the data translation, and then return the data in a new data format.
id RCAP_60315fde14d3cc6157b491ae3e5842f2
oai_identifier_str oai:repositorio.utad.pt:10348/12888
network_acronym_str RCAP
network_name_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository_id_str https://opendoar.ac.uk/repository/7160
spelling Dynamic Data Translation Method for Data Sharing PlatformData TranslationData ConversionIoTInteroperabilityAPIgRPCIn recent years, there has been a growing IoT field and it is expected to keep growing in the years to come. Currently, this field is estimated to be worth about 240 billion dollars with an expectancy of reaching 520 billion by 2027. In terms of devices, it is estimated that about 13 billion devices are connected with a prospect of reaching 23 billion devices by 2027. The industry value and the number of devices connected show that this is a hot field, and with that, it brings a lot of new players into this field with new data formats, new devices, new innovations in the cloud side, new mobile technologies, new communication protocols, new data protocols, and many other improvements. So, with new devices and new data formats, the problem of data interoperability occurs between devices and cloud platforms, since it is required that data from the devices be interpreted by the platform. This dissertation proposed a way to solve it by creating a component on the cloud side that does the data conversion to a data format that is supported by the cloud platform. For this component to be integrated with a microservices architecture, it was also built a library that use gRPC technology as the technology of communication. The components developed with this library, therefore, receive requests from the other services of the platform via gRPC. With this library, it is possible to develop components that, expeditiously, receive requests from clients, perform the data translation, and then return the data in a new data format.Nos últimos tempos houve um crescimento na área de IoT e prespetivase que continue a crescer nos próximos anos. Atualmente estima-se que esta área tenha um valor de cerca 240 mil milhões de dólares e com uma espetativa de chegar aos 520 mil milhões de dólares até 2027. Em termos de dispositivos é estimado que existam cerca 13 mil milhões conectados e com a perspetiva de atingir 23 mil milhões até 2027. O valor desta indústria e o número de dispositivos conectados mostra que esta área está em voga e com isto traz novas entidades que contribuem com novos formatos de dados, novos dispositivos, inovações na parte da cloud, novas tecnologias móveis, novos protocolos de comunicação, novos protocolos de dados, entre muitas outras contribuições. Com novos dispositivos e novos formatos de dados é criado um problema interoperabilidade de dados entre os dispositivos e as plataformas de cloud, uma vez que é necessário que os dados provenientes do dispositivo sejam interpretados pelas plataformas. Esta dissertação propõe uma forma de resolver este problema com a criação de um componente integrado na cloud, que realiza a conversão dos dados para um formato que é suportado pela plataforma. Para este componente ser integrado numa arquitetura de microserviços foi construida uma biblioteca, que utiliza gRPC como tecnologia de comunicação. Os componentes desenvolvidos usando esta biblioteca, portanto, recebem pedidos dos restantes serviços da plataforma usando gRPC. Com esta biblioteca podem ser desenvolvidos componentes que, de uma forma expedita, recebem pedidos de um cliente, efetuam a tradução dos dados e de seguida devolvem os dados no novo formato.2024-09-19T14:16:52Z2027-05-08T00:00:00Z2024-05-09T00:00:00Z2024-05-092024-08-04info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfapplication/pdfapplication/pdfhttps://hdl.handle.net/10348/12888engSantos, Filipe Pereira dosinfo:eu-repo/semantics/embargoedAccessreponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiainstacron:RCAAP2025-04-13T02:08:24Zoai:repositorio.utad.pt:10348/12888Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireinfo@rcaap.ptopendoar:https://opendoar.ac.uk/repository/71602025-05-28T18:53:22.038242Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiafalse
dc.title.none.fl_str_mv Dynamic Data Translation Method for Data Sharing Platform
title Dynamic Data Translation Method for Data Sharing Platform
spellingShingle Dynamic Data Translation Method for Data Sharing Platform
Santos, Filipe Pereira dos
Data Translation
Data Conversion
IoT
Interoperability
API
gRPC
title_short Dynamic Data Translation Method for Data Sharing Platform
title_full Dynamic Data Translation Method for Data Sharing Platform
title_fullStr Dynamic Data Translation Method for Data Sharing Platform
title_full_unstemmed Dynamic Data Translation Method for Data Sharing Platform
title_sort Dynamic Data Translation Method for Data Sharing Platform
author Santos, Filipe Pereira dos
author_facet Santos, Filipe Pereira dos
author_role author
dc.contributor.author.fl_str_mv Santos, Filipe Pereira dos
dc.subject.por.fl_str_mv Data Translation
Data Conversion
IoT
Interoperability
API
gRPC
topic Data Translation
Data Conversion
IoT
Interoperability
API
gRPC
description In recent years, there has been a growing IoT field and it is expected to keep growing in the years to come. Currently, this field is estimated to be worth about 240 billion dollars with an expectancy of reaching 520 billion by 2027. In terms of devices, it is estimated that about 13 billion devices are connected with a prospect of reaching 23 billion devices by 2027. The industry value and the number of devices connected show that this is a hot field, and with that, it brings a lot of new players into this field with new data formats, new devices, new innovations in the cloud side, new mobile technologies, new communication protocols, new data protocols, and many other improvements. So, with new devices and new data formats, the problem of data interoperability occurs between devices and cloud platforms, since it is required that data from the devices be interpreted by the platform. This dissertation proposed a way to solve it by creating a component on the cloud side that does the data conversion to a data format that is supported by the cloud platform. For this component to be integrated with a microservices architecture, it was also built a library that use gRPC technology as the technology of communication. The components developed with this library, therefore, receive requests from the other services of the platform via gRPC. With this library, it is possible to develop components that, expeditiously, receive requests from clients, perform the data translation, and then return the data in a new data format.
publishDate 2024
dc.date.none.fl_str_mv 2024-09-19T14:16:52Z
2024-05-09T00:00:00Z
2024-05-09
2024-08-04
2027-05-08T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://hdl.handle.net/10348/12888
url https://hdl.handle.net/10348/12888
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/embargoedAccess
eu_rights_str_mv embargoedAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
application/pdf
dc.source.none.fl_str_mv reponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron:RCAAP
instname_str FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron_str RCAAP
institution RCAAP
reponame_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
collection Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository.name.fl_str_mv Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
repository.mail.fl_str_mv info@rcaap.pt
_version_ 1833597735023935488