Dynamic Data Translation Method for Data Sharing Platform
| Main Author: | |
|---|---|
| Publication Date: | 2024 |
| Format: | Master thesis |
| Language: | eng |
| Source: | Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| Download full: | https://hdl.handle.net/10348/12888 |
Summary: | In recent years, there has been a growing IoT field and it is expected to keep growing in the years to come. Currently, this field is estimated to be worth about 240 billion dollars with an expectancy of reaching 520 billion by 2027. In terms of devices, it is estimated that about 13 billion devices are connected with a prospect of reaching 23 billion devices by 2027. The industry value and the number of devices connected show that this is a hot field, and with that, it brings a lot of new players into this field with new data formats, new devices, new innovations in the cloud side, new mobile technologies, new communication protocols, new data protocols, and many other improvements. So, with new devices and new data formats, the problem of data interoperability occurs between devices and cloud platforms, since it is required that data from the devices be interpreted by the platform. This dissertation proposed a way to solve it by creating a component on the cloud side that does the data conversion to a data format that is supported by the cloud platform. For this component to be integrated with a microservices architecture, it was also built a library that use gRPC technology as the technology of communication. The components developed with this library, therefore, receive requests from the other services of the platform via gRPC. With this library, it is possible to develop components that, expeditiously, receive requests from clients, perform the data translation, and then return the data in a new data format. |
| id |
RCAP_60315fde14d3cc6157b491ae3e5842f2 |
|---|---|
| oai_identifier_str |
oai:repositorio.utad.pt:10348/12888 |
| network_acronym_str |
RCAP |
| network_name_str |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| repository_id_str |
https://opendoar.ac.uk/repository/7160 |
| spelling |
Dynamic Data Translation Method for Data Sharing PlatformData TranslationData ConversionIoTInteroperabilityAPIgRPCIn recent years, there has been a growing IoT field and it is expected to keep growing in the years to come. Currently, this field is estimated to be worth about 240 billion dollars with an expectancy of reaching 520 billion by 2027. In terms of devices, it is estimated that about 13 billion devices are connected with a prospect of reaching 23 billion devices by 2027. The industry value and the number of devices connected show that this is a hot field, and with that, it brings a lot of new players into this field with new data formats, new devices, new innovations in the cloud side, new mobile technologies, new communication protocols, new data protocols, and many other improvements. So, with new devices and new data formats, the problem of data interoperability occurs between devices and cloud platforms, since it is required that data from the devices be interpreted by the platform. This dissertation proposed a way to solve it by creating a component on the cloud side that does the data conversion to a data format that is supported by the cloud platform. For this component to be integrated with a microservices architecture, it was also built a library that use gRPC technology as the technology of communication. The components developed with this library, therefore, receive requests from the other services of the platform via gRPC. With this library, it is possible to develop components that, expeditiously, receive requests from clients, perform the data translation, and then return the data in a new data format.Nos últimos tempos houve um crescimento na área de IoT e prespetivase que continue a crescer nos próximos anos. Atualmente estima-se que esta área tenha um valor de cerca 240 mil milhões de dólares e com uma espetativa de chegar aos 520 mil milhões de dólares até 2027. Em termos de dispositivos é estimado que existam cerca 13 mil milhões conectados e com a perspetiva de atingir 23 mil milhões até 2027. O valor desta indústria e o número de dispositivos conectados mostra que esta área está em voga e com isto traz novas entidades que contribuem com novos formatos de dados, novos dispositivos, inovações na parte da cloud, novas tecnologias móveis, novos protocolos de comunicação, novos protocolos de dados, entre muitas outras contribuições. Com novos dispositivos e novos formatos de dados é criado um problema interoperabilidade de dados entre os dispositivos e as plataformas de cloud, uma vez que é necessário que os dados provenientes do dispositivo sejam interpretados pelas plataformas. Esta dissertação propõe uma forma de resolver este problema com a criação de um componente integrado na cloud, que realiza a conversão dos dados para um formato que é suportado pela plataforma. Para este componente ser integrado numa arquitetura de microserviços foi construida uma biblioteca, que utiliza gRPC como tecnologia de comunicação. Os componentes desenvolvidos usando esta biblioteca, portanto, recebem pedidos dos restantes serviços da plataforma usando gRPC. Com esta biblioteca podem ser desenvolvidos componentes que, de uma forma expedita, recebem pedidos de um cliente, efetuam a tradução dos dados e de seguida devolvem os dados no novo formato.2024-09-19T14:16:52Z2027-05-08T00:00:00Z2024-05-09T00:00:00Z2024-05-092024-08-04info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfapplication/pdfapplication/pdfhttps://hdl.handle.net/10348/12888engSantos, Filipe Pereira dosinfo:eu-repo/semantics/embargoedAccessreponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiainstacron:RCAAP2025-04-13T02:08:24Zoai:repositorio.utad.pt:10348/12888Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireinfo@rcaap.ptopendoar:https://opendoar.ac.uk/repository/71602025-05-28T18:53:22.038242Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiafalse |
| dc.title.none.fl_str_mv |
Dynamic Data Translation Method for Data Sharing Platform |
| title |
Dynamic Data Translation Method for Data Sharing Platform |
| spellingShingle |
Dynamic Data Translation Method for Data Sharing Platform Santos, Filipe Pereira dos Data Translation Data Conversion IoT Interoperability API gRPC |
| title_short |
Dynamic Data Translation Method for Data Sharing Platform |
| title_full |
Dynamic Data Translation Method for Data Sharing Platform |
| title_fullStr |
Dynamic Data Translation Method for Data Sharing Platform |
| title_full_unstemmed |
Dynamic Data Translation Method for Data Sharing Platform |
| title_sort |
Dynamic Data Translation Method for Data Sharing Platform |
| author |
Santos, Filipe Pereira dos |
| author_facet |
Santos, Filipe Pereira dos |
| author_role |
author |
| dc.contributor.author.fl_str_mv |
Santos, Filipe Pereira dos |
| dc.subject.por.fl_str_mv |
Data Translation Data Conversion IoT Interoperability API gRPC |
| topic |
Data Translation Data Conversion IoT Interoperability API gRPC |
| description |
In recent years, there has been a growing IoT field and it is expected to keep growing in the years to come. Currently, this field is estimated to be worth about 240 billion dollars with an expectancy of reaching 520 billion by 2027. In terms of devices, it is estimated that about 13 billion devices are connected with a prospect of reaching 23 billion devices by 2027. The industry value and the number of devices connected show that this is a hot field, and with that, it brings a lot of new players into this field with new data formats, new devices, new innovations in the cloud side, new mobile technologies, new communication protocols, new data protocols, and many other improvements. So, with new devices and new data formats, the problem of data interoperability occurs between devices and cloud platforms, since it is required that data from the devices be interpreted by the platform. This dissertation proposed a way to solve it by creating a component on the cloud side that does the data conversion to a data format that is supported by the cloud platform. For this component to be integrated with a microservices architecture, it was also built a library that use gRPC technology as the technology of communication. The components developed with this library, therefore, receive requests from the other services of the platform via gRPC. With this library, it is possible to develop components that, expeditiously, receive requests from clients, perform the data translation, and then return the data in a new data format. |
| publishDate |
2024 |
| dc.date.none.fl_str_mv |
2024-09-19T14:16:52Z 2024-05-09T00:00:00Z 2024-05-09 2024-08-04 2027-05-08T00:00:00Z |
| dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
| dc.type.driver.fl_str_mv |
info:eu-repo/semantics/masterThesis |
| format |
masterThesis |
| status_str |
publishedVersion |
| dc.identifier.uri.fl_str_mv |
https://hdl.handle.net/10348/12888 |
| url |
https://hdl.handle.net/10348/12888 |
| dc.language.iso.fl_str_mv |
eng |
| language |
eng |
| dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/embargoedAccess |
| eu_rights_str_mv |
embargoedAccess |
| dc.format.none.fl_str_mv |
application/pdf application/pdf application/pdf |
| dc.source.none.fl_str_mv |
reponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia instacron:RCAAP |
| instname_str |
FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia |
| instacron_str |
RCAAP |
| institution |
RCAAP |
| reponame_str |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| collection |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| repository.name.fl_str_mv |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia |
| repository.mail.fl_str_mv |
info@rcaap.pt |
| _version_ |
1833597735023935488 |