Restructuring an ETL Process and Data-Base Model for Online Analysis

Bibliographic Details
Main Author: Silva, Francisco Alagôa Pedro Batista da
Publication Date: 2022
Format: Master thesis
Language: eng
Source: Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
Download full: http://hdl.handle.net/10362/155507
Summary: In an ever-growing technological world, there is a lot of value in being able to quickly analyze data and make decisions in order to maintain a successful business. Imaginary Cloud is a growing Software Development and UX/UI company, and with such growth, there is an increased amount of data to be stored and processed. Therefore, it is of great importance that each department can easily access their respective data, to increase the speed of their decision-making process. In order to better analyze its performance, the company intends on developing a dash-board system for internal use that allows the visualization of relevant data dynamically, in-cluding key performance indicators. The purpose of this project will be to work alongside Imaginary Cloud to develop a tool that extracts information from multiple sources as efficiently as possible and create a central-ized database to hold the extracted data, expected to be ever expanding. The database must be optimized for the retrieval of data in real data, so that it can be queried by the dashboard system (not to be developed in this project) at the user’s request. In the end, the existence of this tool should have a major impact on how easy each de-partment can access and interpret data, allowing for more informed and faster decision mak-ing, and increasing the overall company’s efficiency.
id RCAP_8fa7fa230b67aaf62f1351d87014dbdc
oai_identifier_str oai:run.unl.pt:10362/155507
network_acronym_str RCAP
network_name_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository_id_str https://opendoar.ac.uk/repository/7160
spelling Restructuring an ETL Process and Data-Base Model for Online AnalysisData WarehouseDimensional ModelingOnline QueryingETLDomínio/Área Científica::Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e InformáticaIn an ever-growing technological world, there is a lot of value in being able to quickly analyze data and make decisions in order to maintain a successful business. Imaginary Cloud is a growing Software Development and UX/UI company, and with such growth, there is an increased amount of data to be stored and processed. Therefore, it is of great importance that each department can easily access their respective data, to increase the speed of their decision-making process. In order to better analyze its performance, the company intends on developing a dash-board system for internal use that allows the visualization of relevant data dynamically, in-cluding key performance indicators. The purpose of this project will be to work alongside Imaginary Cloud to develop a tool that extracts information from multiple sources as efficiently as possible and create a central-ized database to hold the extracted data, expected to be ever expanding. The database must be optimized for the retrieval of data in real data, so that it can be queried by the dashboard system (not to be developed in this project) at the user’s request. In the end, the existence of this tool should have a major impact on how easy each de-partment can access and interpret data, allowing for more informed and faster decision mak-ing, and increasing the overall company’s efficiency.Num mundo em constante desenvolvimento tecnológico, é muito importante ser capaz de analisar e tomar decisões rapidamente para que se consiga manter um negócio bem-sucedido. A Imaginary Cloud é uma empresa de desenvolvimento de Software e Design de UX/UI em crescimento, e com o seu aumento de escala, aumenta também a quantidade de dados a serem armazenados e processados. Como tal, é de alta importância que cada departamento consiga facilmente aceder aos seus respetivos dados, para que se aumente a velocidade do processo de tomada de decisões. Para melhorar a análise do seu desempenho, a empresa pretende desenvolver um sis-tema de dashboards para uso interno que permita visualizar dados relevantes de forma dinâ-mica, incluindo indicadores chave de desempenho. O objetivo deste projeto é colaborar com a Imaginary Cloud para desenvolver uma fer-ramenta que extraia informação de múltiplas fontes e criar uma base de dados centralizada que conterá os dados extraídos, que se espera que aumentem continuamente. A base de dados deve estar otimizada para a requisição de dados em tempo real, para que possa ser consultada pelo sistema de dashboards (que não será desenvolvido neste projeto) a pedido do utilizador. No final, a existência desta ferramenta deve ter um grande impacto na facilidade com que cada departamento consegue aceder e interpretar os seus dados, permitindo uma tomada de decisões mais rápida e informada, melhorando a eficiência geral da empresa.Santos, AndréDuarte, VítorRUNSilva, Francisco Alagôa Pedro Batista da2023-07-19T09:59:50Z2022-122022-12-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10362/155507enginfo:eu-repo/semantics/openAccessreponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiainstacron:RCAAP2024-05-22T18:13:08Zoai:run.unl.pt:10362/155507Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireinfo@rcaap.ptopendoar:https://opendoar.ac.uk/repository/71602025-05-28T17:43:41.948895Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiafalse
dc.title.none.fl_str_mv Restructuring an ETL Process and Data-Base Model for Online Analysis
title Restructuring an ETL Process and Data-Base Model for Online Analysis
spellingShingle Restructuring an ETL Process and Data-Base Model for Online Analysis
Silva, Francisco Alagôa Pedro Batista da
Data Warehouse
Dimensional Modeling
Online Querying
ETL
Domínio/Área Científica::Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática
title_short Restructuring an ETL Process and Data-Base Model for Online Analysis
title_full Restructuring an ETL Process and Data-Base Model for Online Analysis
title_fullStr Restructuring an ETL Process and Data-Base Model for Online Analysis
title_full_unstemmed Restructuring an ETL Process and Data-Base Model for Online Analysis
title_sort Restructuring an ETL Process and Data-Base Model for Online Analysis
author Silva, Francisco Alagôa Pedro Batista da
author_facet Silva, Francisco Alagôa Pedro Batista da
author_role author
dc.contributor.none.fl_str_mv Santos, André
Duarte, Vítor
RUN
dc.contributor.author.fl_str_mv Silva, Francisco Alagôa Pedro Batista da
dc.subject.por.fl_str_mv Data Warehouse
Dimensional Modeling
Online Querying
ETL
Domínio/Área Científica::Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática
topic Data Warehouse
Dimensional Modeling
Online Querying
ETL
Domínio/Área Científica::Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática
description In an ever-growing technological world, there is a lot of value in being able to quickly analyze data and make decisions in order to maintain a successful business. Imaginary Cloud is a growing Software Development and UX/UI company, and with such growth, there is an increased amount of data to be stored and processed. Therefore, it is of great importance that each department can easily access their respective data, to increase the speed of their decision-making process. In order to better analyze its performance, the company intends on developing a dash-board system for internal use that allows the visualization of relevant data dynamically, in-cluding key performance indicators. The purpose of this project will be to work alongside Imaginary Cloud to develop a tool that extracts information from multiple sources as efficiently as possible and create a central-ized database to hold the extracted data, expected to be ever expanding. The database must be optimized for the retrieval of data in real data, so that it can be queried by the dashboard system (not to be developed in this project) at the user’s request. In the end, the existence of this tool should have a major impact on how easy each de-partment can access and interpret data, allowing for more informed and faster decision mak-ing, and increasing the overall company’s efficiency.
publishDate 2022
dc.date.none.fl_str_mv 2022-12
2022-12-01T00:00:00Z
2023-07-19T09:59:50Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10362/155507
url http://hdl.handle.net/10362/155507
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron:RCAAP
instname_str FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron_str RCAAP
institution RCAAP
reponame_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
collection Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository.name.fl_str_mv Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
repository.mail.fl_str_mv info@rcaap.pt
_version_ 1833596920062279680