Extract, Transform, and Load data from Legacy Systems to Azure Cloud
Main Author: | |
---|---|
Publication Date: | 2021 |
Format: | Master thesis |
Language: | eng |
Source: | Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
Download full: | http://hdl.handle.net/10362/118629 |
Summary: | Internship report presented as partial requirement for obtaining the Master’s degree in Information Management, with a specialization in Knowledge Management and Business Intelligence |
id |
RCAP_bff7451980d821e28f1db2b5373f79a8 |
---|---|
oai_identifier_str |
oai:run.unl.pt:10362/118629 |
network_acronym_str |
RCAP |
network_name_str |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
repository_id_str |
https://opendoar.ac.uk/repository/7160 |
spelling |
Extract, Transform, and Load data from Legacy Systems to Azure CloudModern data platformData lakeDelta lakeData integrationData transformationData loadingInternship report presented as partial requirement for obtaining the Master’s degree in Information Management, with a specialization in Knowledge Management and Business IntelligenceIn a world with continuously evolving technologies and hardened competitive markets, organisations need to continually be on guard to grasp cutting edge technology and tools that will help them to surpass any competition that arises. Modern data platforms that incorporate cloud technologies, support organisations to strive and get ahead of their competitors by providing solutions that help them capture and optimally use untapped data, and scalable storages to adapt to ever-growing data quantities. Also, adopt data processing and visualisation tools that help to improve the decision-making process. With many cloud providers available in the market, from small players to major technology corporations, this offers much flexibility to organisations to choose the best cloud technology that will align with their use cases and overall products and services strategy. This internship came up at the time when one of Accenture’s significant client in the financial industry decided to migrate from legacy systems to a cloud-based data infrastructure that is Microsoft Azure cloud. During this internship, development of the data lake, which is a core part of the MDP, was done to understand better the type of challenges that can be faced when migrating data from on-premise legacy systems to a cloud-based infrastructure. Also, provided in this work, are the main recommendations and guidelines when it comes to performing a large scale data migration.Pinheiro, Flávio Luís PortasRUNJephte, Ioudom Foubi2021-06-01T10:02:12Z2021-05-202021-05-20T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10362/118629TID:202731391enginfo:eu-repo/semantics/openAccessreponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiainstacron:RCAAP2024-05-22T17:53:36Zoai:run.unl.pt:10362/118629Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireinfo@rcaap.ptopendoar:https://opendoar.ac.uk/repository/71602025-05-28T17:24:48.817649Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiafalse |
dc.title.none.fl_str_mv |
Extract, Transform, and Load data from Legacy Systems to Azure Cloud |
title |
Extract, Transform, and Load data from Legacy Systems to Azure Cloud |
spellingShingle |
Extract, Transform, and Load data from Legacy Systems to Azure Cloud Jephte, Ioudom Foubi Modern data platform Data lake Delta lake Data integration Data transformation Data loading |
title_short |
Extract, Transform, and Load data from Legacy Systems to Azure Cloud |
title_full |
Extract, Transform, and Load data from Legacy Systems to Azure Cloud |
title_fullStr |
Extract, Transform, and Load data from Legacy Systems to Azure Cloud |
title_full_unstemmed |
Extract, Transform, and Load data from Legacy Systems to Azure Cloud |
title_sort |
Extract, Transform, and Load data from Legacy Systems to Azure Cloud |
author |
Jephte, Ioudom Foubi |
author_facet |
Jephte, Ioudom Foubi |
author_role |
author |
dc.contributor.none.fl_str_mv |
Pinheiro, Flávio Luís Portas RUN |
dc.contributor.author.fl_str_mv |
Jephte, Ioudom Foubi |
dc.subject.por.fl_str_mv |
Modern data platform Data lake Delta lake Data integration Data transformation Data loading |
topic |
Modern data platform Data lake Delta lake Data integration Data transformation Data loading |
description |
Internship report presented as partial requirement for obtaining the Master’s degree in Information Management, with a specialization in Knowledge Management and Business Intelligence |
publishDate |
2021 |
dc.date.none.fl_str_mv |
2021-06-01T10:02:12Z 2021-05-20 2021-05-20T00:00:00Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/masterThesis |
format |
masterThesis |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://hdl.handle.net/10362/118629 TID:202731391 |
url |
http://hdl.handle.net/10362/118629 |
identifier_str_mv |
TID:202731391 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.source.none.fl_str_mv |
reponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia instacron:RCAAP |
instname_str |
FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
collection |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
repository.name.fl_str_mv |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia |
repository.mail.fl_str_mv |
info@rcaap.pt |
_version_ |
1833596675277455360 |