by Vivek Agarwal | Sep 26, 2023 | AWS, Blog, Cloud, Data Management
Navigating the world of data engineering tools can often be a complex undertaking. Deciding when to use one solution over another, such as Amazon EMR versus AWS Glue, often hinges on careful consideration and understanding of these services’ specific features...
by XTIVIA | Sep 19, 2023 | AWS, Blog, Cloud
In the ever-evolving world of cloud computing and big data handling, understanding all your tool options and their pros and cons is essential. Today, let’s uncover one such integral tool – AWS Glue – by addressing what it is, how it benefits data...
by Phani Krishna Pochiraju | Feb 24, 2022 | Blog, Testing
Extract-Transform-Load (ETL) is a process of loading data from the source system to the target (data warehouse) based on the transformation rules. Data is extracted from an OLTP database (sometimes text files, legacy systems, and spreadsheets), transformed, and loaded...
by Phani Krishna Pochiraju | Jun 27, 2019 | Blog, Testing
Extract, Transform, Load (ETL) is the process of gathering data (Extract) from an unlimited number of sources, converting it (Transform) into a format that can be analyzed, and centralizing it into a single repository (Load). ETL is an alternative, but related...
by XTIVIA | Jan 10, 2018 | Blog, Business Intelligence
What is Business Intelligence? The purpose of Business Intelligence is the transformation of raw data into meaningful information which can be used to make better business decisions. Business Intelligence grew out of Decision Support systems and is all about...
by XTIVIA | Mar 7, 2017 | Blog, Business Intelligence, Data Warehousing
It’s been estimated that up to 60% of the effort in building a data warehouse can be spent in developing the ETL processes that are needed to copy data from source systems and transform it before loading it in to the data warehouse. Many of the ETL processes,...
by XTIVIA | Feb 13, 2013 | Blog, Business Intelligence
Two bits of Information I picked up from our principal Informatica Architect. When I used these, it did really work wonders. Aggregators and joiners should have sorted input. The Sorter Transformation sorts rows more efficiently that the Aggregator...
by XTIVIA | Feb 13, 2013 | Blog, Business Intelligence, Data Warehousing
Lately, we at XTIVIA have seen a marked uptick for interest in open source ETL tools. Each customer situation is unique, but I would like to propose a few factors that you should review before making the decision: Incumbent Tool Set: Decisions around your choice...
by XTIVIA | Jan 31, 2012 | Blog, Databases
I’ve done a fair bit of work implementing custom ETL solutions with SSIS concluding that the tool provides excellent “out-of-the-box” support for ETL as well as almost limitlessly extensibility with the Script component. If you have a need to bring data from...
