AZURE DATA ENGINEERING DESIGN & IMPLEMENTATION ROADMAP
Founded in 2009 and headquartered in Charlotte, North Carolina, our client is a full-service private equity real estate firm primarily focusing on the multifamily and self-storage sectors. They develop and invest in properties across the United States. They develop, acquire, and manage self-storage properties with the help of investment professionals with more than 75 years of combined experience and a team of 100 employees.
Our client has a manual reporting system built with Excel, which gathers data sent by third-party hosting companies. They don’t have a technical team to design, implement, and manage an automated data pipeline. The current data gathering, integration, and reporting processes are error-prone, poorly documented, and dependent on individuals. Our client requested a design and roadmap for a data pipeline and reporting data store to cater to multiple reporting needs.
XTIVIA reviewed and understood the current reports, attributes, how the data is integrated, and the current issues. We also gathered the future-state reporting requirements to create a generic data model. Finally, we provided a data pipeline design that includes an incremental data ingestion from three data sources using Azure Data Factory, land the data in Azure Blob Storage, and take the data through sanity checks, cleanup, standardization, integration, and storage.
We considered Azure SQL as the initial target data warehouse platform based on the client’s request. We educated the client regarding Azure SQL and Synapse differences, illuminating the pros and cons. XTIVIA provided an implementation roadmap that includes schedule, resource requirement, and cost.
With XTIVIA’s assistance, the client now has improved awareness of the Azure platform and its services, such as Blob Storage, ADF, Azure SQL, and Synapse. The roadmap provided the basis for cost-benefit analysis, implementation planning, budgeting, staffing, and risk management.
Let's Talk Today!
No obligation, no pressure. We're easy to talk with and you might be surprised at how much you can learn about your project by speaking with our experts.
XTIVIA CORPORATE OFFICE
304 South 8th Street, Suite 201
Colorado Springs, CO 80905 USA
Additional offices in New York, New Jersey,
Missouri, Texas, Virginia, and Hyderabad, India.
USA toll free: 888-685-3101, ext. 2
International: +1 719-685-3100, ext. 2
Fax: +1 719-685-3400