November | 2016
Data Warehouse (DW) is a business intelligence system which analyzes historical data gathered from different sources and provides insightful information to organizations from those data quickly. Conventional DW are commonly hosted in a relational database which is designed for reporting and data analysis. The use cases that are supported by DW can be applicable and utilized across industries. For example:
However, Conventional DW comes with identified set of challenges. It needs upfront investment into costly software licenses and large infrastructure. And this is where cloud providers come in. Cloud providers are game changers as they help transform Capex to an Opex model in turn enabling affordability and accessibility to large DW systems, increased speed of development as well as drastically reducing the burden of owning and managing infrastructure.
For instance, Amazon Web Service (AWS) provides Redshift platform as a service (PaaS) that can host up to two petabyte of compressed data with a reasonable pricing model. Google Cloud Platform (GCP) gives BigQuery as a server less, fully managed, petabyte scale DW platform. Both of these platforms are based on similar principles of hosting compress data in columnar data storage. This enables the tools to read large volume of data in very less amount of time.
Comparative analysis between Redshift and BigQuery:
So the key takeaways…
Satyajit Das is Principal Consultant in the Cloud COE of Service Transformation at Wipro with sixteen years of experience. Satyajit has defined and applied Enterprise architecture framework to migrate applications to AWS cloud for high availability, scalability and fault tolerance of the system applying Micro-Architecture solution paradigm. He has also been involved with CoE and Governance setup, defining best practices, policies and guidelines for Service implementations and also have lead large teams for solution delivery and execution. He was instrumental in defining Solution Architecture, Design and delivery of critical applications with stringent NFR requirements. He has experience across industry domains like manufacturing, finance, consulting, and government.
© 2021 Wipro Limited |
|
© 2021 Wipro Limited |
Pharmaceutical & Life Sciences