Member-only story
Data Warehouse Concepts; Architecture; Data Warehouse vs. Database; OLAP vs. OLTP
Data Warehouse is an information system that contains historical and commutative data from single or multiple sources. It is a centralized storage system that allows storing, analyzing, and interpretation of data in order to facilitate better decision-making. It is a vital component of business intelligence which is developed with the goal of creating a trove of historical data that can be retrieved and analyzed to provide useful insights according to the organization’s operations.
Data Warehouse Architecture
A Data Warehouse architecture consists of different standard vital components. Each Data Warehouse is defined differently but is mostly characterized using these vital components. Below is the snapshot of the Data Warehouse architecture used across multiple groups within the organization.
Operational System — An operational system is a method used in data warehousing to refer to a system that is used to process the day-to-day transactions of an organization.
Flat Files — A Flat file system is a system of files in which transactional data is stored, and every file in the system must have a different name.
Meta Data — A set of data that defines and gives information about other data. Meta Data summarizes necessary information about data, which can make finding and work with particular instances of data more accessible. For example, author, data build, data changed, and file size is examples of very basic document metadata.
Metadata is used to direct a query to the most appropriate data source.
We must clean and process your operational information before putting it into the warehouse.
Staging area — simplifies data cleansing and consolidation for operational methods coming from multiple source systems, especially for enterprise data warehouses where all relevant data of an enterprise is consolidated.
Data Warehouse Staging Area is a temporary location where a record from source systems is copied.
We may want to customize our warehouse’s architecture for multiple groups within our organization. We can do this by adding data marts.
A data…
