TRENDS IN DATA WAREHOUSING

Size: px

Start display at page:

Download "TRENDS IN DATA WAREHOUSING"

Mervyn Collins
8 years ago
Views:

1 TRENDS IN DATA WAREHOUSING Chapter #3 Imran Khan

2 Agenda Continued Growth in DW DW has become Mainstream Industries using DW Vendor Solution & Products Status of DW market Significant Trends Web Enabled DW

3 CONTINUED GROWTH IN DATA WAREHOUSING Data warehousing is no longer a purely novel idea for study and experimentation. It has become mainstream. True, the data warehouse is not in every dentist s office yet, but neither is it confined only to high-end businesses. More than half of all U.S. companies have made a commitment to data warehousing. About 90% of multinational companies have data warehouses or are planning to implement data warehouses in the next few months.

True, the data warehouse is not in every dentist s office yet, but neither is it confined only to high-end businesses.

4 CONTINUED GROWTH IN DATA WAREHOUSING In every industry across the board, from retail chain stores to financial institutions, from manufacturing enterprises to government departments, from airline companies to pharmaceuticals, data warehousing has revolutionized the way people perform business analysis and make strategic decisions. Every company that has a data warehouse continues to realize enormous benefits that get translated into positive results at the bottom line. Many of these companies, incorporating Web-based technologies, have enhanced the potential for greater and easier delivery of vital information.

5 Data Warehousing has Become Mainstream In the early stages, four significant factors drove many companies to move into data warehousing: Fierce competition Government deregulation Need to revamp internal processes Imperative for customized marketing Telecommunications, banking, and retail were the first industries to adopt data warehousing. That was largely because of government deregulation in telecommunications and banking. Retail businesses moved into data warehousing because of fiercer competition. Utility companies joined the group as that sector was deregulated. The next wave of businesses to get into data warehousing consisted of companies in financial services, healthcare, insurance, manufacturing, pharmaceuticals, transportation, and distribution.

That was largely because of government deregulation in telecommunications and banking. Retail businesses moved into data warehousing because of fiercer competition.

6 Data Warehousing has Become Mainstream Today, telecommunications and financial services continue to lead in data warehouse spending. As much as 15% of technology budgets in these industries is spent on data warehousing. At present, data warehouses exist in every conceivable industry. In 2008, pharmaceuticals was at the top of the list, with the highest average salary.

As much as 15% of technology budgets in these industries is spent on data warehousing.

7 Industries using Data warehouse

8 Vendor Solutions and Products There are hundreds of data warehousing vendors and thousands of data warehousing products and solutions. Each company positioned its own products as the proper set of data warehousing tools. Data warehousing was a new concept for many of the businesses that adopted it. These businesses were at the mercy of the marketing hype of the vendors. Over the past decade, the situation has improved tremendously. The market is reaching maturity, to the extent of producing off-the-shelf packages and becoming increasingly stable.

Data warehousing was a new concept for many of the businesses that adopted it.

9 Status of the data warehousing market Separate the market broadly into two distinct

10 SIGNIFICANT TRENDS In the next few years, data warehousing is expected make big strides in software, especially for optimizing queries indexing very large tables enhancing SQL improving data compression expanding dimensional modeling.

optimizing queries indexing very large tables enhancing

11 SIGNIFICANT TRENDS Real-Time Data Warehousing Multiple Data Types Adding Unstructured Data Searching Unstructured Data Spatial Data Data Visualization Major Visualization Trends Visualization Types Advanced Visualization Techniques Chart Manipulation. Drill Down. Advanced Interaction.

Visualization Major Visualization Trends Visualization Types Advanced

12 SIGNIFICANT TRENDS Dashboards and Scorecards Parallel Processing Parallel Processing Hardware Options Parallel Processing Software Implementation Data Warehouse Appliances Query Tools Flexible presentation Aggregate awareness Crossing subject areas Multiple heterogeneous sources Integration Overcoming SQL limitations Browser Tools

Warehouse Appliances Query Tools Flexible presentation Aggregate awareness

13 SIGNIFICANT TRENDS Data Fusion Data Integration Data Integration Application Integration Business Process Integration User Interaction Integration Analytics Multidimensional Analysis Predictive Analytics Agent Technology Syndicated Data Data Warehousing and ERP

Interaction Integration Analytics Multidimensional Analysis

14 SIGNIFICANT TRENDS Data in ERP Packages Integration Options

15 SIGNIFICANT TRENDS Data Warehousing and KM Data Warehousing and CRM Agile Development Active Data Warehousing

16 WEB-ENABLED DATA WAREHOUSE The Warehouse to the Web Bringing the Web to the warehouse essentially involves capturing the clickstream of all the visitors to your company s Web site and performing all the traditional data warehousing functions. And you must accomplish this, near real-time, in an environment that has now come to be known as the datawebhouse.

site and performing all the traditional data warehousing functions.

17 WEB-ENABLED DATA WAREHOUSE Clickstream data enables analysis of several key measures, including: Customer demand Effectiveness of marketing promotions Effectiveness of affiliate relationship among products Demographic data collection Customer buying patterns Feedback on Web site design

promotions Effectiveness of affiliate relationship among products

18 WEB-ENABLED DATA WAREHOUSE The Webhouse can produce the following useful information: Site statistics Visitor conversions Ad metrics Referring partner links Site navigation resulting in orders Site navigation not resulting in orders Pages that are session killers

metrics Referring partner links Site navigation resulting in

19 WEB-ENABLED DATA WAREHOUSE The Web-Enabled Configuration

Big Data and Your Data Warehouse Philip Russom

Big Data and Your Data Warehouse Philip Russom TDWI Research Director for Data Management April 5, 2012 Sponsor Speakers Philip Russom Research Director, Data Management, TDWI Peter Jeffcock Director,