Data Warehousing and Data Mining Executive Overview Term Paper

Download this Term Paper in word format (.doc)

Note: Sample below may appear distorted but all corresponding word document files contain proper formatting

Excerpt from Term Paper:

Data Warehousing and Data Mining

Executive Overview

Analytics, Business Intelligence (BI) and the exponential increase of insight and decision making accuracy and quality in many enterprises today can be directly attributed to the successful implementation of Enterprise Data Warehouse (EDW) and data mining systems. The examples of how Continental Airlines (Watson, Wixom, Hoffer, 2006) and Toyota (Dyer, Nobeoka, 2000) continue to use advanced EDW and data mining systems and processes to streamline their business models are a case in point. The greater the level of economic uncertainty, perceived and actual risk in any given strategy or endeavor, the more the reliance on EDW, data mining and advanced forms of predictive modeling including analytics (Sen, Ramamurthy, Sinha, 2012). From this standpoint, the emerging areas of high growth in the global economy are attracting a high level of investment in EDW, data mining, predictive modeling and analytics. The latest figures illustrate how valued EDW and data mining are in enterprise today. According to industry research and advisory firm Gartner, the EDW and data mining market began 2011 with a global value of $23.2 billion with a projection of market growth of 7% per year through 2015, making it one of the largest and perennially growing enterprise software market (Sen, Ramamurthy, Sinha, 2012). Gartner has defined the EDW and data mining architecture as being comprised of the architectural design, repository and execution platform. These three core components are how this research and advisory firm analyze the market from a software component standpoint, looking at the relative adoption of each EDW and data mining component (Sen, Ramamurthy, Sinha, 2012). The intent of this analysis is to evaluate the benefits and current trends in EDW and data mining, evaluating Continentals' and Toyota's best practices and results achieved. Additional objectives include an assessment of EDW and data mining optimization techniques, recommendations for storage solutions and an analysis of a potential EDW process workflow predicated on a Customer Relationship Management (CRM) system.

Benefits and Current Trends in Data Warehousing and Data Mining

The greatest benefit that is being accrued from EDW and data mining is the ability to gain greater insights into the customer, distribution channel, supplier and stakeholder processes, systems and metrics over time. A highly effective EDW and data mining strategy will bring together a myriad of systems that had been disconnected, even siloed, throughout an enterprise. The Master Data Management (MDM) applications that are part of an EDW architecture or platform deliver what many enterprise lack previous to this point, which is a single system of record for all transactions and enterprise-wide activity (Fay, Zahay, 2003). Having a single system of record leads to more synchronized, unified strategies across an entire enterprise and often leads to corporate cultures becoming more galvanized around specific goals, objectives, while also measuring their relative performance with much greater accuracy and insight (Watson, Wixom, Hoffer, 2006). Based on the solid foundations of an MDM architecture and the ability to mine data across the enterprise, enterprises often accelerate their use of many different forms of analytics, from predictive modeling to data visualization including modeling customer interactions to see how pricing and product promotions will impact sales and profitability (Fay, Zahay, 2003). This leads to one of the most critically important advantages of using EDW and data mining applications, which is the ability to predict overall corporate performance based on the impact of demand-driven, customer-driven and supply chain-based factors and determinants of performance (Watson, Wixom, Hoffer, 2006).

Relying on this integration of customer, distributor and supplier EDW and data mining applications once integrated to financial systems have been delivering insights that continue to revolutionize the financial management of firms (ABA Journal, 1999). The trend begun over fifteen years of integrating customer, distribution and supply chain data into a single system of record to drive greater insights into an enterprise and therefore attain a greater clarity of decision making is a pervasive best practice across many enterprises today (Brachman, Khabaza, Kloesgen, Piatetsky-Shapiro, Simoudis, 1996). The trend has accelerated in the last three years to include Big Data and the use of Hadoop and MapReduce to better analyze and interpret large-scale data sets that are outside the range of calculating and analysis levels of existing mainstream EDW systems and platforms (Sen, Ramamurthy, Sinha, 2012). The advent of Big Data is already beginning to reshape how decisions are made in enterprises, even though this specific technology, considered part of the highest-growing areas of EDW and data mining, is nascent and in the first phase of its industry lifecycle (Sen, Ramamurthy, Sinha, 2012). One of the most promising aspects of this trend is the development of more comprehensive and strategic Business Intelligence (BI) platforms as shown in Figure 1, The Impact of EDW and Data Mining Systems on CRM Analytics. The integration of these factors will continue to have an additive effect on the level of insight and intelligence enterprises will be able to use over time.

Figure 1: The Impact of EDW & Data Mining Systems on CRM Analytics

Based on analysis of the following sources: (Brachman, Khabaza, Kloesgen, Piatetsky-Shapiro, Simoudis, 1996) (Fay, Zahay, 2003) (Fong, Wong, 2002) (Marks, Frolick, 2001) (Sutherland, 2003)

Of the many companies that are successfully using EDW and data mining today, two of the more noteworthy ones are Continental Airlines (Watson, Wixom, Hoffer, 2006) and Toyota in their world-famous supply chain management system, the Toyota Production System (TPS)(Dyer, Nobeoka, 2000). Both of these company's best practices are briefly described in this analysis starting with the impressive use of EDW, data mining and predictive modeling completed by Continental. The well-known airline had recently emerged from bankruptcy, and one of the more valuable lessons learned from that experience was how disconnected the entire enterprise was from its customers. In 1988 Continental launched its Go Forward Initiative, which sought to unify the diverse and disparate systems across the company, bringing together the foundation of its MDM and EDW architectures. Spending $30M for the entire series of software, hardware and systems and generating a $500M increase in combined cost savings and revenue growth, Continental hailed this IT strategy as the most successful in the company's history (Watson, Wixom, Hoffer, 2006). Using this system the company was able to, for the first time, integrate their many airline and maintenance operations processes with CRM, accounting, finance and security systems to ensure real-time 360-degree views of the customer and the entire operations process. This ensures that flight staffing, planning and gross margin analysis are all synchronized to a common set of metrics and key performance indicators (Watson, Wixom, Hoffer, 2006). Continental went on to optimize their entire operations using the lessons learned regarding analytics and metrics from their investments in EDW and data mining, trimming entire routes and increasing customer satisfaction and profitability in the process (Watson, Wixom, Hoffer, 2006). Another company who has successfully transitioned from being managed to metrics that lagged the performance of their supply chain, services and had a corresponding impact on their new product launch strategies is Toyota and the TPS system they use for global procurement and supply chain management (Dyer, Nobeoka, 2000). Toyota has taken the approach of quantifying overall supplier performance, rank-ordering it on a series of dashboards and scorecards, and using Six Sigma, evaluate overall performance across all product lines. The intent of this is to ascertain how best to augment and increase the knowledge across the organization to transform it into a competitive asset (Dyer, Nobeoka, 2000). It is a best practice to use an EDW and data mining platform to create a knowledge management system, coupling quantified metrics and those that are more aligned to process-based performance (Sen, Ramamurthy, Sinha, 2012). The TPS system can manage a new product introduction in as little as 26 weeks' time when necessary, by far the quickest in the auto industry (Dyer, Nobeoka, 2000). It can also troubleshoot quality to the production lot literally in seconds. The lapses in product quality that occurred in the last few years on core product liens, Toyota was able to use the analytics of the TPS and troubleshoot down to the factory level, finding plant managers had neglected to use Six Sigma incoming inspection practices to track overall quality (Dyer, Nobeoka, 2000). This example is admittedly unique in that it blends the ability to manage knowledge while also creating a quality management system that is predicated on knowledge creation over pure compliance reporting.

Data Warehousing and Data Mining Optimization Techniques

The emerging nature of EDW and data mining optimization techniques is emerging rapidly due to the increasing use of constraint-based modeling platforms (Sen, Ramamurthy, Sinha, 2012). Constraint-based modeling is predicated on a series of parameter sets that continually optimize the levels of selections made throughout an EDW including the MDM repositories as defined previously in this paper. The use of constraint-based modeling is making it possible for Web-based applications to populate and propagate analytics, predictive models and performance analyses across enterprises regardless of device. An effective optimization would be able to create an…[continue]

Cite This Term Paper:

"Data Warehousing And Data Mining Executive Overview" (2012, June 08) Retrieved December 2, 2016, from

"Data Warehousing And Data Mining Executive Overview" 08 June 2012. Web.2 December. 2016. <>

"Data Warehousing And Data Mining Executive Overview", 08 June 2012, Accessed.2 December. 2016,

Other Documents Pertaining To This Topic

  • Database Data Warehousing Design Data Warehousing Is

    Database Data Warehousing Design Data warehousing is a powerful tool that business organizations use to enhance competitive advantages. Data warehousing supports business decision by collecting, organizing and consolidating data for analysis and reporting using tools such as OLAP (online analytical processing ) and data mining. Typically, the relational database technology is generally being used to design a data warehousing and a relational database is a database having collection of tables, and

  • Data Warehouse a Strategic Weapon of an Organization

    Data Warehousing: A Strategic Weapon of an Organization. Within Chapter One, an introduction to the study will be provided. Initially, the overall aims of the research proposal will be discussed. This will be followed by a presentation of the overall objectives of the study will be delineated. After this, the significance of the research will be discussed, including a justification and rationale for the investigation. The aims of the study are to

  • Enterprise Resource Systems the Company

    Some manufacturers have sought to improve their profitability by becoming more horizontally integrated in their supply chain management operations, but it does not appear feasible for the company to acquire the vendors that supply its component parts so viable alternatives must be identified that can facilitate the supply chain management process vertically. As Choy, Lee and Lo (2003) point out, "Very few manufactures now own all the activities along the

  • Relationships and Distinctions Between the Information Systems

    relationships and distinctions between the information systems concepts of data warehousing and data mining, which combined with online analytical processing (OLAP) form the backbone of decision support capability in the database industry. Decision support applications impose different demands for OLAP database technology than the online transaction processing (OLTP) model that preceded it. Data mining with OLAP differs from OLTP queries in the use of multidimensional data models, different data

  • Business Intelligence Creating Implementing and Using Business

    Business Intelligence Creating, Implementing and Using Business Intelligence in Clinic and Resort Cases In the process of effective decision making for improving opportunities and performance of a business, a vital role is played by Business Intelligence (BI). Business Intelligence Systems understand the environments of organizations and follow a systematic information process. These systems have huge development costs but are widely created, implemented and used in mid-sized organizations, hospitals, resorts and hotels. The

  • Database Marketing Sales Force Automation and Virtual

    Database marketing, sales force automation and virtual reality are three of the newest trends in technology to impact the way company's market to their customers. All three technologies offer specific advantages and disadvantages for their use. The appropriate use of the technology must be based solidly on the type of product, costs incurred, and the nature of relationship with clients. When used in a judicious way, all three technologies can

  • Information Technology IT Acquisition Management

    IT Acquisition Management for a new Video Shop Individual Project Activities Identification of a problem Organization: Component: Showtime Video Store Business Capture Group The problem is that there is no real information technology security measure employed in the video shop. There is very little awareness of the necessary IT security measures amongst the current management heads which is why they need an effective IT security plan and structure to implement to ensure there is no copyright infringement

Read Full Term Paper
Copyright 2016 . All Rights Reserved