Data mining tools for business decision-making and implementation

¶ … Management

The 21st century has brought with it a number of challenges in relation to data management. Translating data into high quality and understandable information is the key to competitive advantage. Determination can be unconstructively influenced when required information can neither be retrieved nor offered comprehensibly. At the same time as various large businesses have made it investments nearing 50% of their yearly principal expenses (Teresko, 1996), and nearly all companies have been plagued with data, there is still an unrelenting "information gap." In addition, there are human expenses. Executives managing database surroundings use a great deal of time with not only internal but also external resources, filtering data to acquire required information. Therefore, these huge demands on not only financial resources but also human resources have left executives with information overload (Ye, 2003).

Key to these 21ST century challenges has been the problem of acquiring dependable and assimilated outlook from various information courses. Previously, companies developed and applied "executive information systems" (EIS) along with "decision support systems" (DSS) to give assimilated presentations from broken and incoherent data that quite often got sorted from operational computer structures. Despite the fact that information given from an EIS or DSS had often been assimilated, significant, and practical, executives started to recognize that excavating huge quantities of data from a data warehouse might outcome in more precise information outlines and enhanced accurateness in market evaluation (Phillips, 1997).

Concentration on knowledge management in companies has enhanced the view of imparting and utilizing data to gain competitive advantage (Zorn et al., 1999). Attention in data mining is enhancing as companies look towards a more comprehensive understanding of their business, in order to not only satisfy their customers, but also enhance their efficiency. Data mining is a method that allows withdrawal of concealed predictive information from huge databases. It is a prevailing method with immense potential to assist businesses in concentrating on the most significant information accessible in their databases. It offers various kinds of tools to forecast future tendencies and actions to let executives make practical, knowledge-oriented decisions (Ye, 2003).

These new mechanized and innovative analyses surpass and exceed the analyses of preceding actions given by exhibitive tools distinctive of EIS and DSS. By means of data mining abilities, several business problems that had previously been too protracted to solve can be effortlessly tackled by exploring databases for concealed patterns and discovering prognostic information. Acquiring such advantages, on the other hand, is dependent on data quality in warehouses and efficient utilization of data mining tools (Ye, 2003).

Both these aspects (data quality in warehouses and efficient utilization of data mining tools) are rarely understood and seldom executed in the correct way. The purpose of this research is to explain the functions of data mining in favor of business decisions and to define some of the obstacles to its effectual deployment in companies and give recommendations.

Literature Review

For along time, business executives had complained that they are sinking in data generated by computer-founded structures. Nonetheless, practical and useful information is still in short supply. Companies have been amassing huge quantities of data. The range of the business world's data is predicted to double every year and a half (Frawley et al., 1991). The typical Fortune 500 business deals with more than a terabyte of digital information - that is amid 20 million to 500 million text reports and pages - every day, with 57% yearly increase (Kempster, 1998; Zorn et al., 1999). For case in point, the databases of at&T might comprise phone call patterns of its 100 million clients who produce more than 200 million phone calls every day.

On the other hand, most of the data has not been successfully used because of lack of highly developed systems to examine this significant and complexly developed data (Rosen, 1996). This difficulty has been further complicated by the company's rising utilization of Web tools (for instance, e-commerce, extranets and intranets). These tools allow companies to collect additional data from their digital dealings, which, consecutively, need far-reaching analyses to satisfy their clients. Problem of surplus data and very little information is the core issue at present (Ye, 2003).

Ye (2003) writes, "Advanced technologies have enabled us to collect large amounts of data on a continuous or periodic basis in many fields. On one hand, these data present the potential for us to discover useful information and knowledge that we could not see before. On the other hand, we are limited in our ability to manually process large amounts of data to discover useful information and knowledge. This limitation demands automatic tools for data mining to mine useful information and knowledge from large amounts of data. Data mining has become an active area of research and development (Ye, 2003)."

Data mining" can be defined as a procedure for making breakthroughs by excavating unidentified and actable information from huge and secure databases in favor of making practical business decision. Data mining evokes algorithms, which itemize designs from, or equip models to, data (Fayyad, 1997). The excavated information can be utilized to shape a forecast or categorization model, recognize relations amid database accounts, or offer an outline of the databases being excavated. Those designs or systems can be utilized to direct strategic decisions and predict the outcome of those decisions (Kempster, 1998; Saarenvirta, 1999). For that reason, data mining discovers and reveals previously unknown or overlooked information for executives which, consecutively, outcomes in more practical business decisions.

Kelly (2005) writes, "The term 'data mining' has come to refer to a set of techniques that originated in statistics, computer science, and related areas that are typically used in the context of large datasets. The purpose of data mining is to reveal previously hidden associations between variables that are potentially relevant for managerial decision making. The exploratory and modeling techniques used in data mining are familiar to many statisticians and include exploratory tools such as histograms, scatterplots, boxplots, and analytic tools such as regression, neural nets, and decision trees (Kelly, 2005)."

The procedure of data mining comprises the recognition of the data mining aims, recognition of the data, which is to be utilized, training and renovation of the data, along with data mining. May be the most effective access to data for analysis is to excavate the data from a warehouse. This, on the other hand, does not mean that a data warehouse ought to exist so as to extract and mine data. Data mining applications can, in addition, function outside warehouses. In this instance, nonetheless, data mining needs additional steps for mining, importing, along with evaluating data (Ye, 2003).

In operation, data mining needs the execution of two major steps. The first is the assortment and alteration of data into a reliable design for the mining processes (this is where warehousing comes into the picture), and the second is the utilization of analytical methods to assess data and recognize designs and forecasts for making decision (Ye, 2003).

The warehousing process

This measure might use from 50% to 80% of the entire data mining endeavor. In view of the fact that data is frequently stocked in various systems and designs, data from varied sources has got to be combined to generate a data warehouse, which is able to assist mining of data and making of business decisions. The warehousing procedure utilizes electronic and digital methods to combine data from various resources, redesign it, and thereafter arrange it in a manner to assist in drawing a macro outlook of information for managers and more comprehensive information for functional clients (Ye, 2003).

Data mining process

This process comprises the automatic withdrawal of embedded, formerly unidentified, and potentially helpful information from data in huge warehouses or databases. It comprises methods to mechanically discover designs in a warehouse with no previous production of a theory. It utilizes software designs to forecast future circumstances, categorize clients or conditions into known groups, discover developing operational difficulties, or assist in making concurrent business decisions (Ye, 2003).

Barriers to effective data mining

Several barriers exist in the implementation of effective data mining. Firstly, lack of vision towards data mining by organizational leaders is a common phenomenon. Secondly, producing and sustaining data and utilizing unacceptable resources and designs systems. Thirdly, ignoring corporate responsibility inside the data management workforce, which leads to inferior data quality. Fourthly, managers often do not set the standards for measuring data and fail to provide workable definitions of quality. Fifthly, selection of data mining software is done while disregarding company vision towards data mining. And lastly, failure to set up monitoring processes to maintain data quality at common stages of data formation, mining, and execution (Ye, 2003).

It is important to note that even the most complicated data mining applications cannot create successful databases and warehouses if the data is wrong. For case in point, a production firm had to fragment an almost $20 million database venture because of disconnectedly defined merchandise data along with inferior quality. A publishing and broadcasting firm used four years for cracking down client data that had been acquired from a dozen different archives (English, 1996).

Information that crawls into the databases or warehouse might be utilized for reasons beyond those initially planned by those filling and amassing the data (Phillips, 1997). Data that might be pleasing in quality for functional databases can be not viable in warehouses that confirm practical strategic business decisions. For case in point, the correctness of the analysis code in an insurance firm's functional database had been immaterial when disbursing insurance claims but might trigger a risk analysis to stop working.

From the above mentioned facts it is clear that research needs to be carried out on data mining so as to clarify and recommend solutions to the problems being faced by business executives in their data mining efforts. The purpose of this research is to explain the functions of data mining in favor of business decisions and to define some of the obstacles to its effectual deployment in companies and give recommendations.

Collection of Data

The tactic involved in the process of collection of relevant data will include gathering of concise, and yet, comprehensive information related to the topic (explaining the functions of data mining in favor of business decisions and defining some of the obstacles to its effectual deployment in companies and giving recommendations) from articles published in various scientific journals and magazines by individual researchers, as well as, the government, research institutions and companies using data mining tools. Both, online resources and offline resources will be used to compile the data.

Data analysis and Search tactics

The data analysis and search tactic will depend on manifold means so as to guarantee the most advantageous totality of facts and statistics available. At the outset a comprehensive literature exploration will be performed by means of internet, as well as, university and public library, as mentioned above. In this manner the bulk of published information relating to the topic (explaining the functions of data mining in favor of business decisions and defining some of the obstacles to its effectual deployment in companies and giving recommendations) will be distinguished, initially, and compiled, subsequently.

The analytical strategy that will be employed in this paper will firstly identify the gravity of the situation at hand relating to functions of data mining. Thereafter, the paper illustrates some of the obstacles to its effectual deployment in companies and lastly gives recommendations based in empirical research. Appropriate theories and facts will be given to prove not only the seriousness of the situation but also the validity of the arguments. Also, a brief overview will be given of the past and present situation by evaluating the strengths, weaknesses of the past and present trends and the emerging opportunities and threats. Furthermore, the most pertinent and possible factors relating to the topic (explaining the functions of data mining in favor of business decisions and defining some of the obstacles to its effectual deployment in companies and giving recommendations) will be analyzed and thereafter a thorough examination of possible variables and alternates will be conducted.

As mentioned above, factors influencing data mining are several, but only the most relevant ones will be discussed in this thesis so that the relevancy of the argument can be sustained throughout the paper. Furthermore, the use of quotations, throughout the thesis, will denote the diverse opinions of the most expert personnel in the pertinent field. The observations and views expressed by leading analysts' will offer support to the various assertions that will be presented in this thesis.

Limitations of the Research

It is imperative to analytically assess the outcome and the entire thesis. This is because this thesis has some limitations that should be observed when taking into consideration the importance of the thesis and its assistance. This thesis has concentrated on a subject that has been an extremely large and leading one; that is, functions of data mining and obstacles towards its successful execution. Undoubtedly, this characterizes an extremely difficult assignment for research in spite of the more precise interests that the thesis might have. This wide-ranging and difficult subject has been analyzed from a somewhat limited experimental perception. The choice of the single thesis design obviously draws out numerous limitations in so far as the simplification of the outcome of the thesis is involved. Consequently, the thesis setting can simply be termed as a sort of direct framework of the past and present trends in data mining.

One more limitation of this research study will be the viewpoint assumed. Rather than attempting to comprehend the entire situation in the it industry at the global level, this thesis will be primarily limited to explaining the functions of data mining in favor of business decisions and defining some of the obstacles to its effectual deployment in companies and giving recommendations. Even though the thesis will also consider additional observations of past operations and functions of data warehouses, the most important point-of-view from which results have been sketched is the explanation of the functions of data mining in favor of business decisions.

Validity and reliability of the results

May be the most important aspect of this research will be its heavy reliance on sources of information that can be unfinished or badly subjective. When the information on which the results have been-based is not comprehensive or is deceptive, the soundness of those conclusions is clearly uncertain. Consequently, this research confronts the challenge of making sure that the explanation given is a precise portrayal of what happened, is happening, and what might happen in the data mining sector. How genuinely such information corresponds to the events they portray might be open to important questions. In addition, I myself can be responsible, either by being unsuccessful in researching methodically for records and accounts or by influencing the records.

Taking into consideration the risks to the genuineness and balance of obtainable knowledge concerning the present topic, this research study will adapt a number of safeguards to encourage the accurateness of the production. One method will be to acquire manifold records to determine how strongly dissimilar versions correspond. One more method will be to find the records within the sociopolitical environment of the present day. A third method will be to assess the dependability of a reference by its standing as an official text or by the standing of its writer.

Conclusion

The concept and use of data mining has transformed essentially from what it was a decade ago to what it is right now. Now with the increased competition and advance technology, data mining has become a decisive tool in the tug of war within the global market serving as a mechanism to gain advantage over the competitors' product, advertising, prices, consumer services, etc. The purpose of this research is to explain the functions of data mining in favor of business decisions and to define some of the obstacles to its effectual deployment in companies and give recommendations.