Predictive Analytics for the Eyes and Mind


 Arlene Cain
 1 years ago
 Views:
Transcription
1 WHITE PAPER Predictive Analytics for the Eyes and Mind Stephen Few Perceptual Edge
2 Most of my current work in the field of data visualization focuses on analytical uses of visualization, especially what s called descriptive statistics. Analysis of this type strives to discover and understand the meanings that reside in data meanings that reveal what actually exists and has happened in the past. Often, the greatest benefi t of data analysis, however, comes from using our knowledge of what s happened in the past to predict what might happen in the future what s called predictive statistics or predictive analytics. If we understand data well enough to describe the past clearly and accurately, we can usually build a model that can be used to predict what will likely happen in the future as a result of particular conditions, events, or decisions. This interest in prediction has always been a preoccupation of statistics, and for good reason. The ability to predict probable futures allows us to shape the future, rather than merely survive whatever it brings. When supported by good visualizations, predictive analytics come alive in ways that not only help statisticians, but also make it possible for a much broader audience to become involved in shaping the future. In recent years, the benefi ts that visualization brings to descriptive statistics have been embraced by a growing body of knowledge workers in organizations of all types. It s time for this same broad audience of people to be invited to harness the power of visualization for predictive analytics. There is a mystique that often and unnecessarily shrouds predictive analytics, which I believe can and should be dispersed by simple, welldesigned examples of data visualization. This is what I m attempting to do, at least in part, in this paper. While it s true that some analytical problems can only be solved by welltrained statisticians and the use of sophisticated tools, most of the analytical tasks that nonstatisticians face in the course of their work can be effectively handled using relatively simple visualizations and no more than a basic understanding of statistics. Predictive Analytics for All Let s clarify the meaning of predictive analytics. Like many terms that get tossed around by software vendors and even by thought leaders in the fi eld of business intelligence, predictive analytics seems to mean whatever s convenient at the moment. It might be useful for marketing purposes to keep defi nitions loose and adaptable to the occasion, but it doesn t help us at all. We ll start by turning to everyone s favorite encyclopedia these days: Wikipedia. Predictive analytics encompass a variety of techniques from statistics and data mining that analyze current and historical data to make predictions about future events. Such predictions rarely take the form of absolute statements, and are more likely to be expressed as values that correspond to the odds of a particular event or behavior taking place in the future. In business, predictive models exploit patterns found in historical and transactional data to identify risks and opportunities. Models capture relationships among many factors to allow assessment of risk or potential associated with a particular set of conditions, guiding decision making for candidate transactions. Wikipedia entry for predictive analytics as of December 15, Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 1 of 16
3 Despite reservations about defi nitions from Wikipedia, I think these two paragraphs nicely describe the nature of predictive analytics that we can use as a platform for the short journey that I ll take you on in the paper. I d like to supplement what we ve learned from Wikipedia with a few words from Alan McLean of Monash University, because he adds an important emphasis on probability and features the role of models. Statistics is commonly taught as a set of techniques to aid in decision making, by extracting information from data. It is argued here that the underlying purpose, often implicit rather than explicit, of every statistical analysis is to establish one or more probability models that can be used to predict values of one or more variables. Such a model constitutes information only in the sense, and to the extent, that it provides predictions of suffi cient quality to be useful for decision making. The quality of the decision making is determined by the quality of the predictions, and hence by that of the models used. Alan McLean, The Predictive Approach to Teaching Statistics, Journal of Statistics Education v.8, n.3 (2000). The goal of statistics, when used for prediction, is not to produce certainty, but to reduce uncertainty to a level that will allow us to make better decisions. To do this, we rely on models. Don t let the terms statistical model or predictive model throw you. In concept, they re quite simple, just like more familiar models of other types. Generally speaking, models are representations of things or events, which we use to examine and understand those things or events when it isn t possible or practical to observe or interact with them directly. Statistical models represent mathematical relationships between the parts that make up the thing or event. Predictive models are those that we can interact with to investigate the results of hypothetical conditions, such as by changing the values of particular variables. Predictive models make it possible for us to do what some people call whatif analysis. What if such and such a condition existed or event occurred? What would happen as a result? Predictive models give us the means to predict what would probably happen (the probable outcomes of dependent variables) if particular conditions arose naturally or by intention (specifi ed input values to one or more independent variables). One of my favorite models is 1.5 acres in size, filling a large building in the city of Sausalito, California, located just across the Golden Gate Bridge from San Francisco in Marin County. The Bay Model, as it s called, is a threedimensional hydraulic model of the entire San Francisco Bay and the surrounding delta system that extends into the Sacramento and San Joaquin valleys, consisting of more than 1,600 square miles of waterways. It was built and is still used by the US Army Corps of Engineers to study the effects of various conditions on this huge estuary, which is vitally important to the state of California. One way that engineers use this model is to anticipate conditions that could harm the bay so they can construct preventative protections. Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 2 of 16
4 On two occasions, I ve walked all around and over the bay model on platforms that let visitors explore this smallscale version of the entire bay area. It s a bit like fl ying over this beautiful area, where I live, in a helicopter. Like most visitors, I love to spot places that are familiar to me and to get a sense of how they fi t into the region as a whole. The Bay Model, like all good models, has been intentionally simplifi ed. It doesn t show houses and only major roads are included because its purpose is to help engineers focus on water levels in relation to particular areas of shoreline and structures, such as bridges, ports and shipping routes. Small metal rods stick out of the water throughout the model, extending from the earthen fl oor of the bay upward above the water line. These rods make it possible to see water levels throughout the model and to watch how they re affected by particular conditions, such as releases of water from a dam or the drought conditions that we re currently experiencing. The engineers could have prepared a complex Excel spreadsheet, using mathematical calculations alone to model this water system, but this wouldn t suffi ce. Some things must be seen to be understood. Good predictive models of all types, whether they represent something physical such as the San Francisco Bay or something abstract such as your company s sales, almost always benefi t from good visualizations. Good Models Are Critical A model must capture the essence of the thing it represents, fi nding the right balance between too much information and too little. To build an effective model, you must understand the thing being modeled well enough to pick out the important parts and ignore the others, and to represent only the aspects of those important parts that are relevant to the task. If a model is more complicated than the thing it represents, it s a bad model. If it s so simple that it leaves out information that must be seen and understood, it s a bad model. For purposes of analysis or presentation, viewing and interacting with a good model works better than viewing and interacting with the real thing. The model removes extraneous features and details, making it easy for us to focus only on what pertains to our purpose. For this reason, good instruction manuals often use simple line drawings to illustrate how things should be put together or repaired, rather than photographs. It would be diffi cult to pick out the important features of the things you need to interact with from a photograph. Like the real world, photographs are fi lled with shadows, subtle details are buried in visual complexity, and what you need to see can be hidden behind something else. In this same vein, comic book artist Scott McCloud, a talented artist and thoughtful communicator, explains how the pared down design of comic book illustrations works as a form of amplifi cation through simplifi cation. When we abstract an image through cartooning, we re not so much eliminating details as we are focusing on specifi c details. By stripping down an image to its essential meaning, an artist can amplify that meaning in a way that realistic art can t. Scott McCloud, Understanding Comics, Harper Collins, New York, NY, 1993, p. 30 Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 3 of 16
5 Most of the applications that I ve seen marketed by business intelligence software vendors for predictive analytics allow data to be entered on one end (inputs) and then results (outputs) pop out the other; what goes on in between remains hidden in a black box. Unfortunately, without seeing what goes on in that black box, our brains aren t fully engaged in the process and too much is missed. Predictive analytics are most revealing when they allow us to see how all the variables that contribute either directly or indirectly to the outcomes that concern us relate to those outcomes and to one another. To understand these relationships, we must see them; we must watch how changes in one variable directly cause or indirectly infl uence changes in the others. For this to happen, predictive models must be displayed visually in a way that allows: (1) our eyes to see the relationships and changes; and (2) our minds to make sense of them. It s almost impossible to spot and make sense of patterns without pictures Designers of good predictive models know how to let computers do what they do well in this case, the math, which they do quickly and rapidly and how to let people s eyes and minds do what they do well spot patterns and make sense of them. This level of involvement in the analytical process takes advantage of our brains in a way that throws open the windows to insights that might never be experienced otherwise. We must enable a subtle interplay between human and computer a dance in which each partner fully displays its strength and grace, without overstepping and diminishing the other s. It s almost impossible to spot and make sense of patterns without pictures. Patterns that remain hidden in a table of numbers, like that Excel spreadsheet the U.S. Army Corps of Engineers could have built to model the San Francisco Bay, are made visible by the right visualization. In their case the visualization is a 3D physical model, but most models of abstract information (that is, information pertaining to something that isn t physical), work best with simple 2D visualizations that can be viewed and manipulated on a computer. Good software treats our minds with respect. Our brains are capable of abstract reasoning, subtle pattern detection, and interpretation of meaning. Models sell them short when our minds are invited only to enter inputs and then view end results, as if they can t make sense of what lies between. Not only can they make sense of what often hides in the black box, it is only when that information is properly revealed that we can hope to discover what lives beyond the expected. Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 4 of 16
6 An Example of an Enlightening Predictive Model Earlier I spoke of the mystique that often hides analytics behind the curtain, making anyone who isn t a wizard fear to approach. Consistent with this alienating perception is the common fallacy that many things simply can t be measured, should not be measured, or only can be measured using techniques known by a few statistical grand masters. Douglas Hubbard, the author of How to Measure Anything, believes differently. Hubbard makes a clear and convincing argument that not only can everything be measured, and much of it should, but also that there are means at our disposal that aren t terribly complicated. In his book, Hubbard teaches an entire collection of practical techniques for measuring things that businesspeople often dismiss at great loss as intangibles. One use of predictive models that he features in his book involves the assessment of risk. Hubbard bemoans the fact that organizations often fail to measure risk because they assume it can t be done or is too diffi cult. Many organizations employ fairly sophisticated risk analysis methods on particular problems; for example, actuaries in an insurance company defi ne the particulars of an insurance product, statisticians analyze the ratings of a new TV show, and production managers are using simulations to model changes in production methods. But those very same organizations do not routinely apply those same sophisticated risk analysis methods to much bigger decisions with more uncertainty and more potential loss. Douglas W. Hubbard, How to Measure Anything: Finding the Value of Intangibles in Business, John Wiley and Sons Inc., Hoboken, NJ, 2007, p. 83. I decided to use one of Hubbard s examples of risk assessment to illustrate how I believe predictive models ought to be designed to fully engage our minds and, as a result, lead us to the best decisions. This particular example is quite simple. It involves a company that manufactures a product, which management hopes can be manufactured more successfully and at less cost by leasing a particular machine at a cost of $400,000 per year. Here are the variables that must be considered to assess the risk associated with the lease that is, the risk of not saving enough money as a result of using the machine to equal or exceed the cost of the lease: Maintenance Savings ($ per unit) Labor Savings ($ per unit) Raw Materials Savings ($ per unit) Production Level (total units manufactured) We can build a predictive model to assess the risk of the lease and to also determine where efforts should be focused to produce maximum savings. In this model, total annual savings resulting from the use of the machine can be calculated as: Annual Savings = (Maintenance Savings + Labor Savings + Raw Material Savings) * Production Level Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 5 of 16
7 In this example, annual savings must exceed $400,000 or we ll lose money. In the graceful dance between human and computer that we re hoping to perform, as manufacturing experts (or so we imagine) we can contribute useful knowledge to the model. We can draw on our own experience to estimate the savings we can expect to gain related to maintenance, labor, and raw materials. You might argue, and rightfully so, that even an expert can t be expected to predict the actual amount of savings for each of these variables, but an expert can come up with a reliable estimate of the possible range. Hubbard talks a great deal about range estimates such as these. One method to express our uncertainty about a number is to think of it as a range of probable values. In statistics, a range that has a particular chance of containing the correct answer is called a confi dence interval (CI). A 90% CI is a range that has a 90% chance of containing the correct answer. Douglas W. Hubbard, How to Measure Anything: Finding the Value of Intangibles in Business, John Wiley and Sons Inc., Hoboken, NJ, 2007, p. 53. As it turns out, these lowtohigh value ranges that we use to express confi dence intervals are quite handy for predictive analysis. Using ranges to represent your uncertainty instead of unrealistically precise point values clearly has advantages. When you allow yourself to use ranges and probabilities, you don t really have to assume anything you don t know for a fact. But precise values have the advantage of being simple to add, subtract, multiply and divide in a spreadsheet. So how do we add, subtract, multiply and divide in a spreadsheet when we have no exact values, only ranges? Fortunately, a fairly simple trick can be done on any PC  Monte Carlo simulations, which were developed to do exactly that. A Monte Carlo simulation uses a computer to generate a large number of scenarios based on probabilities of inputs. For each scenario, a specifi c value would be randomly generated for each of the unknown variables. Then these specifi c values would go into a formula to compute an output for that single scenario. This process usually goes on for thousands of scenarios. Douglas W. Hubbard, How to Measure Anything: Finding the Value of Intangibles in Business, John Wiley and Sons Inc., Hoboken, NJ, 2007, p. 72. We ll get to Monte Carlo simulations in a moment. For now, let s enter our 90% confi dence intervals for each of the variables into a model. To construct and interact with our predictive model, I m going to use a feature, called the Profi ler, in the JMP software product from SAS. To get started, the Profi ler allowed me to easily defi ne each of the variables and set their lower and upper limits in the table on the following page. Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 6 of 16
8 Figure 1 I named the model Risk Predictor. As you can see, I entered a low value for each variable s confi dence interval (including production volume) into the fi rst row, and a high value into the second. These values came directly from Hubbard s book. The low and high values in the Annual Savings column were automatically calculated by the Profi ler based on the formula that I described earlier, which I entered into the Profi ler while defi ning this variable. People often try to predict risk by assigning specifi c values to the independent variables. For instance, we could use the following middle values (the means in this case) of our confi dence intervals: Independent Variable Low Value High Value Mean Maintenance Savings (dollars per unit) Labor Savings (dollars per unit) Raw Materials Savings (dollars per unit) Production Level (total units manufactured) 15,000 35,000 25,000 Based on these specifi c values, we could calculate annual savings as follows: Annual Savings = ($15 + $3 + $6) * 25,000 = $600,000 This method is simple, but it doesn t tell us how likely it is that our annual savings would fall below the $400,000 cost of the lease. In other words, this method doesn t really assess probable risk. To do this, we ll need to use our confi dence intervals. After entering the variables into the Profi ler table, I asked JMP to graph the variables a single, simple step which generated the display on the following page: Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 7 of 16
9 Figure 2 This visual model consists of four graphs, one for each independent variable, and a quantitative scale on the left, which measures annual savings in thousands of dollars. Consider the maintenance savings graph on the left for a moment. The black line that slopes upward from left to right shows how increases in maintenance savings will affect annual savings. The vertical dashed red line is currently set to a maintenance savings value of $15, and the horizontal dashed red line indicates that for this amount of maintenance savings, along with the current values set for each of the other independent variables in their respective graphs, projected annual savings equal $600,000. We still haven t gotten around to assessing risk. So far, the Profiler has given us a way to visually explore the effect on annual savings of various values for any or all of the independent variables. Let s use this model to explore. Before changing any of the values to see the results, let s see what we can understand about these four variables and their relationships to annual savings without changing a thing. By looking at the black lines in the four graphs above, which show the slope of change to annual savings associated with each of these variables, we can see that changes to some variables have a greater effect than others on annual savings, based on the slopes of the lines. The variable with the greatest upward slope is production volume, which isn t a surprise. Maintenance and labor savings both appear to have roughly the same midlevel effect on annual savings, and raw materials savings contributes the least. By moving the red line in the production volume graph from 25,000 to 26,000, increasing volume by 1,000 units, without changing anything else, we could increase annual savings from $600,000 to $624,000, as you can see below. Figure 3 Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 8 of 16
10 Assuming that the leased machine would enable us to manufacture more products than we currently produce without it, we can see that our greatest opportunity to maximize savings would come from increases in manufacturing volume. What if we achieved only the lowest predicted dollar savings associated with each of the other three variables? Could we then make up for the cost of the lease based on increases to manufacturing volumes alone? Let s take a look. I moved the vertical red lines for maintenance, labor, and raw materials savings to the lowest value in their ranges and then moved the vertical red line for production volume to 35,000, the highest value in the range, and here s the result: Figure 4 As you can see, we could only expect this scenario to produce around $385,000 in annual savings, which is below our lease cost of $400,000. We probably couldn t break even by focusing on production volume increases alone. We should focus on some combination of maintenance and labor savings along with increases in production volumes to achieve high annual savings. For instance, by increasing maintenance savings from $15 to $16 a unit and labor savings from $3 to $4 a unit and leaving production volume at 25,000, we could likely increase annual savings from $600,000 to $650,000, as shown below. Figure 5 Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 9 of 16
11 From here, each incremental increase of 1,000 units in production volume results in an annual savings increase of $26,000. For instance, in the following example, you can see that a single increase of 1,000 units in production volume raised annual savings from $650,000 to $676,000. Figure 6 This simple visual display has given us a means to perform whatif analysis in a manner that reveals how the variables relate to and affect one another. The result is a better understanding of how the leased machine could affect savings than we would have gained by entering input values and seeing the resulting annual savings amount, while the relationship between the variables remained hidden in a black box. This better understanding helped us to develop a strategy for maximizing savings that would have taken a great deal of trial and error to piece together using the black box approach. The best way (and often the only way) to see how the parts of something relate to one another is to place them all simultaneously before our eyes, so we can observe them all at once and watch how a change in one results in changes to the others. This is because we can only compare things that reside simultaneously in working memory. Visual working memory is limited to about three chunks of information at any one time. Visual information gets into working memory in three ways: (1) from the external world through our eyes, (2) from longterm memory, where memory chunks are stored for later retrieval when needed, and (3) from our imagination, where we construct images from pure thought. This means that when we re comparing quantitative values to determine how they relate, as we ve been doing with our Risk Predictor model, the easiest way to support this process is to position the variables simultaneously in front of your eyes on a computer screen in the form of a graphical model. This allows us to swap the patterns that we see and wish to compare in and out of working memory rapidly. In this manner, we can also compare patterns that we re currently seeing with our eyes to relevant patterns that we ve seen in the past and memorized (that is, stored in longterm memory) or to patterns that we re imagining in the moment. Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 10 of 16
12 Let s now extend our predictive queries to the assessment of risk. For this, we re going to let the computer do what it does well: perform extremely fast and accurate calculations. Specifi cally, we re going to ask it to perform what s called a Monte Carlo simulation. If you ve encountered this term before and dismissed it as something too complicated to consider (which I did for years), I assure you, there s nothing to fear. Although we might not be able to write the software algorithms that Monte Carlo simulations use, the concept is fairly simple. The Wikipedia entry for Monte Carlo method includes a sentence that s quite pertinent to our situation. Monte Carlo methods are useful for modeling phenomena with signifi cant uncertainty in inputs, such as the calculation of risk in business. Wikipedia entry for Monte Carlo method as of December 15, What we ve done so far is whatif predictive analysis. Using models similar to the one we ve been using so far, analysts often produce three different whatif scenarios: best case, worst case and most likely case. Based on the 90% confi dence intervals that we ve assigned to each independent variable, we could produce the following: Scenario Annual Savings ($) Gain/Loss on Lease ($) Best Case 1,295, ,000 Most Likely Case 600, ,000 Worse Case 165,000 (235,000) This expresses risk as a range of possibilities: a full $1,130,000 of uncertainty, extending from a gain of $895,000 on the high end to a loss of $235,000 on the low end. So what is our risk of losing money exactly? In cases like this, whatif analysis is informative, but it doesn t give us what we really need: a measure of the probability that we ll lose money. In statistical terms, whatif analysis is deterministic. This means that it s based on singlevalue estimates for each of the variables. What we need is the type of model that statisticians call stochastic. I know what you re thinking. Why do statisticians have to use such cryptic terms? Just as in any field of study, statisticians coin and then use terms that sound like gobbledygook to those outside the fi eld in this case gobbledygook that alienates most nonstatisticians. Let s be honest statisticians aren t alone in the practice. Experts in any fi eld do this, not to be obscure, but simply because they need a precise term to describe something relevant to their work, which to them is no more obscure than any other term. Sometimes they forget, however, that others don t understand their unique language and end up unintentionally confusing their audience when attempting to explain something. Back to stochastic. I run across this term in my work every once in awhile, but I managed to ignore it out of fear until I took the time to look it up. What I found was fairly simple to understand. Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 11 of 16
13 Stochastic means being or having a random variable. A stochastic model is a tool for estimating probability distributions of potential outcomes by allowing for random variation in one or more inputs over time. The random variation is usually based on fl uctuations observed in historical data for a selected period using standard timeseries techniques. Distributions of potential outcomes are derived from a large number of simulations (stochastic projections) which refl ect the random variation in the input(s). Wikipedia entry for Stochastic process as of December 15, In other words, a predictive model that is stochastic is one that uses a set of random values within a prescribed range, such as our 90% confi dence intervals, for the independent variables in an attempt to simulate a distribution of possible outcomes. Let s go back to Wikipedia once again to tie stochastic models and Monte Carlo simulation together: Monte Carlo simulation considers random sampling of probability distribution functions as model inputs to produce hundreds or thousands of possible outcomes instead of a few discrete scenarios. The results provide probabilities of different outcomes occurring. For example, a comparison of a spreadsheet cost construction model run using traditional whatif scenarios, and then run again with Monte Carlo simulation shows that the Monte Carlo analysis has a narrower range than the whatif analysis. This is because the whatif analysis gives equal weight to all scenarios. Wikipedia entry for Monte Carlo method as of December 15, A Monte Carlo simulation involves using random numbers (that is, a stochastic process) and probability (such as a normal, bellshaped distribution) to solve problems. Enough defi nition; let s get back to our example. Using the predictive model that we already built using the JMP Profi ler, let s now enhance it to run Monte Carlo simulations. After setting it up, which I ll explain in a moment, I asked the Profi ler to use the Monte Carlo method to run 5,000 random simulations, which produced the following display: Figure 7 Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 12 of 16
14 To the right of the graph for production volume, we now see a graph that wasn t there before. It s a histogram turned on its side, which displays the distribution of annual savings values that were produced by the 5,000 Monte Carlo simulations. Looking at the quantitative scale, which appears vertically along the left edge of the maintenance savings graph, notice that the peak of the bellshaped curve in the histogram is located at an annual savings amount of $600,000. Now look at the horizontal red line in the histogram. This marks the $400,000 point the cost of the lease. It serves as a reference line for the point below which we would lose money on the lease. The number labeled Rate, which appears at the righthand edge of the display is the defect rate: the percentage of times out of the 5,000 simulations that the savings rate fell below $400,000. Stated differently, according to the Monte Carlo simulations, the risk of losing money is 14.4%. Stated from the opposite perspective, there is an 85.6% probability that we ll save money by leasing the machine. Now we have an actual measure of risk that we can use to consider the odds before making a decision. Here s what I did to set up the Monte Carlo simulations using the Profi ler. After telling JMP that I wanted to run simulations, it added the green histogram on the right and the four green probability curves at the bottom one for each independent variable. Looking at the probability curve for maintenance savings on the left as an example, notice that it s bellshaped (that is, what s called a normal curve) with its peak in the middle, centered on the value of $15 per unit in maintenance savings. As a default, the Profi ler assumed the random variables that the simulations would generate should be controlled to produce a distribution of this shape, with most of the 5,000 values near $15 and greater and lesser values within our 90% confi dence interval range from $10 on the low end to $20 on the high end decreasing in quantity on both sides of $15 the farther they venture from that center value. This turned out to be a good assumption for our model, but if we knew that maintenance savings were more likely to be skewed such that more values would fall in the lower half of the range than the higher, we could have adjusted the shape of the distribution to match that expectation. In addition to this, the Profi ler provides a long list of possible distribution shapes from which to choose, with enough fl exibility to fi t all possible distributions. The most statistically challenging task that I faced while setting up the Monte Carlo simulations involved telling JMP to interpret the lower and upper bounds of the ranges that we set up for each independent variable as 90% confi dence intervals. I did this by adjusting the values in the data entry fi elds labeled SD (standard deviation). The Profi ler can be set up to interpret the lower and upper values that are entered into the model in various ways, not just as 90% confi dence intervals, which is how we want them to be understood. To make sure that 90% of the random values that were generated would fall within this range, I had to set the standard deviation to a value that instructed the Profi ler to distribute the randomly generated values in this manner. Even though in my work I don t usually think of variation in terms of standard deviations, it was fairly easy to determine the correct standard deviation value for each of our independent variables, based on an understanding of how standard deviations behave in normal distributions, such as the ones we re using here. I know that 68% of the values in a normal distribution fall within one standard deviation above Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 13 of 16
15 and below the mean, 95% fall within two standard deviations, and 99.7% fall within three standard deviations. Given this understanding, I could have easily caused 95% of the values generated by the Monte Carlo simulations to fall within our lower and upper limits by dividing each by the difference between them and the mean by two (that is, two standard deviations). For instance, to set the standard deviation for maintenance savings in this manner, the difference between the mean value of $15 and the lower limit of $10 is $5; which, when divided by two, equals $2.50. I d rather be more precise, however, and set the standard deviations for each independent variable to the value that that will treat our lower and upper bounds as 90% confi dence intervals, so I did a quick Web search and found that standard deviations (rather than 2) from the mean contains 90% of the values in a normal distribution. From here, to set the precisely correct standard deviation for maintenance savings, I divided the $5 difference between the mean of $15 and lower limit of $10 by 1.645, resulting in $3.04. I then used this same calculation to set the appropriate standard deviation for each of the independent variables. With our Monte Carlo simulator in place, we can now go back to what we were doing before adjusting the values of our independent variables to see how they might affect our risk. For instance, in the example below, I ve made a single adjustment: an increase in production to 26,000 units. Figure 8 Notice that the probability of losing money has now been reduced to 10.9% (the rate that appears at the righthand edge). Let s look at one fi nal scenario. In the example on the following page, I ve left production volume at the increased amount of 26,000 units, but have also increased maintenance and labor savings to $16 and $4 respectively. Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 14 of 16
16 Figure 9 With this scenario, the probability of losing money on the lease has been reduced to 8.12%. We can now proceed with confi dence that there is a less than a one in ten chance that we ll lose money, which we can reduce even more with a strategy that focuses on a little extra effort to increase production volume, maintenance savings, and labor savings. Model Builders and Model Users Some predictive models are simple to construct and use, assuming you understand the domain (that is, the data and processes involved) and have a tool that makes it easy to defi ne variables and their relationships. Some models involve complex statistics and can only be built by those who possess this level of skill, but once constructed, these models can often be used by anyone who understands the domain. It s important to understand this distinction. A fair amount of predictive modeling, even of the exploratory variety, can be done by people who lack all but a basic understanding of statistics, assuming they have good software at their disposal. Over time with experience, their skills will grow, along with their knowledge of statistics as they learn principle by principle, technique by technique, as they re needed. A fair amount of predictive modeling, even of the exploratory variety, can be done by people who lack all but a basic understanding of statistics, assuming they have good software at their disposal. It s also important to realize that even predictive analysis that involves complex statistical models can often be done by a broad population of nonstatisticians, if the analysis is routine in nature (that is, always done by following the same steps) and a good predictive model has already been built by someone with the required skills. There is no reason for skilled statisticians themselves to perform, again and again, routine analyses that could be easily done by others using a prebuilt predictive model. By building such models for others, skilled statisticians in our organizations can keep their time free for more daunting challenges, to the greater benefi t of all. Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 15 of 16
17 Beware of Cheap Imitations Don t be fooled by those socalled data visualization products that are currently popular because of fl ashy, videogamelike displays. Most of them possess little analytical support under the hood and reveal meager substance in their displays once you peel away the bright colors and shiny lighting effects. Now that people are increasingly recognizing the tremendous potential of visual analytics, every business intelligence vendor in the marketplace claims to lead the industry. The sad truth, however, is that most can t even properly defi ne terms like data analysis, data visualization, predictive analytics, and visual analytics. Today, only a few vendors are contenders. In every case that I ve seen, these aren t traditional business intelligence software vendors, but companies that have either been working in the fi eld of statistical analysis for years (such as SAS) or are spinoffs of information visualization research at universities. If you re in the market for analytics software, evaluate a vendor s claim to analytical prowess with a critical eye and respond with a cold shoulder whenever its promises are hollow. Visual analytics can open your eyes to levels of discovery and understanding that surpass anything you ve known, but only true analytics done right. It s up to you to know the difference. About the Author Stephen Few has worked for 25 years as an IT innovator, consultant, and teacher. Today, as Principal of the consultancy Perceptual Edge, Few focuses on data visualization for analyzing and communicating quantitative business information. He provides consulting and training services, writes the monthly Visual Business Intelligence Newsletter, speaks frequently at conferences, and teaches in the MBA program at the University of California, Berkeley. He is the author of two books: Show Me the Numbers: Designing Tables and Graphs to Enlighten and Information Dashboard Design: The Effective Visual Communication of Data. Copyright 2008, Stephen Few. Reprinted with the permission of Stephen Few. Page 16 of 16
18 SAS Institute Inc. World Headquarters To contact your local JMP office, please visit SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. indicates USA registration. Other brand and product names are trademarks of their respective companies. Copyright 2009, SAS Institute Inc. All rights reserved _
Dashboard Design for Rich and Rapid Monitoring
Dashboard Design for Rich and Rapid Monitoring Stephen Few Visual Business Intelligence Newsletter November 2006 This article is the fourth in a fivepart series that features the winning solutions to
More informationQuantitative Displays for Combining TimeSeries and ParttoWhole Relationships
Quantitative Displays for Combining TimeSeries and ParttoWhole Relationships Stephen Few, Perceptual Edge Visual Business Intelligence Newsletter January, February, and March 211 Graphical displays
More informationCopyright 2008 Stephen Few, Perceptual Edge Page of 11
Copyright 2008 Stephen Few, Perceptual Edge Page of 11 Dashboards can keep people well informed of what s going on, but most barely scratch the surface of their potential. Most dashboards communicate too
More informationCSU, Fresno  Institutional Research, Assessment and Planning  Dmitri Rogulkin
My presentation is about data visualization. How to use visual graphs and charts in order to explore data, discover meaning and report findings. The goal is to show that visual displays can be very effective
More informationIntroduction to Geographical Data Visualization
perceptual edge Introduction to Geographical Data Visualization Stephen Few, Perceptual Edge Visual Business Intelligence Newsletter March/April 2009 The important stories that numbers have to tell often
More informationRisk Analysis Overview
What Is Risk? Uncertainty about a situation can often indicate risk, which is the possibility of loss, damage, or any other undesirable event. Most people desire low risk, which would translate to a high
More informationSometimes We Must Raise Our Voices
perceptual edge Sometimes We Must Raise Our Voices Stephen Few, Perceptual Edge Visual Business Intelligence Newsletter January/February 9 When we create a graph, we design it to tell a story. To do this,
More informationCommon Mistakes in Data Presentation Stephen Few September 4, 2004
Common Mistakes in Data Presentation Stephen Few September 4, 2004 I'm going to take you on a short streamofconsciousness tour through a few of the most common and sometimes downright amusing problems
More informationMaking confident decisions with the full spectrum of analysis capabilities
IBM Software Business Analytics Analysis Making confident decisions with the full spectrum of analysis capabilities Making confident decisions with the full spectrum of analysis capabilities Contents 2
More informationIf A is divided by B the result is 2/3. If B is divided by C the result is 4/7. What is the result if A is divided by C?
Problem 3 If A is divided by B the result is 2/3. If B is divided by C the result is 4/7. What is the result if A is divided by C? Suggested Questions to ask students about Problem 3 The key to this question
More informationBetter decision making under uncertain conditions using Monte Carlo Simulation
IBM Software Business Analytics IBM SPSS Statistics Better decision making under uncertain conditions using Monte Carlo Simulation Monte Carlo simulation and risk analysis techniques in IBM SPSS Statistics
More informationHow Traditional Physical Backup Imaging Technology Fits Into a Virtual Backup Solution
Virtualization Backup and Recovery Solutions for the SMB Market The Essentials Series How Traditional Physical Backup Imaging Technology Fits Into a Virtual Backup Solution sponsored by Introduction to
More informationTop 5 best practices for creating effective dashboards. and the 7 mistakes you don t want to make
Top 5 best practices for creating effective dashboards and the 7 mistakes you don t want to make p2 Financial services professionals are buried in data that measure and track: relationships and processes,
More informationVisualizing Multidimensional Data Through Time Stephen Few July 2005
Visualizing Multidimensional Data Through Time Stephen Few July 2005 This is the first of three columns that will feature the winners of DM Review's 2005 data visualization competition. I want to extend
More informationA Picture Really Is Worth a Thousand Words
4 A Picture Really Is Worth a Thousand Words Difficulty Scale (pretty easy, but not a cinch) What you ll learn about in this chapter Why a picture is really worth a thousand words How to create a histogram
More informationPart 7. Capital Budgeting
Part 7. Capital Budgeting What is Capital Budgeting? Nancy Garcia and Digital Solutions Digital Solutions, a software development house, is considering a number of new projects, including a joint venture
More informationArbs2U Is it right for me? 17 October 2014
17 October 2014 Contents Section 1 Preface... 3 Document Feedback... 3 Section 2 Introducing Arbitrage... 4 A brief discussion on Betting... 4 What is Arbitrage?... 5 What are the risks involved?... 7
More informationHigh School Algebra Reasoning with Equations and Inequalities Solve equations and inequalities in one variable.
Performance Assessment Task Quadratic (2009) Grade 9 The task challenges a student to demonstrate an understanding of quadratic functions in various forms. A student must make sense of the meaning of relations
More informationFundamentals Level Skills Module, Paper F5
Answers Fundamentals Level Skills Module, Paper F5 Performance Management June 2010 Answers 1 (a) Costs and quoted prices for the GC and the EX using labour hours to absorb overheads: GC $ EX $ Materials
More informationIs Your Financial Plan Worth the Paper It s Printed On?
T e c h n o l o g y & P l a n n i n g Is Your Financial Plan Worth the Paper It s Printed On? By Patrick Sullivan and Dr. David Lazenby, PhD www.scenarionow.com 20022005 ScenarioNow Inc. All Rights Reserved.
More informationI m Graydon Trusler and I ve been doing all the Marketing for my wife s divorce law firm in Austin for 8 years or so.
I m Graydon Trusler and I ve been doing all the Marketing for my wife s divorce law firm in Austin for 8 years or so. I m going to take the same approach with you that I have with our marketing aimed at
More informationPrice Optimization. For New Business Profit and Growth
Property & Casualty Insurance Price Optimization For New Business Profit and Growth By Angel Marin and Thomas Bayley Nonlife companies want to maximize profits from new business. Price optimization can
More information0 Introduction to Data Analysis Using an Excel Spreadsheet
Experiment 0 Introduction to Data Analysis Using an Excel Spreadsheet I. Purpose The purpose of this introductory lab is to teach you a few basic things about how to use an EXCEL 2010 spreadsheet to do
More informationThe Math. P (x) = 5! = 1 2 3 4 5 = 120.
The Math Suppose there are n experiments, and the probability that someone gets the right answer on any given experiment is p. So in the first example above, n = 5 and p = 0.2. Let X be the number of correct
More informationMathematical Proficiency By Kenneth Danley Principal, Starline Elementary School1
W e know that parents are eager to help their children be successful in school. Many parents spend countless hours reading to and with their children. This is one of the greatest contributions a parent
More informationTop 5 Mistakes Made with Inventory Management for Online Stores
Top 5 Mistakes Made with Inventory Management for Online Stores For any product you sell, you have an inventory. And whether that inventory fills dozens of warehouses across the country, or is simply stacked
More informationDrawing a histogram using Excel
Drawing a histogram using Excel STEP 1: Examine the data to decide how many class intervals you need and what the class boundaries should be. (In an assignment you may be told what class boundaries to
More informationEffective Visualization Techniques for Data Discovery and Analysis
WHITE PAPER Effective Visualization Techniques for Data Discovery and Analysis Chuck Pirrello, SAS Institute, Cary, NC Table of Contents Abstract... 1 Introduction... 1 Visual Analytics... 1 Static Graphs...
More informationThe Dirty Little Secret of Software Pricing
WHITEPAPER The Dirty Little Secret of Software Pricing Stan Schneider Mr. Customer, our price is $13,349 dollars per floating development seat. Larger teams need more support, so we charge 20% maintenance
More informationQuantitative vs. Categorical Data: A Difference Worth Knowing Stephen Few April 2005
Quantitative vs. Categorical Data: A Difference Worth Knowing Stephen Few April 2005 When you create a graph, you step through a series of choices, including which type of graph you should use and several
More informationAbsolute Value of Reasoning
About Illustrations: Illustrations of the Standards for Mathematical Practice (SMP) consist of several pieces, including a mathematics task, student dialogue, mathematical overview, teacher reflection
More informationForex Trading. What Finally Worked For Me
Forex Trading What Finally Worked For Me If you find typographical errors in this book they are here for a purpose. Some people actually enjoy looking for them and we strive to please as many people as
More informationVisual Scoring the 360 View: 5 Steps for Getting Started with Easier, Faster and More Effective Lead Scoring
Visual Scoring the 360 View: 5 Steps for Getting Started with Easier, Faster and More Effective Lead Scoring Authors: Elissa Fink Wade Tibke Tableau Software p2 Lead Scoring For Most a Great Idea in Concept,
More informationData Visualization Techniques
Data Visualization Techniques From Basics to Big Data with SAS Visual Analytics WHITE PAPER SAS White Paper Table of Contents Introduction.... 1 Generating the Best Visualizations for Your Data... 2 The
More informationClub Accounts. 2011 Question 6.
Club Accounts. 2011 Question 6. Anyone familiar with Farm Accounts or Service Firms (notes for both topics are back on the webpage you found this on), will have no trouble with Club Accounts. Essentially
More informationHow to make more money in forex trading. 2003 W. R. Booker & Co. All rights reserved worldwide, forever and ever and ever.
The 10 Rules How to make more money in forex trading. 2003 W. R. Booker & Co. All rights reserved worldwide, forever and ever and ever. 2 10 Rules Page 2 Rule #1: Never lie to anyone. Never lie to yourself
More informationSimulation and Risk Analysis
Simulation and Risk Analysis Using Analytic Solver Platform REVIEW BASED ON MANAGEMENT SCIENCE What We ll Cover Today Introduction Frontline Systems Session Ι Beta Training Program Goals Overview of Analytic
More informationThe Secret Formula for Webinar Presentations that Work Every Time
The Secret Formula for Webinar Presentations that Work Every Time by Gihan Perera www.webinarsmarts.com Sponsored by In an online presentation, your slides aren t visual aids; they ARE the visuals. One
More informationBasic Tools for Process Improvement
What is a Histogram? A Histogram is a vertical bar chart that depicts the distribution of a set of data. Unlike Run Charts or Control Charts, which are discussed in other modules, a Histogram does not
More informationA capacity planning / queueing theory primer or How far can you go on the back of an envelope? Elementary Tutorial CMG 87
A capacity planning / queueing theory primer or How far can you go on the back of an envelope? Elementary Tutorial CMG 87 Ethan D. Bolker Departments of Mathematics and Computer Science University of Massachusetts
More informationAdvanced handicapping made easy.
Advanced handicapping made easy. Handicapping is the art or science of selecting a winning horse based on the information that is available to you before the race. A first time visitor to the track might
More informationINVENTORY MANAGEMENT: ANALYZING INVENTORY TO MAXIMIZE PROFITABILITY
INVENTORY MANAGEMENT: ANALYZING INVENTORY TO MAXIMIZE PROFITABILITY Jon Schreibfeder Effective Inventory Management, Inc. Sponsored by Every company strives to improve profitability. Countless hours are
More informationFIVE WAYS TO MAKE YOUR SALES COMPENSATION PLANS PAY OFF BIG. Everything you need to know to create more powerful sales incentive plans
FIVE WAYS TO MAKE YOUR SALES COMPENSATION PLANS PAY OFF BIG Everything you need to know to create more powerful sales incentive plans Executive Summary A bad sales commission plan will cost you more than
More informationStephen Few, Perceptual Edge Visual Business Intelligence Newsletter November/December 2008
perceptual edge Line Graphs and Irregular Intervals: An Incompatible Partnership Stephen Few, Perceptual Edge Visual Business Intelligence Newsletter November/December 28 I recently received an email from
More informationTableau Data Visualization Cookbook
Tableau Data Visualization Cookbook Ashutosh Nandeshwar Chapter No. 4 "Creating Multivariate Charts" In this package, you will find: A Biography of the author of the book A preview chapter from the book,
More informationGoogle Lead Generation For Attorneys  Leverage The Power Of Adwords To Grow Your Law Business FAST. The Foundation of Google AdWords
Google Lead Generation For Attorneys  Leverage The Power Of Adwords To Grow Your Law Business FAST You re about to discover the secrets of fast legal practice success with Google AdWords. Google AdWords
More informationPart 1: Project Portfolio Management Tools
Part 1: Project Portfolio Management Tools To survive and prosper in today's competitive, costconscious, and risky business environment, organizations must derive greater value from the projects that
More informationWhitepaper. 5 Dos and Don ts of Embedded Analytics. www.sisense.com
Whitepaper 5 Dos and Don ts of Embedded Analytics Who Needs Embedded Analytics? Whether you re producing automation software, SaaS products or cloud applications, it s likely to assume you re collecting
More informationThe power of money management
The power of money management One trader lost ($3000) during the course of a year trading one contract of system A. Another trader makes $25,000 trading the same system that year. One trader makes $24,000
More informationImproving Decision Making and Managing Knowledge
Improving Decision Making and Managing Knowledge Decision Making and Information Systems Information Requirements of Key DecisionMaking Groups in a Firm Senior managers, middle managers, operational managers,
More informationTools you must have to recruit the right heavy construction talent
Tools you must have to recruit the right heavy construction talent You would never think of sending your skilled tradespeople to their next job without the right tools. Whether your business is highways,
More informationHow to get profitcreating information from your accountant
How to get profitcreating information from your accountant What a tailored accounting service can do for you How could you get much more out of the accounting service you re already paying for? Possibly
More informationTABLE OF CONTENTS. ROULETTE FREE System #1  2 ROULETTE FREE System #2  4  5
IMPORTANT: This document contains 100% FREE gambling systems designed specifically for ROULETTE, and any casino game that involves even money bets such as BLACKJACK, CRAPS & POKER. Please note although
More informationLife Insurance Modelling: Notes for teachers. Overview
Life Insurance Modelling: Notes for teachers In this mathematics activity, students model the following situation: An investment fund is set up Investors pay a set amount at the beginning of 20 years.
More informationHow to Study Mathematics Written by Paul Dawkins
How to Study Mathematics Written by Paul Dawkins Before I get into the tips for how to study math let me first say that everyone studies differently and there is no one right way to study for a math class.
More informationPersonalisation. The database. communications brief: direct marketing 1. Title: The PIN code
direct marketing 1 A recent Brandscience survey by media group OMG showed that targeted communications increase response rates by up to 62% over generic equivalents. The US Direct Marketing Association
More informationEast Coast Visual Business Intelligence Workshop
East Coast Visual Business Intelligence Workshop 4 days of data analysis and presentation courses in Portsmouth, VA Show Me the Numbers: Table and Graph Design (twoday course) Taught by Stephen Few of
More informationHOW PREDICTIVE ANALYTICS DRIVES PROFITABILITY IN ASSET FINANCE
HOW PREDICTIVE ANALYTICS DRIVES PROFITABILITY IN ASSET FINANCE By Janet Orrick, Analytic Scientist at International Decision Systems EXECUTIvE SUMMARY In today s everchanging business world, asset finance
More informationTSM meets the Pro Backer
TSM meets the Pro Backer written by Dave Morris (August 2013) As the founder and owner of The Staking Machine (TSM), I m often approached by tipsters asking me to look at their historical results, and
More informationTHREE FEET from SEVEN FIGURES
THREE FEET from SEVEN FIGURES OneonOne Engagement Techniques to Qualify More Leads at Trade Shows by DAVID SPARK Three Feet from Seven Figures: OneonOne Engagement Techniques to Qualify More Leads
More informationThis Method will show you exactly how you can profit from this specific online casino and beat them at their own game.
This Method will show you exactly how you can profit from this specific online casino and beat them at their own game. It s NOT complicated, and you DON T need a degree in mathematics or statistics to
More informationSPECIAL REPORT: 4 BIG REASONS YOU CAN T AFFORD TO IGNORE BUSINESS CREDIT!
SPECIAL REPORT: 4 BIG REASONS YOU CAN T AFFORD TO IGNORE BUSINESS CREDIT! 4 BIG REASONS YOU CAN T AFFORD TO IGNORE BUSINESS CREDIT! Provided compliments of: FIRSTUSA DATA SERVICES, LLC 8778575045 SUPPORT@FIRSTUSADATA.COM
More informationTutorial 3: Graphics and Exploratory Data Analysis in R Jason Pienaar and Tom Miller
Tutorial 3: Graphics and Exploratory Data Analysis in R Jason Pienaar and Tom Miller Getting to know the data An important first step before performing any kind of statistical analysis is to familiarize
More informationMassachusetts Institute of Technology Sloan School of Management System Dynamics II: Applications of System Dynamics. Professor Jim Hines
Massachusetts Institute of Technology Sloan School of Management System Dynamics II: Applications of System Dynamics Professor Jim Hines Guidelines for kickoff meeting and first breakout Group presentation:
More informationHow to Outsource Without Being a Ninnyhammer
How to Outsource Without Being a Ninnyhammer 5 mistakes people make when outsourcing for profit By Jason Fladlien 2 Introduction The way everyone does outsourcing is patently wrong, and this report is
More informationMARKET RESEARCH OVERVIEW
DEFINITION OF MARKET RESEARCH. MARKET RESEARCH OVERVIEW Market research is the systematic collection and analysis of information relating to the market for your business. Successful businesses can no longer
More informationtop 5 best practices for creating effective campaign dashboards and the 7 mistakes you don t want to make
top 5 best practices for creating effective campaign dashboards and the 7 mistakes you don t want to make You ve been there: no matter how many reports, formal meetings, casual conversations, or emailed
More informationWhat Are Certificates?
The Essentials Series: CodeSigning Certificates What Are Certificates? sponsored by by Don Jones W hat Are Certificates?... 1 Digital Certificates and Asymmetric Encryption... 1 Certificates as a Form
More informationTruth. The. About Real Estate Advertising COTTER $49.00. Cell: (805) 6800769 Website: www.patticotter.com Email: Patti@PattiCotter.com.
$49.00 Real estate agents tell you advertising is for your benefit. Find out who's really benefiting from their ads and how to select the right real estate professional for your needs. The Truth About
More informationAdvice for Recommenders: How to write an effective Letter of Recommendation for applicants to the Stanford MBA Program
Advice for Recommenders: How to write an effective Letter of Recommendation for applicants to the Stanford MBA Program  Edited Transcript of Interview updated 27 July 2011 What are some of your responsibilities
More informationSix Signs. you are ready for BI WHITE PAPER
Six Signs you are ready for BI WHITE PAPER LET S TAKE A LOOK AT THE WAY YOU MIGHT BE MONITORING AND MEASURING YOUR COMPANY About the auther You re managing information from a number of different data sources.
More informationCOLLEGE ALGEBRA. Paul Dawkins
COLLEGE ALGEBRA Paul Dawkins Table of Contents Preface... iii Outline... iv Preliminaries... Introduction... Integer Exponents... Rational Exponents... 9 Real Exponents...5 Radicals...6 Polynomials...5
More information6 Steps To Success With Your Web Agent Solutions Website
6 Steps To Success With Your Web Agent Solutions Website By Jay Kinder and Michael Reese Introduction Congratulations on your decision to join the Web Agent Solutions family. It s an enormously effective
More informationSo today we shall continue our discussion on the search engines and web crawlers. (Refer Slide Time: 01:02)
Internet Technology Prof. Indranil Sengupta Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur Lecture No #39 Search Engines and Web Crawler :: Part 2 So today we
More informationLinear Programming Notes VII Sensitivity Analysis
Linear Programming Notes VII Sensitivity Analysis 1 Introduction When you use a mathematical model to describe reality you must make approximations. The world is more complicated than the kinds of optimization
More informationPointOfSale Research Worksheet
PointOfSale Research Worksheet This worksheet has been designed to ensure you get the information you need to properly evaluate and compare POS systems. PointOfSale Research Worksheet Shopping for
More informationGet out of debt faster
Get out of debt faster Unleash the moneysaving power of balance transfer credit cards. The Beginner s Guide to Balance Transfers Table of Contents creditcard.com.au Introduction 1 Balance Transfer Basics
More informationSimple Predictive Analytics Curtis Seare
Using Excel to Solve Business Problems: Simple Predictive Analytics Curtis Seare Copyright: Vault Analytics July 2010 Contents Section I: Background Information Why use Predictive Analytics? How to use
More informationHow to brand your dealership.
autorevo.com 2013 Guide #03 How to brand your dealership. a dealership branding guide by AutoRevo. Take a good look at your dealership... How do customers see your dealership? Do you have an obvious identity,
More informationFIVE STEPS FOR DELIVERING SELFSERVICE BUSINESS INTELLIGENCE TO EVERYONE CONTENTS
FIVE STEPS FOR DELIVERING SELFSERVICE BUSINESS INTELLIGENCE TO EVERYONE Wayne Eckerson CONTENTS Know Your Business Users Create a Taxonomy of Information Requirements Map Users to Requirements Map User
More informationPAYPERCLICK CALL TRACKING. How Call Tracking Data Can Improve & Optimize Your PPC Strategy
PAYPERCLICK CALL TRACKING & How Call Tracking Data Can Improve & Optimize Your PPC Strategy Table of Contents Introduction 3 What is PPC? 4 Google AdWords Features 6 What is Call Tracking? 8 Using Call
More information*NO PING PONG TABLE REQUIRED the one simple secret that made 96% of our developers love their jobs
*NO PING PONG TABLE REQUIRED the one simple secret that made 96% of our developers love their jobs Written by Ryan Chartrand, CEO of XTeam, a global developer resourcing company that provides fulltime
More informationTrue Cost of Tape Backup
WHITE PAPER: DATA PROTECTION Business Case: True Cost of Tape Backup Economic Value Creation (EVC ) Experts The Remote Backup Appliance Company WHITE PAPER: DATA PROTECTION The True Cost of Tape Backup
More information27PercentWeekly. By Ryan Jones. Part II in the Series Start Small and Retire Early Trading Weekly Options
By Ryan Jones Part II in the Series Start Small and Retire Early Trading Weekly Options Important My 27% Option Strategy is one of the best option trading opportunities you will come across. When you see
More informationWould You Like To Earn $1000 s With The Click Of A Button?
Would You Like To Earn $1000 s With The Click Of A Button? (Follow these easy step by step instructions and you will) This Version of the ebook is for all countries other than the USA. If you need the
More informationGuide for Local Business Google Pay Per Click Marketing!
Guide for Local Business Google Pay Per Click Marketing! Guide for Google Pay Per Click Marketing  Leverage The Power Of Adwords To Grow Your Business FAST You re about to discover the secrets of fast
More informationc01_1 09/18/2008 1 CHAPTER 1 COPYRIGHTED MATERIAL Attitude Is Everything in a Down Market http://www.pbookshop.com
c01_1 09/18/2008 1 CHAPTER 1 Attitude Is Everything in a Down Market COPYRIGHTED MATERIAL c01_1 09/18/2008 2 c01_1 09/18/2008 3 Whether you think you can or you think you can t, you are right. Henry Ford
More informationINTRODUCING AZURE SEARCH
David Chappell INTRODUCING AZURE SEARCH Sponsored by Microsoft Corporation Copyright 2015 Chappell & Associates Contents Understanding Azure Search... 3 What Azure Search Provides...3 What s Required to
More informationWEB ANALYTICS Where to Begin
WEB ANALYTICS Where to Begin ebook SPOILER ALERT! People love the Internet. A lot. In fact, 92% of online adults rely on search engines when looking for information 1. That means your audience s first
More informationSales Lead Brokerage Profit Plan Bonus Document
Sales Lead Brokerage Profit Plan Bonus Document Introduction Hello and thanks for ordering the Sales Lead Brokerage Profit Plan through the Money Makers Reviewed website. As you ll know if you read my
More informationUnit 19: Probability Models
Unit 19: Probability Models Summary of Video Probability is the language of uncertainty. Using statistics, we can better predict the outcomes of random phenomena over the long term from the very complex,
More information