X Incentivizing Participation in Online Forums for Education


 Octavia Patrick
 3 years ago
 Views:
Transcription
1 X Incentivizing Participation in Online Forums for Education Arpita Ghosh, Cornell University Jon Kleinberg, Cornell University We present a gametheoretic model for online forums for education, where students in a class can post questions to the forum and seek responses from the instructor or other students in the class. We first show that our model predicts the anecdotally observed phenomenon that students participation in a forum is nonmonotone in the instructor s response rate to questions: if the instructor responds at too high a rate students do not respond to their peers questions, whereas an almostabsent instructor induces very little participation from the students as well. We then investigate the optimal use of a forum for two kinds of questions singleanswer questions and discussionstyle questions which lead to different levels of rewards that can be meaningfully offered. We show that for discussionstyle questions, the instructor can choose her response rate so that the expected rate at which the first student response is received increases linearly with the size of the class; for singleanswer questions, however, the optimal expected rate of arrival of the first student response remains a constant even as class size diverges. However, this slow response rate can be remedied by mixing question types as long as there is any positive probability of a discussiontype question in a forum, the instructor can choose her response rate so that the equilibrium rate of the first response from the class diverges with the number of students in the class. 1. INTRODUCTION The increasing use of online applications for education raises a spectrum of research issues ranging across the delivery of course content, the evaluation of student work, and the development of resources to stimulate discussion and address student questions. We focus on resources of this latter type online forums for education oriented around discussion and questionanswering which are increasingly found in a number of different educational contexts. In many cases, they exist as supplements to standard offline classes through sites such as Piazza a rapidly growing online platform for education forums with over 500 participating classes and already used by over 100,000 students which provide students with a separate online venue for asking questions and receiving help. In other cases, they are being explored as a key component of massive open online courses (MOOCs), creating communities of students who can discuss course content online. An important property of such forums, when they work well, is that they are not simply channels for instructors to provide information to students they also involve students providing significant help to each other, thereby tapping into the peerlearning potential of a large class which, research in education shows, can provide significant learning benefits to students [Topping and Ehly 1998]. Students arrive at the forum with questions or topics they want help with, and fellow students, together with the instructor, provide followup discussion and answers. These education forums have much in common with online questionanswering (Q&A) sites such as StackOverflow, MathOverflow, or Yahoo! Answers, but also differ in key ways which play important roles in their design: Online forums for education have an instructor who can if she chooses play a crucial and visible role in the operation of the forum. In addition to providing answers of her own, the instructor can act as a global monitor of the site, and reward students for participation on the forum, both via explicit incentives such as class grades, as well as via socialpsychological rewards from instructor approval or endorsement. For these reasons, an instructor in an online forum for educa Authors s: Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies show this notice on the first page or initial screen of a display along with the full citation. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, to redistribute to lists, or to use any component of this work in other works requires prior specific permission and/or a fee. Permissions may be requested from Publications Dept., ACM, Inc., Penn Plaza, Suite 701, New York, NY USA, fax +1 (1) , or c 013 ACM /013/0ARTX $15.00 DOI:
2 X: tion has access to incentives that operate particularly powerfully relative to moderators on general Q&A sites, who tend to wield a qualitatively lower level of influence than the instructor in an education forum. The presence of an instructor who can monitor and potentially penalize poorquality contributions, as well as the presence of social norms similar to those in a classroom, mean that contribution quality, while still an issue, is arguably much less heterogeneous than in general online Q&A forums on the Web. Indeed, low effort and junk contributions appear to be significantly less common in Piazza and other education forums in comparison with generalpurpose forums like Y! Answers. From the growing use of online forums for education, we see that they can operate well with specific questions getting resolved quickly, and openended discussion questions receiving a strong flow of contributions. But they can also operate poorly, with little student participation and questions that go unanswered for long periods of time. An instructor would like to make use of an online forum so as to promote better outcomes. How can an instructor use her own behavior to incentivize higher student participation? For example, if the instructor actively appears on the site, does this tend to increase student participation (because they are hoping to get the instructor s approval) or decrease it (because they assume that the instructor will answer the questions herself)? Is there an optimal way to trade off these two forces, and how does the best outcome the instructor can elicit through her behavior depend on the size of the class as the class size becomes large, can the instructor step back and let the class do most of the work on the forum? While such questions appear at the heart of discussions about best practices in these forums [Andresen 009; Burge et al. 000; Gray 004; Hanover Research Council 009; Mazzolini and Maddison 003], there has so far not been a formal way of reasoning about them Overview of results We develop and analyze a gametheoretic model of student participation in online forums for education, and use this model to address questions regarding the optimal use of such forums. While a range of factors, including psychology and user interface design, will clearly play a role in participation on these forums, we argue using our model that a gametheoretic analysis of incentives can provide a useful framework for understanding many of the tradeoffs that have emerged in discussions of education forums thus far. In particular, our model requires very few ingredients to define formally yet exhibits rich behavior, including some of the subtle tradeoffs in class size, instructor activity, and instructor effort level that have been observed qualitatively in early empirical studies of these forums. There is a class of n students, and an instructor, each of whom chooses rates at which to check the class s online forum for new content; a rate of λ corresponds to repeatedly checking the forum according to a Poisson process with rate λ, truncated to a finite time interval ( ). Checking the forum more frequently, i.e., at a higher rate, incurs a higher cost, but potentially also leads to higher benefits, as follows. A student who answers a question is rewarded by the instructor for (usefully, and correctly) answering a question on the forum this reward could either be points awarded by the instructor that count towards the student s grade in the class, or a socialpsychological reward deriving from approval, or endorsement, by the instructor. An instructor rewards students only for answering questions in time, i.e., for answering new questions that have arrived since the last time she visited the forum, as explained in. (Of course, the instructor could choose to reward students for delayed answers as well, but as our analysis will show, this does not create the right incentives for participation). Given a rate µ chosen by the instructor, each student therefore chooses the rate λ at which he checks the forum to trade off cost and benefit: choosing a high value of λ comes at a large cost in effort (the student needs to be frequently checking the forum), but increases his expected benefit since there is a higher chance that he will see and answer questions in time to receive rewards from the instructor. In addition, if the nature of the question is such that multiple answers are redundant, a higher rate also increases the student s chance of providing a useful, nonredundant answer, since
3 only useful answers are rewarded by the instructor. This gives us a game where the instructor moves first by choosing her rate µ, and the students move second, choosing their rates λ as a best response to µ, and possibly also as a best response to each other s rates, depending on the type of the question. We explore how an instructor s choice of behavior, modeled by her rate choice µ, affect both her own utility the difference between the welfare of the student asking the question and the instructor s cost from her rate choice as well as the overall behavior of the forum, for two representative question types. We obtain an essentially complete characterization of the forum s behavior for both types of questions, which turn out to lead to very different outcomes. Openended questions. Openended or discussionstyle questions are those where a student can generate value by answering even if other students have already provided answers earlier, so any student who answers the question in time receives a reward. So here the students are not competing with each other, but only racing against the instructor. We find that the student s response rate λ for openended questions is nonmonotone in the instructor s choice of rate µ: as µ increases upward from 0, it initially causes the student to move faster (to answer the question in time), but as µ becomes too large, the reward from answering is no longer worth the cost it would require to make λ sufficiently large, and the student s choice of rate λ begins dropping back toward 0. We note that this nonmonotonic dependence of the student s rate λ on the instructor s rate µ has been motivated in earlier writings about educational forums [Andresen 009; Gray 004; Hanover Research Council 009] on qualitative grounds: when students see a highly active instructor on the forum, they conclude that it s either hopeless or not useful to keep up, and they start to drop out. 1 What is striking here is that this qualitative reasoning is captured formally within our model by the optimization performed by strategic agents. Singleanswer questions. Singleanswer questions are those with a short welldefined correct answer, where only the first student provides a nonredundant answer and therefore earns a reward. So here, students compete amongst themselves to be the first one to provide an answer, in addition to racing to arrive before the instructor in order to receive their reward. Thus for any announced rate µ by the instructor, the students are playing a simultaneousmove game in which their strategies are their choices of rate. We show that for every µ, this game has a unique symmetric Nash equilibrium in which all students choose the same rate λ, and we study this rate as a prediction for how the forum will operate and how the instructor should choose µ. In contrast to the case of openended questions where the rate of arrival of the first answer scales linearly with class size n, we find that in equilibrium, the first answer to such singleanswer questions arrives at a rate that is almost independent of the class size n in equilibrium each student in a large class slows down his own rate λ to an extent great enough that it offsets the gains from having many students trying to answer the question. Moreover, this slow race among the students is very hard for the instructor to influence through her choice of µ: for n, the equilibrium value λ is maximized at µ = 0. This principle that a large class slows itself down suggests interesting potential limitations on the power of large classes to provide crowdsourced responses in the singleanswer case, and arises from an underlying mechanism that is intuitive: in a large class, each student reasons that his chance of being the first to answer a (singleanswer) question is so low that it is not worth checking the class forum very often if it only contains singleanswer questions. We then investigate the instructor s utility U I (µ), which is the the utility derived by the question asker minus the instructor s effort cost from checking the forum at rate µ. We discover that as a function of µ, the instructor s utility U I (µ) can in fact be bimodal, with two local maxima: the optimal utility is achieved either by choosing µ 0 and letting the race among the students do its 1 Quoting from [Hanover Research Council 009], During the discussion process, it is important that instructors continuously manage students ideas and further facilitate interactions. However, if the online discussion is going well without instructor feedback, it is often best for teachers to wait to jump into the discussion until the students responses are waning.... Or in the words of an online forum moderator in Gray [Gray 004], I was conscious of Burge, Laroque, and Boak s (000) caution that moderators could not afford to get trapped into the Atlas syndrome of holding up the discussion world and consciously waited for other voices to be heard rather than making postings every day. X:3
4 X:4 work, or by choosing a particular µ > 0 in which the students are essentially driven out of the forum and the instructor answers the questions herself. Which of these two local maxima is higher depends on how the instructor values the cost of her own effort. In between, there is an intriguing local minimum in the utility where, essentially, the instructor is using the forum the wrong way in which the instructor s rate µ suppresses the students effort in a manner that doesn t increase the overall rate at which the question gets answered. The fact that the model produces a local minimum between two more efficient modes of operation is intriguing in the way it aligns with empirical evidence from online forums for education. While there are some differences in setting, Andresen discusses the basic tradeoff between a mode of operation in which students interact with each other, and a mode in which the instructor principally answers the questions on her own [Andresen 009]: In a study that asks the question of what role an instructor should undertake in an asynchronous discussion forum (sage, guide, or ghost), Mazzolini and Maddison (003) found that it depends on what the instructor wishes to accomplish. Learner ratings of a course will show that an instructor is more enthusiastic and expert if s/he increases his/her postings.... However, an instructor that contributes significantly to a discussion tends to decrease the length of discussions (this does not necessarily decrease the quality of the discussion, however) as well as their frequency. What appears to be occurring in this situation is that the instructor can decrease learnerlearner interaction because the learners begin to rely on the instructor to answer questions, becoming the expert or sage to settle debates. Analyzing Mixtures. Finally, we address the question of how an instructor might elicit higher rates from students for singleanswer questions. Recall that each student s rate parameter λ, is a global rate that governs how frequently he checks the forum for the class; by definition it is chosen before any particular question is seen. We show that one way to achieve a speedup with class size for singleanswer questions is to make sure that the forum contains a mixture of singleanswer and openended questions as long as there is any positive probability p that a question in the forum will be an openended question (which might be discussion questions posed by the instructor herself), the instructor can choose µ so as to produce a rate λ such that the rate of arrival of the first response scales linearly with the size of the class, thus obtaining a speedup with class size which is of the same order as in the case of purely openended questions. 1.. Interpreting the Model With any stylized model such as the one presented here, it is useful to consider what qualitative conclusions and recommendations it suggests. Our present model is very simple to formulate it just reflects the balance between the cost of checking the forum frequently and the benefits of getting rewarded for answering questions and hence the phenomena it captures seem to be arising intrinsically from this tension, rather than from any more complicated modeling artifacts. Moreover, these phenomena, while fairly subtle, align well with evidence from empirical studies of the kind noted earlier. Our analysis leads to qualitative recommendations (within the stylized setting of our model) for how to optimize the performance of the forum by carefully choosing the instructor s behavior. A first conclusion is that for motivating individual student effort, it is important to find an optimal operating point between motivating students to move quickly and not pushing them to move so quickly that the effort cost leads them to drop out of the system. A second conclusion is that when only a single reward is (meaningfully) available (as in a singleanswer question), having many students compete for it may not actually be so productive, because students will scale back the effort they expend in the face of a low probability of receiving the reward. Given this phenomenon, the instructor needs to avoid strategies (such as the local minimum that arises in our singleanswer model) where she puts in effort that simply has the effect of suppressing student activity without improving the performance of the forum overall. A final qualitative recommendation from the model is that if the instructor can create reasonable mechanisms by which more than one student is rewarded for the
5 same question, the behavior of the system can transition at least partially toward the faster operation it experiences with openended questions; our analysis of mixedquestion forums in 5 shows one way to achieve this speedup Related work As noted above, there has been research into the use of online forums for education focusing on empirical and qualitative evaluation based on experience with such forums [Andresen 009; Burge et al. 000; Gray 004; Hanover Research Council 009; Mazzolini and Maddison 003]. There is also a large and growing body of work on generalpurpose online Q&A forums such as Y! Answers and StackOverflow starting with Adamic et al. [008]; most of this literature is empirical, documenting and analyzing usage patterns and user behavior from data or qualitative studies on these forums. There is much less prior work on mathematical models and the design of incentives for online Q&A forums; we discuss these below. Chen et al. [009] study Q&A forums such as Y! Answers in a gametheoretic model in which each user has a unique piece of information to contribute to a question, and a user who submits an answer at some time can aggregate all previous answers into her answer. Their work analyzes the equilibria elicited by a bestanswer mechanism where the asker awards a point to the best answer received for complements and substitutes information types in terms of the round in which agents supply their answers. They show that a bestanswer rule is effective for substitutes information but not for complements information, where an approvalvoting scoring rule and a proportionalshare scoring rule can enable the most efficient equilibrium. In their model, agents do not have any cost to answering a question, and their strategic choice of when to answer is driven only by the desire to obtain the reward handed out to the best (or best k or valueproportional, depending on the mechanism) answer. Our model differs in two significant aspects, since agents in our model (i) have a cost to the rate at which they check the forum, which is what drives any delays in answering, and (ii) cannot incorporate (or are not rewarded for incorporating) previous contributions into their answer to beat previous answers to obtain a reward. These two differences lead to an entirely different model of strategic behavior and outcomes. Ghosh and Hummel [01] focus on the bestanswer type of mechanisms used by Q&A sites such as Y! Answers, and investigate implementability, asking whether this family of conteststyle mechanisms is adequate to elicit optimal outcomes when potential answerers are strategic agents, and how payoffs must be structured to incentivize this desired optimal behavior in terms of the quantity and quality of answers elicited in a simultaneous contribution model. Kumar et al. [010] study online Q&A sites in the context of network effects in twosided markets and the rate of arrival of new questionaskers (and answerers) as a function of the number of current answerers and questionaskers in the system, both empirically and theoretically. They show that the two sides of the market can display radically different patterns, and also investigate competing platforms. Finally, we note that there is some very recent work on various research challenges arising in the context of online education via massive online open courses (MOOCs). Our work studies models for online forums for education, whether for standard courses taught in offline classrooms or online ones, and intersects with the research on MOOCs to the extent that most MOOCs use Webbased forums as a platform for communication with and between students in the class.. MODEL In this section, we present a gametheoretic model for online forums for education, the central component of which is the strategic choice of rates by agents the presence of an instructor who can monitor answer quality and reward only goodenough contributions allows us to focus on the rate of participation as the strategic choice variable in a model without qualities (or where all answers have equivalent qualities), a simplification which is less justifiable in general online Q&A forums. Students and the instructor choose rates with which to check the online forum for the class, and students are rewarded when the instructor arrives and finds that a student has (usefully) answered a question on the forum. A higher rate incurs a higher cost, but can also lead to higher X:5
6 X:6 benefit to a student by increasing the probability of arriving before the instructor and thereby earning a reward. This leads to a sequential game where the instructor moves first by choosing her rate, and the students move second, choosing their rate as a best response to the rate chosen by the instructor, and possibly the rate choices of remaining students, as described formally next. There is a class of n students and an instructor. Questions arrive over a time interval [0, T ], and the students and the instructor periodically check the forum and provide answers to these questions, via a process defined below. We refer to the individuals providing the questions as the questionaskers or simply the askers, and the individuals providing the answers as the students..1. Rates Each student and the instructor choose a rate at which to check the class s online forum for new content arriving in the interval [0, T ]. Student j chooses a rate λ j, and repeatedly checks the forum according to a truncated Poisson process with rate λ j that is, (i) if j has just checked the forum at time t, then he will next check it at time t + X, where X is an exponential random variable with rate λ (i.e., with probability density function f(x) = λe λx for x 0); and (ii) j runs this process until the first time that he checks the forum after time T, at which point the process ends. Intuitively, the student s random variable X acts like an alarm clock when the alarm rings at some time t, the student checks the forum and then resets the alarm, so that it next rings at time t + X. We will allow a student to choose λ j = 0: while one cannot define an exponential random variable of rate 0, we use λ j = 0 to simply mean that the student never checks the forum. We suppose that if a student checks the forum and finds a question that still needs an answer, he can provide one. While obviously not always true, we note that this is not a limiting assumption our model can be easily extended to a include a probability s j that a student will have an answer to supply for a random question (the current model corresponds to the special case where s j = 1). Extending the model to include this probability complicates the analysis but not does not change the qualitative conclusions, so we omit it here for clarity given the limited space. The instructor also chooses her own rate µ at which to check the forum, also according to a truncated Poisson process as described above. When the instructor arrives according to her random process of rate µ, she closes the (new) questions she finds there, supplying an answer (if necessary) to these questions and handing out all appropriate rewards (as described later). Once a question is closed, no further rewards can be obtained by answering the question this could be either because the instructor explicitly disables any further answers to the question, or because no further points will be handed out even if answers can be supplied, or perhaps because no one will read any answers beyond those supplied by the instructor in the case of socialpsychological rewards from answering questions. An instructor is also allowed to choose a rate µ = 0, although with a different interpretation. A zero rate for the instructor means that questions are never closed so that a (useful, nonredundant) answer is always assigned a reward no matter how late it arrives Exponential rates. Exponential random variables have a number of nice properties that makes their analysis particularly tractable. The first is the socalled memoryless property : FACT.1. Let X be an exponential random variable with rate λ. Conditioned on the information X t 0, the random variable X t 0 is also an exponential random variable of rate λ. That is, if we know that the alarm has not rung until time t 0, then starting at time t 0 it behaves as though the alarm had just been freshly reset at t 0. Later in this section, we will use this property For simplicity, we will consider the askers and the students here as two disjoint populations, but one can also model the case in which the asker on each individual question is drawn from the population of students.
7 to show that we can reduce the problem of analyzing participants behavior over the entire time interval to the analysis of their behavior on a perquestion basis. We also note two other standard facts about exponential random variables that will be very useful in parts of the analysis. FACT.. If X 1 and X are exponential random variables with rates λ 1 and λ, then Pr [X 1 < X ] = λ 1 λ 1 + λ. FACT.3. If X 1,..., X n are exponential random variables with rates λ 1,..., λ n, then min(x 1,..., X n ) is an exponential random variable with rate λ λ n... Utilities The utility is the difference between an agent s (student s or instructor s) benefit and her cost, which we describe next. Benefits. Rewards are allocated to students by the instructor on a perquestion basis. Students are rewarded when the instructor arrives and ascertains that a student has (correctly and usefully) answered a new question on the forum this reward could either be in the forms of points awarded by the instructor that count towards the student s grade in the class, or because the student derives a socialpsychological reward from the instructor s approval or endorsement 3, or from providing a useful answer to her fellow students. Once the instructor arrives and closes a question, no further rewards can be obtained from answering that question as discussed before, this could be either because the student derives value only when the instructor sees that she has usefully answered a question (either because points are only awarded for such answers, or because the student s reward is the psychological value of the instructor s approval), or because the student derives value from having her fellow students read her answer and no answers beyond the instructor s are read by other students. We note that our model is agnostic on the question of what causes a student to feel rewarded from answering a question, and applies to a spectrum of possible underlying reasons for rewards. We use v to denote the value of each individual reward to a student. Let the random variable R jq be equal to 1 if student j receives a reward for answering question q, and be equal to 0 otherwise. Whether an answer generates value, and therefore merits a reward, is different for the two types of questions discussed in 1. In our definition of openended or discussionstyle questions, an answer adds value even if other answers appear earlier, so that any student who answers before the instructor closes the question can receive a reward (recall our assumption, discussed earlier, that students have correct answers to questions). On the other hand, for singleanswer questions, only the first student to see the question will answer, because subsequent answers would be redundant (which are not rewarded, so that we can assume that students don t bother to supply redundant answers). We derive the specific forms of the reward functions for these two types of questions in 3 and 4 respectively. We assume that the student incurs a fixed cost ξ for writing an answer to a question; because a student will only write an answer when the reward received for it is at least ξ, it makes sense to think not about the pure reward v but the net reward v = v ξ. Costs. We assume that for each student, checking the forum for new content incurs an effort cost of α each time the forum is checked, whether or not there is new content to react to. (If the student does react to new content, this incurs the effort cost of ξ noted above, which is folded into the net reward v = v ξ.) Similarly, the instructor incurs a cost of β each time she checks the forum. Arrival of Questions and Overall Utility. Questions arrive over the time interval [0, T ] according to a Poisson process with rate 1 that is, we imagine questions being generated by a rate1 Poisson X:7 3 Piazza, for instance, explicitly offers an instructor endorsement feature on its forums.
8 X:8 process defined over the positive real numbers, and then we only keep the subset of questions that arrive in [0, T ]. (The choice of 1 here provides the units of the time scale in which all other rates are measured.) Let Q denote this set of questions, and let C j denote the set of times at which student j checks the forum. Then student j s overall utility (recall that v is the net reward) is the expectation of vr jq q Q h C j α, reflecting the net rewards from each question and the cost for each checking of the forum..3. Reduction to the Case of a Single Question Because of the memoryless property of the exponential distribution, we can effectively consider each question that appears on the forum over the duration of the course in isolation, as follows. Recall that each student (and the instructor) runs his process from 0 until the first time that his exponentially distributed alarm clock rings after time T. Thus, since each question q appears before time T, all participants alarm clocks are still running when q arrives, and by the memoryless property we can thus imagine that these alarm clocks are all started at this point of arrival. It follows that for a student j and any two questions q and q, the random variables R jq and R jq have the same distribution; let R j denote a random variable with this shared distribution. Hence, by Wald s Theorem, we can write student j s overall utility as E vr jq = ve [ Q ] E [R j ] αe [ C j ]. q Q h C j α Since the questions are arriving at rate 1 over the interval [0, T ], we have E [ Q ] = T. For E [ C j ], we observe that the times at which student j checks the forum consist of draws from a rateλ j Poisson process over [0, T ], followed deterministically by one additional check of the forum (the first one that the process generates after T ). Hence we have E [ C j ] = λ j T + 1, and so j s utility is ve [R j ] T α(λ j T + 1) = (ve [R j ] αλ j )T α. T and α are independent of student j s choice of λ j, but E [R j ] depends on λ j, since a faster rate of checking the forum leads to a greater chance of receiving a reward. We can thus think of j as strategically choosing λ j to optimize the objective function ve [R j ] αλ j, and this is the basic form of the problem we consider. We make one further simplication we will focus in this exposition on the case in which the net reward v = 1, so the objective function representing student j s utility maximization problem is E [R j ] αλ j. This is purely for simplicity, and arbitrary values of v are handled completely analogously. The Instructor s Utility. For the instructor s utility, we can use a direct analogue of the reduction above and focus on her utility for a single question. The instructor s utility on a single question is the difference between her timediscounted value from the answers contributed to the question and her effort cost βµ from checking the forum at a rate µ; as with the students, the form of this utility depends on on whether the question is openended or a singleanswer question. The instructor derives benefit from the asker of the question getting an answer (for singleanswer questions) or answers (in discussion questions) as quickly as possible. We model this by saying that the value of a (useful, nonredundant) answer is discounted exponentially, so that if it arrives at time t after the question was asked, it has value e δt for a parameter δ > 0. Thus, if a question receives k answers potentially including the instructor s own answer at times t 1, t,..., t k (note that k = 1 for a
9 X:9 singleanswer question 4 ), then the instructor s utility in this realization of the process is k e δti βµ. i=1 In both 3 and 4, we will be considering the expected value of this expression, when the times t i arise from the random process of checking the forum according to the rates λ chosen (in equilibrium) by the students, and the rate µ chosen by the instructor..4. Summary of Parameters The reduction above allows us to consider the problem of equilibrium rates in the context of a single question that arrives at time 0; all strategies and utilities will be defined in the context of this single question, keeping in mind that this in fact captures the behavior of the system for the full set of questions arriving over [0, T ], Beyond the number of students n, the model thus has three basic parameters: α, β, and δ, each with a simple interpretation. The parameters α and β represent how the students and the instructor value the effort they have to put into the forum (for example, a large α means students view checking the forum as a costly activity, which affects how they set λ). The parameter δ models the impatience of the asker: a large value of δ means that answers that take longer to come in create significantly less value than answers that come in right away. 3. OPENENDED QUESTIONS We begin by considering openended questions, in which the questionasker benefits from all answers that come in, and hence students will continue to contribute answers until the instructor closes the question. As a result, the students are not competing against each other to provide answers quickly; each student is instead optimizing his choice of rate λ based solely on the instructor s choice of rate µ. Our first result shows that the student s response rate λ for openended questions is nonmonotone in the instructor s choice of rate µ, and is maximized at a specific intermediate value of µ: as µ increases upward from 0, it initially causes the student to want to move faster (to answer the question before it closes), but as µ becomes too large, the reward from answering is no longer worth the cost it would require to make λ sufficiently large, and the student s choice of rate λ begins dropping back toward 0. THEOREM 3.1. A student s optimal choice of rate λ, as a function of the instructor s rate µ, is given by µ λ(µ) = max{0, α µ}. λ(µ) increases on µ [0, 1 4α ] and decreases beyond, attaining its unique maximum at µ = 1 4α. PROOF. Consider a student with rate x and an instructor with rate µ. The student receives a reward if she arrives and answers the question before the instructor arrives; by Fact., this event has probability x/(x + µ). So the student s payoff from choosing rate x is U S (x) = x x + µ αx. 4 As discussed previously, students do not have an incentive to contribute redundant answers, nor do redundant answers generate value to the asker.
10 X:10 Note that U is concave in x, so to maximize U we set the derivative U S (x) = µ (x+µ) α to zero and solve for x, which gives µ x = α µ. This is the best response for a student when x 0. If x < 0, then the best response is to choose rate 0, since U S (0) = 0 and U S (0) < 0 in this case (U S is concave in x so U S is decreasing, and U S (x ) = 0 for x < 0) this corresponds to the instructor choosing too high a rate µ, specifically µ > α 1 at which point the student simply drops out. Therefore, the student s best response rate when the instructor chooses rate µ is µ λ(µ) = max{0, µ}. (1) α Observe that λ(µ) is nonmonotone in µ: the derivative of λ(µ) with respect to µ, for µ 1 α, is λ (µ) = αµ 1, which is positive for µ 4α so that λ is increasing for 0 µ 4α, and negative for µ > 1 1 4α, so that λ(µ) decreases with as the instructor increases her rate beyond 4α. In particular, we can ask what value of µ causes the student to answer as quickly as possible; this maximum is precisely where the derivative is 0 (note that λ is concave in µ), which is µ = 1 4α. Note that λ(µ ) = µ, so that when the instructor chooses a rate to maximize the rate chosen as a best response by the students, the instructor and students all have the same rate in equilibrium. Note also that at a given µ [0, α 1 ], the probability the student provides an answer before the instructor closes the question is equal to λ(µ) λ(µ) + µ = µα 1 µ µα 1 = 1 αµ, which is decreasing in µ. So for µ close to 0, the student s probability of providing an answer before the question closes at his optimal rate λ(µ) is close to 1; this probability decreases to exactly 1/ at the optimal µ = 1/(4α), and then continues decreasing to 0 as µ reaches 1/α. Overall utility. We now consider how the instructor should choose a rate µ to maximize her utility recall from Section that this utility consists of a benefit equal to the exponentially discounted arrival times of answers, minus a cost βµ due to the instructor s choice of µ. To begin with, let s consider the instructor s utility in the case where she is the only individual providing an answer to the question. If she chooses a rate of x, then the expected benefit of her answer is the expected value of its discounted arrival time, which is 0 e δt xe xt dt = x x + δ. () Equation () has a very clean interpretation the expected value of the discounted arrival time is equivalent to imagining that the questionasker will give up after an amount of time drawn from an exponential distribution with rate δ (the discount parameter), and the benefit of the answer is the probability that it arrives before the asker gives up. Recall that the discount rate δ models the impatience of the asker a large δ corresponds to a fast rate of decay in value on the lefthand of Equation (), and it corresponds to the asker giving up quickly on the righthand side of (). Now let s consider the instructor s full utility function. There is a benefit from each answer provided by a student, plus the benefit of the instructor s own answer, minus the instructor s effort cost. The benefit of a student s answer (provided at rate y) is equal to the probability that it arrives both before the asker gives up (at rate δ) and before the instructor closes the question (at rate µ), since
11 the student will not answer a closed question: 0 e δt e µt ye yt dt = y y + δ + µ. X:11 When the instructor chooses a rate µ, the students will each choose their best response rate λ(µ) (as in (1)), and the instructor s goal is to maximize her utility function U I (µ) = n λ(µ) λ(µ) + µ + δ + µ βµ. (3) µ + δ We now consider the maximum utility achievable in the case when n is large, so that the first term, which is linear in n, is the dominant one in the expression for U I in (3): THEOREM 3.. When µ = α( δ + δα 1 δ), we have U I (µ ) = b n + o(n) where b = 1 α( δ + δα 1 δ); also, there is no µ and b > b for which U I (µ) = bn + o(n). Thus, the rate µ maximizes the instructor s utility to within a term that is sublinear in n. Before presenting the proof, it is worth understanding how the quantities µ and b behave, particularly as we vary the impatience δ of the questionasker. Note that there is a tradeoff between speed and the number of answers received in the utility U I (µ) when µ is very small, students arrive at a much slower rate but more students are likely to find the question open, so that we obtain a larger number of answers, although at later times. As µ increases, students also increase their response rates λ(µ) and arrive faster, but fewer answers are provided since the question closes earlier. When the asker s impatience δ is close to 0, the optimal value µ is close to 0 and b is close to 1: that is, with a very patient asker, the instructor can afford to move slowly to ensure that almost every student contributes close to the full benefit of 1 via their answer. As δ goes to infinity, it follows from Taylor s Theorem that δ + δα 1 δ converges to 1/(α) from below. Hence µ converges to 1/(4α) and b converges to 1 (α)(1/(α)) = 0 from below. This makes sense: as δ increases, so that the asker becomes more impatient, the instructor needs to trade off quantity against speed to induce the students to move more quickly, so she increases her rate up to the µ that, by Theorem 3.1, maximizes the rate of each student. However, each student can only be induced to move at a maximum rate of 1/(4α), which is independent of δ, and so as δ goes to infinity the benefit contributed by each student is converging to 0. We now proceed with the proof of Theorem 3.. PROOF. In the expression for U I in (3), the second and third terms are o(n), so it suffices to find a choice of µ that maximizes the coefficient on n in the first term. Such a choice of µ will lie in the interval [0, α 1 ], since it needs to cause the students to choose a nonzero rate. By Theorem 3.1, when the instructor chooses a rate µ [0, α 1 ], each student chooses the rate λ(µ) = µα 1 µ. Applying this choice of λ in Equation (3), we get U I (n) = B(µ) n + o(n) where µα 1 µ B(µ) = µα 1 + δ. We thus wish to maximize B(µ) over the interval [0, α 1 ]. The function B(µ) is concave in µ over this interval, with a unique maximum where B (µ) = 0. Setting this derivative to 0 yields a quadratic equation in µ: and hence α 1/ µ + δ µ δα 1/ = 0 µ = α( δ + δα 1 δ).
12 X:1 At this value of µ, we have B(µ) = δ + δα 1 α( δ + δα 1 δ) δ + δα 1, which simplifies to B(µ) = 1 α( δ + δα 1 δ). 4. SINGLEANSWER QUESTIONS Singleanswer questions, as the name suggests, are questions with one welldefined correct answer, such as In the homework due tomorrow, were we allowed to assume that x is positive?, or What is the most abundant isotope of carbon?. In singleanswer questions, only the first student to see the question will answer, because subsequent answers would be redundant 5. For singleanswer questions, therefore, students are implicitly competing to be the first to provide an answer so for any particular rate µ chosen by the instructor, students play a simultaneousmove game amongst themselves in which their strategies are their choices of rate. We show that this game has a unique symmetric Nash equilibrium in which all students choose the same rate λ (µ), which we can study as a prediction for how the forum will operate. Note that even when µ = 0 (so that the instructor doesn t close the question, but only grades the outcome of the race once the class is over), the equilibrium rate λ is nontrivial for singleanswer questions, due to the competition among the students. We find that at this equilibrium, the first answer to the question arrives at a speed that is almost independent of the class size n. (There is an additive dependence on n that grows proportionally to 1/n.) Moreover, this slow race among the students is very hard for the instructor to influence through her choice of µ: for n, we will find that the equilibrium value λ (µ) is maximized at µ = 0. Thus, with a singleanswer question, each student in a large class slows down his personal rate, to an extent great enough that it offsets the gains from having many students trying to answer the question. This is a sharp contrast from the case of openended questions, where the students are choosing rates without regard to the behavior of the other students, and hence the rate of the fastest answer in that case scales linearly in n. This principle that a large class slows itself down suggests interesting potential limitations on the power of large classes to provide crowdsourced responses in the singleanswer case, and it arises from an underlying mechanism that is intuitive: in a large class, each student reasons that his chance of being the first to answer a (singleanswer) question is so low that it is not worth checking the site very often. THEOREM 4.1. For any choice of µ by the instructor, there is a unique symmetric equilibrium λ(µ) for the students. In this equilibrium: The students don t participate when µ α 1 ; in this case the instructor answers the question on her own. When µ < α 1, we have λ(µ) = n 1 αn µ n + (n 1) 4α n + µ 4 αn, so that the students do participate 3 along with the instructor, but each at a rate of Θ(1/n) as a function of the class size n. For n, the maximum student rate λ(µ) in equilibrium is achieved when the instructor does not participate (µ = 0). PROOF. Consider a student i with rate x: i receives a reward when she arrives before all the remaining n 1 students and the instructor. The payoff of i, when the other n 1 students all choose rate λ and the instructor chooses rate µ, is (using Fact ): x U(x, λ) = x + (n 1)λ + µ αx. 5 Recall that we assumed in our model that a student who sees a question can supply the correct answer to it, and discussed generalizing this assumption in. Recall also that students are rewarded only for valuable answers, so we assumed that students do not bother to provide redundant or useless answers.
13 X:13 For x to be a best response, U(x, λ, µ) must be maximized at x. Note that U is concave in x, so setting the derivative to zero is a necessary and sufficient condition for an interior maximum. (n 1)λ + µ Taking the derivative and equating to zero, we have = α, which gives us (x + (n 1)λ + µ) (n 1)λ+µ x = α ((n 1)λ + µ). Since we seek a symmetric equilibrium, we want x = λ. This gives us (n 1)λ + µ = nλ + µ, α yielding the following quadratic equation in the variable λ: The solutions to this quadratic are, respectively, αn λ + λ(nµα (n 1)) + (αµ µ) = 0. (λ 1 (µ), λ (µ)) = n 1 αn µ n ± (n 1) 4α n 4 + µ αn 3. (n 1) Since 4α n + µ 4 αn n 1 3 αn, it follows that λ (µ) 0 for any µ. This cannot be the best response since λ is the rate of an exponential and hence must be positive. So the best response of the students when the instructor chooses a rate µ is either λ 1 (µ) if λ 1 (µ) 0, or else it is 0: λ(µ) = max{0, λ 1 (µ)} = max{0, n 1 αn µ (n 1) n + 4α n 4 + µ αn 3 }. Now we investigate the function λ 1 (µ). At µ = 0, λ 1 (0) = n 1 αn. The derivative of λ 1 with respect to µ tells us how the best response rate chosen by the students changes as the instructor increases her rate up from 0, if the best response is to participate: d dµ λ 1(µ) = 1 n αn 3 = (n 1) 4α n + µ 4 αn 3 1 n 1 1. αn (n 1) 4α n + µ 4 αn 3 d Note that dµ λ 1(µ) is decreasing in µ. At µ = 0, the derivative evaluates to d dµ λ 1(µ) = 1 [ ] 1 0 n n for all n. Since the derivative is decreasing in µ, and nonpositive at µ = 0, this means that λ 1 (µ) is maximized at µ = 0, as long as n. Now, the value of λ 1 at µ = 0 is λ(0) = n 1 αn > 0, so the value of µ that maximizes λ(µ) = max{0, λ 1 (µ)} is µ = 0, as long as n. That is, if there are at least two students in the class (and we need at least two students for there to be a race between students to first supply the correct answer), the instructor can maximize the rate of response of the students by choosing the lowest possible rate for herself, i.e., by setting µ = 0. Note that for any n, λ 1 (µ) becomes 0 at µ 0 = 1 α. (Since the derivative of λ 1(µ) is decreasing in µ and nonpositive at µ = 0, and λ 1 (0) > 0, λ 1 (µ) crosses zero exactly once for µ 0). Therefore, the students best response rate λ(µ) behaves as follows: λ(µ) = n 1 αn µ (n 1) n + 4α n 4 + µ αn 3, for µ [0, 1 α ] 0, for µ 1 α.
14 X:14 Finally, we consider what the instructor should do to maximize her utility, and here too we find a complex but fairly intuitive phenomenon at work. Recall that the instructor s utility U I is based on the speed at which the question is answered (either by her or by one of the students), minus the effort cost created by checking the forum at rate µ. When we study this utility U I (µ) as a function of µ, we discover that for a small enough effort coefficient β on the part of the instructor, U I (µ) is in fact bimodal, with two local maxima: the optimal utility is achieved either by setting µ = 0 and letting the race among the students do its work, or by choosing a particular µ > 0 in which the students are essentially driven out of the forum and the instructor answers the questions herself. Which of these two local maxima is higher depends on how the instructor values the cost of her own effort. In between, there is an intriguing local minimum in the utility essentially, when the instructor is using the forum the wrong way in which the instructor s choice of rate µ suppresses the students effort in a manner that doesn t increase the overall rate (i.e., including both the instructor and the students) at which the question gets answered. To begin the analysis of this phenomenon, we write down the utilities involved. For singleanswer questions, the asker derives utility from the first (and only) answer to her question, which is discounted as before by the time at which this first answer arrives. Again, if the asker discounts time by an exponential factor δ, the expected utility from an answer arriving at time t is e δt. The time of arrival of the first answer, when the instructor chooses a rate of µ (and answers the question if she arrives first), and the students choose a rate λ(µ), is exponentially distributed with rate nλ(µ) + µ. So the expected utility to the asker is 0 e δt (nλ(µ) + µ)e (nλ(µ)+µ)t dt = nλ(µ) + µ nλ(µ) + µ + δ. The instructor would like to maximize her own utility which is the difference between the asker s utility, and her own cost to choosing a rate µ, i.e., to choose a rate µ that maximizes U I (µ) = nλ(µ) + µ nλ(µ) + µ + δ βµ. We now formalize the bimodal properties of U I in this setting. THEOREM 4.. For n sufficiently large in terms of α, β, and δ, the following holds. δ If β < (δ + α 1 ), the instructor s utility function U I(µ) has two local maxima: one at µ = 0, and the other at a point µ > α 1. In between, U I has a local minimum at µ = α 1. There is a threshold cost β such that the second local maximum has greater utility than the first if and only β < β. δ If β > (δ + α 1 ), the instructor s utility function U I(µ) decreases monotonically in µ, with a single maximum at µ = 0. PROOF. First we consider what happens if the instructor chooses a rate µ < α 1. Recall from Theorem 4.1 that the students will participate for such µ, and so the combined rate will be nλ(µ)+µ. We use φ(µ) to denote this combined rate; so by the definition of the instructor s utility we have U I (µ) = φ(µ) φ(µ)+δ βµ, and from Theorem 4.1, we have φ(µ) = n 1 αn + (n 1) 4α n + µ αn. Differentiating the instructor s utility, we get U I (µ) = δφ (µ) (φ(µ)+δ) β. Now, φ (µ) = 1 αn 1, (n 1) 4α n + µ αn
15 X:15 which goes to 0 as n diverges, so that the first term in U I (µ) also goes to 0 in n. Thus we see that for sufficiently large n, U I (µ) < 0 for µ < α 1. It follows that µ = 0 is a local maximum of the instructor s utility when n is large enough. Next we consider what happens if the instructor chooses a rate µ α 1. In this case the students will not participate so that the combined rate φ(µ) = µ, and so the instructor s utility is given by U I (µ) = µ βµ. If we consider this as a function over all µ 0, it is concave, with a unique µ+δ local maximum at µ = max { 0, } δ β δ. But this is the correct expression for the instructor s utility only if µ α 1, i.e., once the students have droppedout, so we need to ask when this local maximum µ exceeds α 1. The condition for µ > α 1 δ is β δ > 1 δ and hence β < α (δ + α 1. We thus have two cases (again keeping in ) mind that n is sufficiently large): δ When β < (δ + α 1 ), the instructor s utility has a second local maximum µ (in addition to µ = 0) at a value of µ beyond α 1 this local maximum corresponds to the instructor answering the question alone with no help from the class, at a rate which optimally trades off her cost to checking the forum and her benefit from the asker receiving an answer quickly. δ On the other hand, when β > (δ + α 1 ), then U I(µ) is monotonically decreasing as soon as µ α 1 this is because the concave function µ µ+δ βµ is decreasing beyond its maximum, i.e., for µ µ, and µ < α 1. Hence µ = 0 is the only local maximum for this range of β. δ Finally, in the case when β < (δ + α 1, we can ask which of the two local maxima 0 or µ ) achieves a higher utility. The utility at the local maximum µ = 0 is U I (0) = φ(µ) φ(µ) + δ = The utility at the other maximum µ is given by n 1 αn n 1 αn + δ αδ. U I (µ ) = (1 βδ). Now we observe that as β goes to 0, so that the instructor s effort becomes less and less costly, the utility U I (µ ) converges to 1 while U I (0) remains bounded below 1. Thus there is a β such that when β < β, the second local maximum, when the instructor answers the question on her own, has the higher utility. In the limit as n, the utility U I (0) 1 is converging to 1 + αδ, and so the crossover point where U I(0) = U I (µ ) is converging to the solution of (1 βδ) 1 = 1 + αδ, which is β = 1 δ ( δα ).
16 X:16 5. MIXED FORUMS In this section, we address the question of how an instructor might elicit higher rates from students for singleanswer questions, and show that one way to offset some of the slow behavior arising from singleanswer questions is by ensuring that the forum contains a mixture of singleanswer and openended questions. We imagine that each question is openended with probability p > 0 and singleanswer with probability 1 p. Each student s λ parameter, however, is a global rate that governs how frequently he checks the site; by definition it must be chosen before any particular question is seen. When the student checks the site (according to rate λ), he may sometimes find an openended question, and sometimes a singleanswer question. As before, we find that there is a unique symmetric equilibrium λ for any choice of µ. Our main result here is that the instructor can choose µ so as to elicit a rate λ that is roughly p times what it is in the case of purely openended questions, and this is tight for large n. In this way, the rate at which the 1 p fraction of singleanswer questions get answered benefits significantly from the presence of even a small positive fraction p > 0 of openended questions they are essentially sped up by a linear amount (in n) when p is any constant. THEOREM 5.1. Let p be the probability that a question is openended. The instructor can choose a rate µ such that the equilibrium student rate λ satisfies λ p. Moreover this is essentially 4α tight in the limit, in the following sense: For any ε > 0, there exists a large enough n so that with at least n students, there is no µ the instructor can choose so as to achieve λ (1 + ε)p. 4α PROOF. Suppose the instructor chooses rate µ; we want to determine the best response rate λ chosen by the students. Using the payoffs derived in 3 and 4, the payoff to a student who chooses rate x when the instructor has rate µ and the remaining n 1 students choose rate λ is x x U(x) = p + (1 p) x + µ x + (n 1)λ + µ αx. As usual, for x to be a best response, a necessary condition is for U (x) to be zero, which gives us µ p (x + µ) + (1 p) (n 1)λ + µ (x + (n 1)λ + µ) α = 0. Since we are looking for a symmetric equilibrium, we set x = λ, which gives us the following equation in λ: µ 1)λ + µ p + (1 p)(n (λ + µ) (nλ + µ) = α. (4) Note that (4) can be interpreted as a bivariate equation in the two variables λ and µ; for a given value of µ, if there is a solution λ(µ) 0 to this equation, then λ(µ) is a best response to µ. p We first identify a choice of µ for which the equilibrium value λ(µ) is at least. It turns out 4α that this can be achieved using a µ for which λ(µ) = µ, as follows. In order to have an equilibrium in which λ(µ) = µ, we simply need a pair (µ, λ) satisfying Equation (4) for which µ = λ. Setting µ = λ in (4), we get leading to p λ nλ + (1 p) 4λ (n + 1) λ = α, λ = p + 4 n+1 (1 p) p 4α 4α, (5)
17 X:17 as desired. This gives us a lower bound on the fastest possible equilibrium λ, by demonstrating the value of λ achieved at a particular carefullychosen equilibrium. Next we will show that as n becomes large, this lower bound is essentially the best possible. To do this, fix any constant ε > 0, choose σ small enough that (1 σ)(1+ε) > 1, and then choose n large enough in terms of ε, p, and σ so that 4 < σ. Now suppose by way of contradiction that pn for some choice of µ, there is a pair (µ, λ) that solves the bivariate equation (4) with λ Then we have µ 1)λ + µ α = p + (1 p)(n (λ + µ) (nλ + µ) µ nλ + µ p + (1 p) (λ + µ) (nλ + µ) µ = p (λ + µ) + (1 p) 1 (nλ + µ) µ p (λ + µ) + 1 nλ µ p (λ + µ) + 4α pn µ < p (λ + µ) + σα, (1 + ε)p. 4α and hence µ p > (1 σ)α. (λ + µ) p Writing r = (1 σ)α, this implies an upper bound on λ via the inequality λ < rµ µ. Now, over all µ 0, the righthand side of this inequality is maximized at µ = r/4, where it takes the value r/4, and hence we have λ < r/4 = p 4(1 σ)α (1 + ε)p <. 4α (1 + ε)p This last inequality contradicts our assumption that λ. 4α Thus, as long as there is any positive probability p that a question in the forum will be an openended question (which might be discussion questions posed by the instructor herself), the instructor can choose µ to produce a rate λ such that the rate of arrival of the first response to any question on the forum scales linearly with the size of the class, obtaining a speedup with class size which is of the same order as in the case of purely openended questions. 6. DISCUSSION In this paper, we introduced a gametheoretic model for online forums for education, and investigated how an instructor can influence student participation and utility in these forums. For singleanswer questions, we find that the instructor has very little influence over the rate at which students participate in the forum, especially as the class size grows larger and larger here, the rate of response is driven almost entirely by the students competition amongst each other to arrive first to supply the answer. However, when the instructor is optimizing for the speed at which questions are answered, taking into account her own ability to spend effort on producing answers, a
18 X:18 more complex effect emerges in which the most efficient behaviors of the forum are clustered into two modes one in which the instructor steps back and lets the students compete to answer, and one in which she effectively goes it alone. The instructor s participation plays a very different role in openended questions. First, the instructor must choose a rate µ > 0 if she would like the students to at all contribute the forum if µ = 0, the students choose a rate λ(µ) = 0 as well. Second, the students response rate λ varies nonmonotonically in the instructor s rate; as noted earlier, this provides an interesting strategic basis for the observation that students will increase their effort in the presence of an active instructor up to a point, but then start to give up if the instructor is too active [Gray 004; Hanover Research Council 009]. It is also interesting to note the way in which the student s rates range very widely as the instructor s rate ranges over values in the interval µ [0, 1 α ], where α is the students cost parameter: each student s rate increases from 0 at µ = 0 until the optimal value µ = 1 4α that elicits the fastest responses from the students, and then falls back to 0 at µ = 1 α. Thus, the overall response rate of the class, nλ, ranges all the way from 0 to n 4α and back to 0 over this interval µ [0, 1 α ]. When α is small, so that students consider effort to be inexpensive, this can be a reasonably gradual effect in µ. But for large α, the effect happens over a narrow interval; this means that for a class where students have a high cost to frequently checking the forum, the behavior of the forum is very delicate and changes dramatically over a very small interval of the instructor s rate in [0, 1 α ]. Such sensitivity to the underlying parameters connects in intriguing ways to types of delicate behavior observed in real online forums, where small shifts in activity level can lead to wide changes in participation rate. Among the natural questions for further work, a fundamental one that connects to this point about sensitivity is to ask how an instructor might learn the optimal rate to use for her forum. While we do not attempt to formally address this question here, note that the response rate for singleanswer questions is essentially insensitive to the instructor s choice of rate, but does depend on the students cost parameter α in our stylized model. This suggests that an instructor could initially use singleanswer questions to learn the students cost parameters from their response rates to these questions, and use this to infer the optimal rate µ that she should use for openended questions. More broadly, developing a model for learning parameter values to optimize student participation, as well as modeling learned behavior and evolution of response rates in such online education forums is an interesting open direction for further work. REFERENCES ADAMIC, L., ZHANG, J., BAKSHY, E., AND ACKERMAN, M Knowledge sharing and Yahoo! Answers: Everyone knows something. Proc. 17th International World Wide Web Conference. ANDRESEN, M. A Asynchronous discussion forums: success factors, outcomes, assessments, and limitations. Educational Technology & Society, 1 (1). BURGE, E., LAROQUE, D., AND BOAK, C Baring professional souls: Reflections on Web life. Journal of Distance Education, 15(1). CHEN, Y., JAIN, S., AND PARKES, D Designing Incentives for Online Question and Answer Forums, Proc. ACM EC. GHOSH, A. AND HUMMEL, P. 01. Implementing Optimal Outcomes in Social Computing: A Gametheoretic Approach, Proc. 1st International World Wide Web Conference. GRAY, B Informal Learning in an Online Community of Practice. J. Distance Educ.. 19(1). HANOVER RESEARCH COUNCIL Best Practices in Online Teaching Strategies. KUMAR, R., LIFSHITS, Y., AND TOMKINS, A Evolution of twosided markets, Proc. 3rd ACM International conference on Web Search and Data Mining (WSDM 10). MAZZOLINI, M. AND MADDISON, S Sage, guide or ghost? The effect of instructor intervention on student participation in online discussion forums. Computers & Education, 40(3). TOPPING, K. AND EHLY, S PeerAssisted Learning, Lawrence Erlbaum.
X Incentivizing Participation in Online Forums for Education
X Incentivizing Participation in Online Forums for Education Arpita Ghosh, Cornell University Jon Kleinberg, Cornell University We present a gametheoretic model for online forums for education, where
More informationUnraveling versus Unraveling: A Memo on Competitive Equilibriums and Trade in Insurance Markets
Unraveling versus Unraveling: A Memo on Competitive Equilibriums and Trade in Insurance Markets Nathaniel Hendren January, 2014 Abstract Both Akerlof (1970) and Rothschild and Stiglitz (1976) show that
More informationMoral Hazard. Itay Goldstein. Wharton School, University of Pennsylvania
Moral Hazard Itay Goldstein Wharton School, University of Pennsylvania 1 PrincipalAgent Problem Basic problem in corporate finance: separation of ownership and control: o The owners of the firm are typically
More informationChapter 7. Sealedbid Auctions
Chapter 7 Sealedbid Auctions An auction is a procedure used for selling and buying items by offering them up for bid. Auctions are often used to sell objects that have a variable price (for example oil)
More informationSharing Online Advertising Revenue with Consumers
Sharing Online Advertising Revenue with Consumers Yiling Chen 2,, Arpita Ghosh 1, Preston McAfee 1, and David Pennock 1 1 Yahoo! Research. Email: arpita, mcafee, pennockd@yahooinc.com 2 Harvard University.
More informationSharing Online Advertising Revenue with Consumers
Sharing Online Advertising Revenue with Consumers Yiling Chen 2,, Arpita Ghosh 1, Preston McAfee 1, and David Pennock 1 1 Yahoo! Research. Email: arpita, mcafee, pennockd@yahooinc.com 2 Harvard University.
More informationSupplement to Call Centers with Delay Information: Models and Insights
Supplement to Call Centers with Delay Information: Models and Insights Oualid Jouini 1 Zeynep Akşin 2 Yves Dallery 1 1 Laboratoire Genie Industriel, Ecole Centrale Paris, Grande Voie des Vignes, 92290
More informationGame Theory and Poker
Game Theory and Poker Jason Swanson April, 2005 Abstract An extremely simplified version of poker is completely solved from a game theoretic standpoint. The actual properties of the optimal solution are
More informationInflation. Chapter 8. 8.1 Money Supply and Demand
Chapter 8 Inflation This chapter examines the causes and consequences of inflation. Sections 8.1 and 8.2 relate inflation to money supply and demand. Although the presentation differs somewhat from that
More informationPartial Equilibrium: Positive Analysis
Partial Equilibrium: Positive Analysis This Version: November 28, 2009 First Version: December 1, 2008. In this Chapter we consider consider the interaction between different agents and firms, and solve
More informationGame Theory: Supermodular Games 1
Game Theory: Supermodular Games 1 Christoph Schottmüller 1 License: CC Attribution ShareAlike 4.0 1 / 22 Outline 1 Introduction 2 Model 3 Revision questions and exercises 2 / 22 Motivation I several solution
More information1 Nonzero sum games and Nash equilibria
princeton univ. F 14 cos 521: Advanced Algorithm Design Lecture 19: Equilibria and algorithms Lecturer: Sanjeev Arora Scribe: Economic and gametheoretic reasoning specifically, how agents respond to economic
More informationECON20310 LECTURE SYNOPSIS REAL BUSINESS CYCLE
ECON20310 LECTURE SYNOPSIS REAL BUSINESS CYCLE YUAN TIAN This synopsis is designed merely for keep a record of the materials covered in lectures. Please refer to your own lecture notes for all proofs.
More informationWeek 7  Game Theory and Industrial Organisation
Week 7  Game Theory and Industrial Organisation The Cournot and Bertrand models are the two basic templates for models of oligopoly; industry structures with a small number of firms. There are a number
More informationNotes V General Equilibrium: Positive Theory. 1 Walrasian Equilibrium and Excess Demand
Notes V General Equilibrium: Positive Theory In this lecture we go on considering a general equilibrium model of a private ownership economy. In contrast to the Notes IV, we focus on positive issues such
More informationSensitivity analysis of utility based prices and risktolerance wealth processes
Sensitivity analysis of utility based prices and risktolerance wealth processes Dmitry Kramkov, Carnegie Mellon University Based on a paper with Mihai Sirbu from Columbia University Math Finance Seminar,
More informationI d Rather Stay Stupid: The Advantage of Having Low Utility
I d Rather Stay Stupid: The Advantage of Having Low Utility Lior Seeman Department of Computer Science Cornell University lseeman@cs.cornell.edu Abstract Motivated by cost of computation in game theory,
More informationSome Notes on Taylor Polynomials and Taylor Series
Some Notes on Taylor Polynomials and Taylor Series Mark MacLean October 3, 27 UBC s courses MATH /8 and MATH introduce students to the ideas of Taylor polynomials and Taylor series in a fairly limited
More informationInfinitely Repeated Games with Discounting Ù
Infinitely Repeated Games with Discounting Page 1 Infinitely Repeated Games with Discounting Ù Introduction 1 Discounting the future 2 Interpreting the discount factor 3 The average discounted payoff 4
More informationChapter 21: The Discounted Utility Model
Chapter 21: The Discounted Utility Model 21.1: Introduction This is an important chapter in that it introduces, and explores the implications of, an empirically relevant utility function representing intertemporal
More informationA Simple Model of Price Dispersion *
Federal Reserve Bank of Dallas Globalization and Monetary Policy Institute Working Paper No. 112 http://www.dallasfed.org/assets/documents/institute/wpapers/2012/0112.pdf A Simple Model of Price Dispersion
More informationChapter 17. Network Effects
From the book Networks, Crowds, and Markets: Reasoning about a Highly Connected World. By David Easley and Jon Kleinberg. Cambridge University Press, 2010. Complete preprint online at http://www.cs.cornell.edu/home/kleinber/networksbook/
More informationLecture 3: Solving Equations Using Fixed Point Iterations
cs41: introduction to numerical analysis 09/14/10 Lecture 3: Solving Equations Using Fixed Point Iterations Instructor: Professor Amos Ron Scribes: Yunpeng Li, Mark Cowlishaw, Nathanael Fillmore Our problem,
More informationECON 312: Oligopolisitic Competition 1. Industrial Organization Oligopolistic Competition
ECON 312: Oligopolisitic Competition 1 Industrial Organization Oligopolistic Competition Both the monopoly and the perfectly competitive market structure has in common is that neither has to concern itself
More informationCPC/CPA Hybrid Bidding in a Second Price Auction
CPC/CPA Hybrid Bidding in a Second Price Auction Benjamin Edelman Hoan Soo Lee Working Paper 09074 Copyright 2008 by Benjamin Edelman and Hoan Soo Lee Working papers are in draft form. This working paper
More informationPrices versus Exams as Strategic Instruments for Competing Universities
Prices versus Exams as Strategic Instruments for Competing Universities Elena Del Rey and Laura Romero October 004 Abstract In this paper we investigate the optimal choice of prices and/or exams by universities
More informationOPRE 6201 : 2. Simplex Method
OPRE 6201 : 2. Simplex Method 1 The Graphical Method: An Example Consider the following linear program: Max 4x 1 +3x 2 Subject to: 2x 1 +3x 2 6 (1) 3x 1 +2x 2 3 (2) 2x 2 5 (3) 2x 1 +x 2 4 (4) x 1, x 2
More informationECON 459 Game Theory. Lecture Notes Auctions. Luca Anderlini Spring 2015
ECON 459 Game Theory Lecture Notes Auctions Luca Anderlini Spring 2015 These notes have been used before. If you can still spot any errors or have any suggestions for improvement, please let me know. 1
More informationOn the Interaction and Competition among Internet Service Providers
On the Interaction and Competition among Internet Service Providers Sam C.M. Lee John C.S. Lui + Abstract The current Internet architecture comprises of different privately owned Internet service providers
More informationOn the Efficiency of Competitive Stock Markets Where Traders Have Diverse Information
Finance 400 A. Penati  G. Pennacchi Notes on On the Efficiency of Competitive Stock Markets Where Traders Have Diverse Information by Sanford Grossman This model shows how the heterogeneous information
More informationCHAPTER 3 THE LOANABLE FUNDS MODEL
CHAPTER 3 THE LOANABLE FUNDS MODEL The next model in our series is called the Loanable Funds Model. This is a model of interest rate determination. It allows us to explore the causes of rising and falling
More informationCHAPTER 13 GAME THEORY AND COMPETITIVE STRATEGY
CHAPTER 13 GAME THEORY AND COMPETITIVE STRATEGY EXERCISES 3. Two computer firms, A and B, are planning to market network systems for office information management. Each firm can develop either a fast,
More informationBy Purnima Valiathan Head  Instructional Design Team Knowledge Platform
OVERCOMING THE LIMITATIONS OF MCQS By Purnima Valiathan Head  Instructional Design Team Knowledge Platform KNOWLEDGE PLATFORM WHITE PAPER JULY 2009 Knowledge Platform 72A Tras Street Singapore 079011
More informationarxiv:1112.0829v1 [math.pr] 5 Dec 2011
How Not to Win a Million Dollars: A Counterexample to a Conjecture of L. Breiman Thomas P. Hayes arxiv:1112.0829v1 [math.pr] 5 Dec 2011 Abstract Consider a gambling game in which we are allowed to repeatedly
More informationProbability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur
Probability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur Module No. #01 Lecture No. #15 Special DistributionsVI Today, I am going to introduce
More informationAdaptive Online Gradient Descent
Adaptive Online Gradient Descent Peter L Bartlett Division of Computer Science Department of Statistics UC Berkeley Berkeley, CA 94709 bartlett@csberkeleyedu Elad Hazan IBM Almaden Research Center 650
More informationSoil Dynamics Prof. Deepankar Choudhury Department of Civil Engineering Indian Institute of Technology, Bombay
Soil Dynamics Prof. Deepankar Choudhury Department of Civil Engineering Indian Institute of Technology, Bombay Module  2 Vibration Theory Lecture  8 Forced Vibrations, Dynamic Magnification Factor Let
More informationFacilitating Students Collaboration and Learning in a Question and Answer System
Facilitating Students Collaboration and Learning in a Question and Answer System Chulakorn Aritajati Intelligent and Interactive Systems Laboratory Computer Science & Software Engineering Department Auburn
More information6.207/14.15: Networks Lecture 15: Repeated Games and Cooperation
6.207/14.15: Networks Lecture 15: Repeated Games and Cooperation Daron Acemoglu and Asu Ozdaglar MIT November 2, 2009 1 Introduction Outline The problem of cooperation Finitelyrepeated prisoner s dilemma
More informationBargaining Solutions in a Social Network
Bargaining Solutions in a Social Network Tanmoy Chakraborty and Michael Kearns Department of Computer and Information Science University of Pennsylvania Abstract. We study the concept of bargaining solutions,
More informationThe Method of Lagrange Multipliers
The Method of Lagrange Multipliers S. Sawyer October 25, 2002 1. Lagrange s Theorem. Suppose that we want to maximize (or imize a function of n variables f(x = f(x 1, x 2,..., x n for x = (x 1, x 2,...,
More information2. Information Economics
2. Information Economics In General Equilibrium Theory all agents had full information regarding any variable of interest (prices, commodities, state of nature, cost function, preferences, etc.) In many
More informationIntroduction to time series analysis
Introduction to time series analysis Margherita Gerolimetto November 3, 2010 1 What is a time series? A time series is a collection of observations ordered following a parameter that for us is time. Examples
More informationThe MarketClearing Model
Chapter 5 The MarketClearing Model Most of the models that we use in this book build on two common assumptions. First, we assume that there exist markets for all goods present in the economy, and that
More informationChristmas Gift Exchange Games
Christmas Gift Exchange Games Arpita Ghosh 1 and Mohammad Mahdian 1 Yahoo! Research Santa Clara, CA, USA. Email: arpita@yahooinc.com, mahdian@alum.mit.edu Abstract. The Christmas gift exchange is a popular
More informationFIRST YEAR CALCULUS. Chapter 7 CONTINUITY. It is a parabola, and we can draw this parabola without lifting our pencil from the paper.
FIRST YEAR CALCULUS WWLCHENW L c WWWL W L Chen, 1982, 2008. 2006. This chapter originates from material used by the author at Imperial College, University of London, between 1981 and 1990. It It is is
More informationSPARE PARTS INVENTORY SYSTEMS UNDER AN INCREASING FAILURE RATE DEMAND INTERVAL DISTRIBUTION
SPARE PARS INVENORY SYSEMS UNDER AN INCREASING FAILURE RAE DEMAND INERVAL DISRIBUION Safa Saidane 1, M. Zied Babai 2, M. Salah Aguir 3, Ouajdi Korbaa 4 1 National School of Computer Sciences (unisia),
More informationOnline Appendix Feedback Effects, Asymmetric Trading, and the Limits to Arbitrage
Online Appendix Feedback Effects, Asymmetric Trading, and the Limits to Arbitrage Alex Edmans LBS, NBER, CEPR, and ECGI Itay Goldstein Wharton Wei Jiang Columbia May 8, 05 A Proofs of Propositions and
More informationOligopoly: How do firms behave when there are only a few competitors? These firms produce all or most of their industry s output.
Topic 8 Chapter 13 Oligopoly and Monopolistic Competition Econ 203 Topic 8 page 1 Oligopoly: How do firms behave when there are only a few competitors? These firms produce all or most of their industry
More informationLectures 56: Taylor Series
Math 1d Instructor: Padraic Bartlett Lectures 5: Taylor Series Weeks 5 Caltech 213 1 Taylor Polynomials and Series As we saw in week 4, power series are remarkably nice objects to work with. In particular,
More informationBonus Maths 2: Variable Bet Sizing in the Simplest Possible Game of Poker (JB)
Bonus Maths 2: Variable Bet Sizing in the Simplest Possible Game of Poker (JB) I recently decided to read Part Three of The Mathematics of Poker (TMOP) more carefully than I did the first time around.
More informationThe Exponential Distribution
21 The Exponential Distribution From DiscreteTime to ContinuousTime: In Chapter 6 of the text we will be considering Markov processes in continuous time. In a sense, we already have a very good understanding
More informationOPTIMAL DESIGN OF A MULTITIER REWARD SCHEME. Amir Gandomi *, Saeed Zolfaghari **
OPTIMAL DESIGN OF A MULTITIER REWARD SCHEME Amir Gandomi *, Saeed Zolfaghari ** Department of Mechanical and Industrial Engineering, Ryerson University, Toronto, Ontario * Tel.: + 46 979 5000x7702, Email:
More informationChapter 4 Technological Progress and Economic Growth
Chapter 4 Technological Progress and Economic Growth 4.1 Introduction Technical progress is defined as new, and better ways of doing things, and new techniques for using scarce resources more productively.
More informationDon't Forget the Differential Equations: Finishing 2005 BC4
connect to college success Don't Forget the Differential Equations: Finishing 005 BC4 Steve Greenfield available on apcentral.collegeboard.com connect to college success www.collegeboard.com The College
More informationFourier Series. A Fourier series is an infinite series of the form. a + b n cos(nωx) +
Fourier Series A Fourier series is an infinite series of the form a b n cos(nωx) c n sin(nωx). Virtually any periodic function that arises in applications can be represented as the sum of a Fourier series.
More informationConstructing Portfolios of ConstantMaturity Fixed Income ETFs
Constructing Portfolios of ConstantMaturity Fixed Income ETFs Newfound Research LLC December 2013 For more information about Newfound Research call us at +16175319773, visit us at www.thinknewfound.com
More informationChapter 15. Sponsored Search Markets. 15.1 Advertising Tied to Search Behavior
From the book Networks, Crowds, and Markets: Reasoning about a Highly Connected World. By David Easley and Jon Kleinberg. Cambridge University Press, 2010. Complete preprint online at http://www.cs.cornell.edu/home/kleinber/networksbook/
More informationThe Economics of Ecosystem Based Management: The Fishery Case
The Economics of Ecosystem Based Management: The Fishery Case Fisheries impact on marine ecosystem and policy implications Peder Andersen Coauthors: Lars Ravensbeck Hans S. Frost Department of Food and
More informationModeling Insurance Markets
Modeling Insurance Markets Nathaniel Hendren Harvard April, 2015 Nathaniel Hendren (Harvard) Insurance April, 2015 1 / 29 Modeling Competition Insurance Markets is Tough There is no wellagreed upon model
More informationPull versus Push Mechanism in Large Distributed Networks: Closed Form Results
Pull versus Push Mechanism in Large Distributed Networks: Closed Form Results Wouter Minnebo, Benny Van Houdt Dept. Mathematics and Computer Science University of Antwerp  iminds Antwerp, Belgium Wouter
More informationAccurately and Efficiently Measuring Individual Account Credit Risk On Existing Portfolios
Accurately and Efficiently Measuring Individual Account Credit Risk On Existing Portfolios By: Michael Banasiak & By: Daniel Tantum, Ph.D. What Are Statistical Based Behavior Scoring Models And How Are
More information1 Uncertainty and Preferences
In this chapter, we present the theory of consumer preferences on risky outcomes. The theory is then applied to study the demand for insurance. Consider the following story. John wants to mail a package
More informationLecture 3: Growth with Overlapping Generations (Acemoglu 2009, Chapter 9, adapted from Zilibotti)
Lecture 3: Growth with Overlapping Generations (Acemoglu 2009, Chapter 9, adapted from Zilibotti) Kjetil Storesletten September 10, 2013 Kjetil Storesletten () Lecture 3 September 10, 2013 1 / 44 Growth
More informationA Coefficient of Variation for Skewed and HeavyTailed Insurance Losses. Michael R. Powers[ 1 ] Temple University and Tsinghua University
A Coefficient of Variation for Skewed and HeavyTailed Insurance Losses Michael R. Powers[ ] Temple University and Tsinghua University Thomas Y. Powers Yale University [June 2009] Abstract We propose a
More informationELLIPTIC CURVES AND LENSTRA S FACTORIZATION ALGORITHM
ELLIPTIC CURVES AND LENSTRA S FACTORIZATION ALGORITHM DANIEL PARKER Abstract. This paper provides a foundation for understanding Lenstra s Elliptic Curve Algorithm for factoring large numbers. We give
More informationMarket Power and Efficiency in Card Payment Systems: A Comment on Rochet and Tirole
Market Power and Efficiency in Card Payment Systems: A Comment on Rochet and Tirole Luís M. B. Cabral New York University and CEPR November 2005 1 Introduction Beginning with their seminal 2002 paper,
More informationRafal Borkowski, Hipoteczna 18/22 m. 8, 91337 Lodz, POLAND, Email: rborkowski@go2.pl
Rafal Borkowski, Hipoteczna 18/22 m. 8, 91337 Lodz, POLAND, Email: rborkowski@go2.pl Krzysztof M. Ostaszewski, Actuarial Program Director, Illinois State University, Normal, IL 617904520, U.S.A., email:
More informationDesigning Incentives in Online Collaborative Environments 1
Designing Incentives in Online Collaborative Environments 1 Yoram Bachrach, Vasilis Syrgkanis, and Milan Vojnović November 2012 Technical Report MSRTR2012115 Microsoft Research Microsoft Corporation
More information6.254 : Game Theory with Engineering Applications Lecture 5: Existence of a Nash Equilibrium
6.254 : Game Theory with Engineering Applications Lecture 5: Existence of a Nash Equilibrium Asu Ozdaglar MIT February 18, 2010 1 Introduction Outline PricingCongestion Game Example Existence of a Mixed
More informationEquilibrium: Illustrations
Draft chapter from An introduction to game theory by Martin J. Osborne. Version: 2002/7/23. Martin.Osborne@utoronto.ca http://www.economics.utoronto.ca/osborne Copyright 1995 2002 by Martin J. Osborne.
More information1 Interest rates, and riskfree investments
Interest rates, and riskfree investments Copyright c 2005 by Karl Sigman. Interest and compounded interest Suppose that you place x 0 ($) in an account that offers a fixed (never to change over time)
More informationCredible Discovery, Settlement, and Negative Expected Value Suits
Credible iscovery, Settlement, and Negative Expected Value Suits Warren F. Schwartz Abraham L. Wickelgren Abstract: This paper introduces the option to conduct discovery into a model of settlement bargaining
More informationWhy is Insurance Good? An Example Jon Bakija, Williams College (Revised October 2013)
Why is Insurance Good? An Example Jon Bakija, Williams College (Revised October 2013) Introduction The United States government is, to a rough approximation, an insurance company with an army. 1 That is
More informationThe Behavior of Bonds and Interest Rates. An Impossible Bond Pricing Model. 780 w Interest Rate Models
780 w Interest Rate Models The Behavior of Bonds and Interest Rates Before discussing how a bond marketmaker would deltahedge, we first need to specify how bonds behave. Suppose we try to model a zerocoupon
More informationChapter 10. Matching Markets. 10.1 Bipartite Graphs and Perfect Matchings
From the book Networks, Crowds, and Markets: Reasoning about a Highly Connected World. By David Easley and Jon Kleinberg. Cambridge University Press, 2010. Complete preprint online at http://www.cs.cornell.edu/home/kleinber/networksbook/
More informationWorking Paper Series
RGEA Universidade de Vigo http://webs.uvigo.es/rgea Working Paper Series A Market Game Approach to Differential Information Economies Guadalupe Fugarolas, Carlos HervésBeloso, Emma Moreno García and
More informationChapter 15 Introduction to Linear Programming
Chapter 15 Introduction to Linear Programming An Introduction to Optimization Spring, 2014 WeiTa Chu 1 Brief History of Linear Programming The goal of linear programming is to determine the values of
More informationFigure 2.1: Center of mass of four points.
Chapter 2 Bézier curves are named after their inventor, Dr. Pierre Bézier. Bézier was an engineer with the Renault car company and set out in the early 196 s to develop a curve formulation which would
More informationTheorem (informal statement): There are no extendible methods in David Chalmers s sense unless P = NP.
Theorem (informal statement): There are no extendible methods in David Chalmers s sense unless P = NP. Explication: In his paper, The Singularity: A philosophical analysis, David Chalmers defines an extendible
More information9.2 Summation Notation
9. Summation Notation 66 9. Summation Notation In the previous section, we introduced sequences and now we shall present notation and theorems concerning the sum of terms of a sequence. We begin with a
More informationLOOKING FOR A GOOD TIME TO BET
LOOKING FOR A GOOD TIME TO BET LAURENT SERLET Abstract. Suppose that the cards of a well shuffled deck of cards are turned up one after another. At any timebut once only you may bet that the next card
More informationSection 1.1. Introduction to R n
The Calculus of Functions of Several Variables Section. Introduction to R n Calculus is the study of functional relationships and how related quantities change with each other. In your first exposure to
More informationWhen is Reputation Bad? 1
When is Reputation Bad? 1 Jeffrey Ely Drew Fudenberg David K Levine 2 First Version: April 22, 2002 This Version: November 20, 2005 Abstract: In traditional reputation theory, the ability to build a reputation
More informationThe Economics of BusinesstoBusiness (B2B) Telemarketing
The Economics of BusinesstoBusiness (B2B) Telemarketing By Jeffrey L. Josephson President, JV/M, Inc. Abstract For most companies in the businesstobusiness (B2B) market, telemarketing can be the fastest,
More informationMath 19A (Online) Calculus for Science Engineering and Mathematics University of California Santa Cruz
Math 19A (Online) Calculus for Science Engineering and Mathematics University of California Santa Cruz Instructors and Course Creators Tony Tromba, PhD, Distinguished Professor, Mathematics Department,
More informationChapter 14: Production Possibility Frontiers
Chapter 14: Production Possibility Frontiers 14.1: Introduction In chapter 8 we considered the allocation of a given amount of goods in society. We saw that the final allocation depends upon the initial
More informationTaylor Polynomials and Taylor Series Math 126
Taylor Polynomials and Taylor Series Math 26 In many problems in science and engineering we have a function f(x) which is too complicated to answer the questions we d like to ask. In this chapter, we will
More informationNotes from Week 1: Algorithms for sequential prediction
CS 683 Learning, Games, and Electronic Markets Spring 2007 Notes from Week 1: Algorithms for sequential prediction Instructor: Robert Kleinberg 2226 Jan 2007 1 Introduction In this course we will be looking
More informationLecture 6: Price discrimination II (Nonlinear Pricing)
Lecture 6: Price discrimination II (Nonlinear Pricing) EC 105. Industrial Organization. Fall 2011 Matt Shum HSS, California Institute of Technology November 14, 2012 EC 105. Industrial Organization. Fall
More informationIMPLICIT CLIENT SORTING AND BONUS MALUS CONTRACTS
IMPLICIT CLIENT SORTING AND BONUS MALUS CONTRACTS Francisco J. Vazquez (C. U. Francisco Vitoria & Universidad Autónoma de Madrid) Richard Watt* (Universidad Autónoma de Madrid) Abstract In an earlier paper,
More informationFinancial Markets. Itay Goldstein. Wharton School, University of Pennsylvania
Financial Markets Itay Goldstein Wharton School, University of Pennsylvania 1 Trading and Price Formation This line of the literature analyzes the formation of prices in financial markets in a setting
More information4.5 Linear Dependence and Linear Independence
4.5 Linear Dependence and Linear Independence 267 32. {v 1, v 2 }, where v 1, v 2 are collinear vectors in R 3. 33. Prove that if S and S are subsets of a vector space V such that S is a subset of S, then
More informationShould Ad Networks Bother Fighting Click Fraud? (Yes, They Should.)
Should Ad Networks Bother Fighting Click Fraud? (Yes, They Should.) Bobji Mungamuru Stanford University bobji@i.stanford.edu Stephen Weis Google sweis@google.com Hector GarciaMolina Stanford University
More informationAppendix A: Science Practices for AP Physics 1 and 2
Appendix A: Science Practices for AP Physics 1 and 2 Science Practice 1: The student can use representations and models to communicate scientific phenomena and solve scientific problems. The real world
More informationPayment streams and variable interest rates
Chapter 4 Payment streams and variable interest rates In this chapter we consider two extensions of the theory Firstly, we look at payment streams A payment stream is a payment that occurs continuously,
More informationMidterm Exam:Answer Sheet
Econ 497 Barry W. Ickes Spring 2007 Midterm Exam:Answer Sheet 1. (25%) Consider a portfolio, c, comprised of a riskfree and risky asset, with returns given by r f and E(r p ), respectively. Let y be the
More informationOnline Supplementary Material
Online Supplementary Material The Supplementary Material includes 1. An alternative investment goal for fiscal capacity. 2. The relaxation of the monopoly assumption in favor of an oligopoly market. 3.
More informationCournot s model of oligopoly
Cournot s model of oligopoly Single good produced by n firms Cost to firm i of producing q i units: C i (q i ), where C i is nonnegative and increasing If firms total output is Q then market price is P(Q),
More information