Multiple studies and weak evidential defeat

Save this PDF as:
 WORD  PNG  TXT  JPG

Størrelse: px
Starte visningen fra side:

Download "Multiple studies and weak evidential defeat"

Transkript

1 Theor Med Bioeth (2017) 38: DOI /s Multiple studies and weak evidential defeat Nikk Effingham 1 Malcolm J. Price 2 Published online: 4 July 2017 Ó The Author(s) This article is an open access publication Abstract When a study shows statistically significant correlation between an exposure and an outcome, the credence of a real connection between the two increases. Should that credence remain the same when it is discovered that further independent studies between the exposure and other independent outcomes were conducted? Matthew Kotzen argues that it should remain the same, even if the results of those further studies are discovered. However, we argue that it can differ dependent upon the results of the studies. Keywords Philosophy of epidemiology Multiple testing Multiplicity Bayesian Evidential defeat Introduction Let u and w be any two factors. A study provides significant results between u and w if and only if that study reports a statistically significant correlation between u and w which would have had only a 1% probability of occurring in the absence of a real connection. A real connection exists between u and w if and only if some variety of causal connection can be traced between u and w. Chance alone allows for studies to show significant results when no real connection exists. Chance alone also allows a real connection to exist between factors without significant results & Malcolm J. Price 1 2 Department of Philosophy, University of Birmingham, Birmingham, UK Biostatistics, Evidence Synthesis and Test Evaluation, Institute of Applied Health Research, College of Medical and Dental Sciences, University of Birmingham, Edgbaston, Birmingham B15 2TT, UK

2 354 N. Effingham, M. J. Price appearing in a study, though, for the sake of argument, this article assumes that this never happens. Imagine reading a study showing significant results between u and w. It is then discovered that further independent studies examining the connection between u and some other outcomes have been conducted. Defeatists believe that if those studies are discovered, the subjective probability of there being a real connection between u and w (i.e., our rational credence) should necessarily lower. But Matthew Kotzen argues to the contrary [1]. Whilst this article does not contest that the mere existence of the other studies is irrelevant, we argue that Kotzen goes too far in thinking that the results of the studies are also irrelevant. Defeatism Imagine the following: Single study scenario : We read a study showing significant results between ingesting peanut butter and cholesterol lowering. Say REALCONNECTION is the proposition that those factors have a real connection (i.e., that eating peanut butter has a causal connection with lower cholesterol). Say SIGNIFICANTRESULTS is the proposition that a study on peanut butter consumption and lower cholesterol shows significant results. Before reading the study, a person has a measure of belief that peanut butter lowers cholesterol, which presumably goes up once shereadsthestudy, i.e., P(REALCONNECTION SIGNIFICANTRESULTS) [ P(REALCONNECTION). Now, imagine that Imaginary Peanut Butter Inc., the fictional commissioning body of the make-believe study, has conducted 999 other studies. Each study examined the association between peanut butter and a factor other than lower cholesterol (e.g., peanut butter and conception rates, peanut butter and resistance to dengue fever, etc.). Call this the multiple study scenario. Given that the probability of a study producing significant results when there is no real connection is (by our definition of statistically significant ) 1%, on average, roughly ten of the 1000 studies conducted in the multiple study scenario would show significant results by mere chance alone. If, for example, 11 of the studies returned significant results, the likeliest explanation would be that one study reflects a real connection whilst the other ten are mere stochastic detritus. Since the lower cholesterol study is but one study amongst the eleven, it is probable that it is amongst the mere detritus. Therefore, one should think P(REALCONNECTION SIGNIFICANTRESULTS) is lower in the multiple study scenario than in the single study scenario. This is the reasoning of the defeatist. Defeatists can be divided into two varieties: strong and weak. Strong defeatists believe that in all such situations, the existence of further studies necessarily lowers one s credence that the original study shows a real connection. Specifically, the strong defeatist believes that the results of those studies are irrelevant. Weak defeatists believe that merely knowing of the existence of further studies does not lower one s credence of there being a real connection. Instead, the weak defeatist says one needs to know what the results of those studies are. Further, in light of

3 Multiple studies and weak evidential defeat 355 those results, the credences that the connection assessed in the original study is real may remain unchanged, decrease, or increase. Kotzen argues that both forms of defeatism are false [1]. We do not contest strong defeatism being false, but we do argue that weak defeatism is true. Kotzen s dice analogies Single and multiple dice scenarios Kotzen s first argument against defeatism depends upon an analogy. Imagine a vat of 1,000,000 dice. One percent of the dice are biased and are perfectly weighted to always roll a 6 ; the remainder are fair. A die is selected from the whole vat. Call the die Harry. HARRYISBIASED is the proposition that Harry is biased. P(HARRYISBIASED) clearly mirrors the percentage of biased dice in the vat, i.e., P(HARRYISBIASED) = But now imagine that Harry is rolled three times and comes up 6 each time. Call this the single die scenario. In the single die scenario, what should the probability be of Harry being biased? That is, where THREE6S is the proposition that Harry came up with three 6S in a row, what is P(HARRYISBIASED THREE6S)? It is easy to calculate. Given Kolmgorov s axioms, PðHarryIsBiasedjThree6sÞ ¼ PðThree6s^HarryIsBiasedÞ PðThree6sÞ Obviously, P(THREE6S) is equal to P(THREE6S^HARRYISBIASED)? P(THREE6S ^:HARRYISBIASED). Further, given De Finetti s axiom, PðThree6s^:HarryIsBiasedÞ ¼PðThree6sjHarryIsBiasedÞPðHarryIsBiasedÞ ¼ 0:01 and PðThree6s^:HarryIsBiasedÞ ¼PðThree6sj:HarryIsBiasedÞ Pð:HarryIsBiasedÞ 0:005: Overall, P(HARRYISBIASED THREE6S) & Now consider a different scenario. Imagine that rather than rolling Harry, Harry is placed back in the vat and then 100,000 dice are randomly selected from the vat and all rolled three times. Of the dice that come up 6 each time, one is randomly selected. What is the probability that such a die is biased? Call this the multiple dice scenario. Where the die in the single die scenario is called Harry, call the selected die in the multiple dice scenario Laura. So the question is, what value does P(LAURAISBIASED) take? The answer is straightforward: exactly the same as P(HARRYISBIASED THREE6S). Imagine the 100,000 dice are instead rolled one by one. Imagine that the first die to be rolled rolls three 6S in a row. We put it aside and call it Laura. Clearly, Laura is

4 356 N. Effingham, M. J. Price now just like Harry from the single die scenario, i.e. P(LAURAISBIASED) & It is equally clear that the rolling of 99,999 more dice is irrelevant to that probability rolling those dice would not make any difference to the probability of Laura being biased. This scenario, where the dice are rolled one by one, is functionally identical to the multiple dice scenario, for it makes no difference whether the dice are rolled one by one or all together. Further, it makes no difference whether the dice are rolled one by one and Laura happens to be the first die rolled, or whether all the dice are rolled simultaneously and Laura is the one picked out from amongst the dice that rolled three 6S. Kotzen s conclusion, with which we concur, is that the same credence should be given to Laura and Harry being biased in both scenarios. On the back of this conclusion, Kotzen argues that defeatism is false because the pairs of scenarios are analogous. The single die scenario is analogous to the single study scenario. Rolling three 6S in a row is analogous to a random study showing significant results, i.e. P(THREE6S) is analogous to P(SIGNIFICANTRESULTS). Randomly selecting a biased die is analogous to randomly selecting a study on factors which bear a real connection to one another, i.e. P(HARRYISBIASED) is analogous to P(REALCONNECTION). A die which has rolled three 6S in a row being biased is analogous to a study that shows significant results being on factors bearing a real connection, i.e. P(HARRYISBIASED THREE6S) is analogous to P(REALCONNECTION SIGNIFICANTRESULTS). Similarly, the multiple dice scenario is analogous to the multiple study scenario. Multiple dice being rolled is the same as multiple studies being conducted. In the same way that Laura is defined as one of the dice that rolled three 6S, the study in the multiple study scenario is guaranteed to be one from amongst those that showed significant results. In the same way that P(HARRYISBIASED THREE6S) = P(LAUR- AISBIASED), the probability of a study being on factors with a real connection, given that one is reading a study which shows significant results, is the same in both the single study scenario and the multiple study scenario. That is, the existence of the other studies is irrelevant to one s credence that the study one is reading is on factors with a real connection or not, i.e. strong defeatism is false. The relevant disanalogy The multiple dice scenario makes no mention of the results of the other 99,999 dice; whatever they rolled is irrelevant to P(LAURAISBIASED). If the multiple dice scenario is analogous to the multiple study scenario, then the results of the other studies are irrelevant to P(REALCONNECTION SIGNIFICANTRESULTS) and weak defeatism is also false. It is at this step that we find fault since the dice scenarios are subtly disanalogous to the study scenarios. Start by examining one reason Kotzen considers for thinking that P(LAURAISBIASED) \ P(HARRYISBIASED THREE6S). Recall that in the multiple dice scenario Harry is pulled out of the vat but is not rolled. Instead, Harry is replaced and the 100,000 dice are rolled instead (from which Laura is selected). We nevertheless have a value of P(HARRYISBIASED), and given the mathematics above, P(LAURAISBIASED) is a function of it. If the results of the 100,000 dice affect P(HARRYISBIASED) then they would likewise affect

5 Multiple studies and weak evidential defeat 357 P(LAURAISBIASED). But Kotzen thinks that the results of the dice rolls should not alter P(HARRYISBIASED): After all, we know that the jar contains a large number of (stipulatively randomized) dice, and we know that 99% of them are fair and that 1% of them are biased. Presumably, even the Defeatist wants to allow that when you pick just one die at random from a jar with such a composition of dice, a rational agent s prior credence in [HARRYISBIASED] should be.01. [1, pp ] The first sentence in this quote is the bone of contention. In the dice case, Kotzen stipulates that the proportion of biased dice is known. But when studies are conducted, one cannot be certain of the proportion of studies which will be on factors with a real connection. Thus, there is a disanalogy. 1 We start with the dice scenarios. In the original dice scenario, P(HARRYISBIASED) mirrors the percentage of dice believed to be biased (i.e. P(HARRYISBIASED) = 0.01) and does not alter when the rest of the dice are rolled. But when one becomes uncertain about the percentage of biased dice, this need not be true. Just as long as the results of the dice influence, to some degree, one s belief about what proportion of dice are biased, the results of the dice bear on P(HARRYISBIASED). Intuitively, this is so. Imagine that it is unclear what proportion of the dice are biased. 100,000 dice are rolled and all come up three 6S in a row. One would then strongly suspect that all of the dice, Laura included, are biased, i.e., fix P(HARRYISBIASED) close to 1 (and, by extension, P(LAURAISBIASED) would be close to 1). But if 100,000 dice are rolled and 50,231 roll three 6S, then that result would be most likely if 50% were biased; if we then fixed P(HARRYISBIASED) at 0.5, P(LAURAISBIASED) being the same as P(HARRYISBIASED THREE6S) would be approximately And if, after 100,000 dice are rolled, 1001 roll three 6S in a row then since that is approximately the average result if roughly one in 100,000 dice were biased we would alter our value of P(HARRYISBIASED) to be In that case, P(LAURAISBIASED) & rather than In short, if one is uncertain what proportion of dice are biased, but nevertheless has access to the actual results of the dice rolls, those results should bear on one s credence for what proportion of dice are biased. Kotzen is therefore wrong to say that the results of the dice rolls in the multiple dice scenario are irrelevant to the probability of Laura being biased. Note that, nevertheless, the mere fact that other dice were rolled is irrelevant, i.e. weak defeatism may be true but Kotzen could still be correct that strong defeatism is false. This revised dice scenario is the better analogy to real world studies for it is not certain what proportion of studies are on factors which actually have a real connection. Thus, it follows that just as weak defeatism is true of the revised dice scenario, weak defeatism is true when studies are considered. 1 Kotzen recognises this disanalogy in [1, pp. 166, 177]; he says that it is incumbent upon the defeatist to explain why this disanalogy might be salient the rest of this section explains just that.

6 358 N. Effingham, M. J. Price The independence argument Kotzen has other arguments against (both strong and weak) defeatism. One is the independence argument [1, p. 160]: given that the other studies are truly independent of one another, the results of one study says nothing about how other studies might turn out. If they say nothing whatsoever, both weak and strong defeatism are false. Kotzen s worry can be grasped first by returning to the dice analogy. Instead of one vat, imagine that there are a million vats. Each vat is filled by a different dice creating machine. Dials on the machines determine how many biased dice each machine produces. The dials on the machines have been independently set. Imagine a die is randomly selected from the vats. Call it Harry. If it rolls three 6S, then it would create an improved single die scenario. But imagine that it is not rolled, and instead is put back in the vat. We then roll one die each from 100,000 randomly selected vats. Of those dice which roll three 6S, one is selected. Call it Laura. This is the improved multiple dice scenario. The results of the other 99,999 dice are prima facie irrelevant to the probability of Laura being biased. Imagine that all 99,999 dice rolled three 6S. In that case, as long as the dial settings were fixed independently of one another, the scenario nevertheless fails to tell us anything about the bias proportion of the vat that Laura was pulled from. The improved multiple dice scenario is a better analogy of the multiple study scenario: pairs of factors are analogous to the vats; each die is analogous to a study one might conduct on the pair; that the dials are independently fixed is analogous to the different studies being independent of one another, etc. So, by that analogy, what the results of the other studies are in the multiple study scenario seems irrelevant, i.e. weak defeatism is false. But the devil is in the detail. P(LAURAISBIASED) is a function of P(HARRYIS- BIASED). Even in the improved multiple dice scenario, one might think that the results of the dice affect P(HARRYISBIASED). Imagine that we have no idea of how to estimate P(HARRYISBIASED). But imagine that prior to picking out Harry (and prior to rolling 100,000 dice, and prior to picking out Laura, etc.), we are allowed to roll some dice from the vats. Call them the anterior dice. The anterior dice are randomly selected such that each die may or may not have come from one of the vats from which we later draw one of the 100,000 dice and, indeed, we do not know whether some, or all, of the anterior dice came from the same vat. If we are genuinely at a loss as to how to estimate P(HARRYISBIASED) then we would believe that it is equiprobable which vat any given die came from. In that case, we should fix P(HARRYISBIASED) at a value mirroring the proportion of anterior dice which rolled three 6S. Then, just as clearly, if we roll 100,000 dice from amongst the vats, then the results of those dice are likewise going to update what we believe about P(HARRYISBIASED). For instance, imagine that we rolled 10 anterior dice and estimated P(HARRYISBIASED) on the back of that. That is not as good as rolling 100,009 which would help us better estimate that value. In the improved multiple dice scenario, the 99,999 rolls of the other dice are just as good as rolling extra anterior dice. The conclusion is that if one used the anterior dice method to estimate P(HARRYISBIASED), then, clearly, the results of the other dice rolls are relevant to

7 Multiple studies and weak evidential defeat 359 P(LAURAISBIASED). That things are the same as they were in the multiple dice scenario should seem intuitive. In the improved multiple dice scenario, 100,000 dice are rolled from randomly selected vats. Imagine that the selected dice are put in a bucket before being rolled. This would now be a situation identical to the multiple dice scenario. Strained analogies? Having added the use of the anterior dice process to the improved multiple dice scenario, there is now yet another variant scenario: the anterior dice scenario. If the anterior dice scenario were analogous to real world scenarios involving multiple independent studies, then weak defeatism would be false. However, if there were no analogy of the anterior dice process, our objection to Kotzen would not work. For there to be an analogy, there must be an anterior studies process whereby the probability of a study showing a real connection is, at least in part, based upon the proportion of studies thus far seen which demonstrate significant results. In the rest of this section, we argue that, in at least some cases, an anterior study process is used (and, further, should be used in at least some cases). Before turning to a real world example, consider a fictional case. Imagine a researcher who has no expertise in, or knowledge relevant to, the field of peanut butter or cholesterol levels. Whilst she is perfectly rational, she has no idea how to estimate P(REALCONNECTION), i.e. she has no idea what the prior probability is of peanut butter ingestion causing lower cholesterol. Nor does she have access to studies that are not independent of the peanut butter study. But she does have access to 1000 independent studies. Of those 1000 studies, 10 studies were conducted on factors that turned out to have a real connection. With nothing better to go on, the researcher should rationally estimate P(REALCONNECTION) to be Now, imagine that this researcher reads an extra nine thousand studies. Were that to show that the proportion of studies conducted on factors with a real connection was, e.g., higher than the proportion in the next nine thousand, this should change her estimation. After reading 10,000 studies, if she saw that the proportion of studies conducted on factors with a real connection was in fact 1.3%, then she should correspondingly adjust P(REALCONNECTION) to be This is simply her deploying the anterior study process. In the multiple study scenario, were the researcher to discover the results of the other studies, then that would be yet more information to feed into a revision of P(REALCONNECTION). Hence, the results of the multiple studies do affect the value of P(REALCONNECTION) and, therefore, the value of P(REALCONNECTION SIGNIFICANTRESULTS) in the multiple study scenario (as compared to the single study scenario). Nor is this relevant only to fiction for there are suitably similar real world cases. One example concerns diagnostic tests for diseases. Imagine someone tests positive for a disease. The subjective probability of the subject having the disease depends upon two things. First, the accuracy of the test: imagine it generates false positives 1% of the time (in uninfected subjects) and never generates false negatives. Second, the prevalence of the disease in the population: imagine that 1% of the population is infected. In such a case, the subjective probability of the subject having the disease

8 360 N. Effingham, M. J. Price would be (roughly) 0.5. And in this case, the subject would be a study of one (with their positive test result being analogous to a die which has rolled three 6s). When one learns more about independently conducted studies (that is, learns more about the prevalence in the population), one s subjective probability of the subject having the disease should vary. For instance, if one came to believe that it was not 1% of the population which was infected but 2%, then one s subjective probability that the subject has the disease should now be roughly A second example involves testing DNA data. James Scott and James Berger use a Bayesian statistical model for testing DNA data [2]. Where x i is the measured under- or over-expression of genes, and l i is x i s true mean, it is natural to believe that (i) the prior probability that l i = 0 for any given i is (unless we know any better!) the same for every i, and (ii) that each value of l i is independent. Examining the different genes is thus equivalent to conducting independent multiple studies on whether different genes over or under express. And when it comes to fixing the prior probability of l i = 0 for any given i, Scott and Berger say that the emphasis is on letting the data themselves (i.e., the results of the independent tests on the genes) fix that prior probability [2, p. 2145]. Clearly, this is just the anterior studies process in action. So, the anterior studies process is used in the real world. Moreover, were weak defeatism false, then these cases would have to be conducted differently (which especially in the case of diagnostic testing would be quite a surprise!). Since the analogy holds, Kotzen s independence argument does not work. The generality argument The final of Kotzen s arguments which we consider in-depth is his generality argument : if defeatism is true, and the existence of some independent studies influence P(REALCONNECTION SIGNIFICANTRESULTS), it seems impossible to draw the line between which studies are relevant and which are not. Are studies about statins and lower cholesterol relevant? Or eating peanut butter and complications arising from heart bypass surgery? Or heart bypass surgery and memory loss (which is, prima facie, totally irrelevant!)? With no good answer to that question, the defeatist is in trouble [1, pp ]. One can also consider this objection in relation to diagnostic disease testing. If testing, say, for the presence of HIV, one might pay close attention to the results of other HIV tests to feed into one s prior probabilities. But one need not pay such attention to any old independent study whatsoever. For instance, one would not pay such attention to the results of tests on whether people have chlamydia or diabetes. We do not believe that this argument demonstrates that weak defeatism is false. Return to the drudgery of the fictional researcher wading through one thousand, and then ten thousand, independent studies in order to estimate a value of P(REALCON- NECTION). The researcher could be asked why she selected those studies. Should the ten thousand studies include studies about statins and lower cholesterol, or about peanut butter and heart bypass surgery complications, or about heart bypass surgery and memory loss, and so on? If the researcher is genuinely ignorant of medical

9 Multiple studies and weak evidential defeat 361 issues, we believe that all such studies are relevant to that researcher. After all, what else should she do? Since there is no alternative to the one we suggest, we think it is obvious that one should use weak defeatist reasoning in this case and that, therefore, Kotzen s argument cannot be sound. When someone is less ignorant than this imaginary researcher, it gets trickier. Improved information changes which studies are relevant. Returning to the anterior dice scenario, a set of dice, P, is constructed. The results of those dice inform our prior probability of Harry being biased. If Harry could have come from any vat, and the dice which are members of P could have come from any vat, the results of dice from P should inform that probability. But if it were known that Harry came from amongst the first 50,000 vats, and if it were known which anterior dice came from vat numbers 1 50,000 and which came from vat numbers 50, ,000, then one would know only to include dice of the former type in P on the grounds that the other dice are not saliently similar to Harry. The same thinking applies in the case of studies. Let s be a study which our researcher has read; let R be the set of studies intended for use in the anterior studies process when estimating the (prior) probability of a real connection between the factors involved in s; let p be the principle that our researcher used for selecting s in the first place. Similar to the dice case, every study in R should be selectable by principle p. If the researcher knows that p could never have selected a given study, then that study should not be included in R. Problematically, there will be many such principles. Some principles appear to be apposite whilst others do not. For instance, in diagnostic testing, the results of other HIV tests seem pertinent to the probability of a given individual having HIV; thus a principle selecting all and only HIV tests seems apposite. In the case of the peanut butter study, a principle selecting all studies on lower cholesterol caused by a variety of common edible substances is likewise apposite. But there are principles which are prima facie odd and bizarre. For instance, imagine that a researcher came across the peanut butter study by accident whilst rummaging under their sofa. In a sense, the researcher has used a principle for reading studies which selects studies left under sofas. But it would be bizarre for R to have as members all and only those studies that have been discarded under sofas. This problem can be showcased by a further example. Imagine one reads the peanut butter study in the Journal of Peanut Butter Studies. Should R include all studies in that journal? Why should it not include all studies that could have appeared in that journal (so include, e.g., studies rejected by that journal but accepted elsewhere)? What if every morning I randomly select a journal to read and happened, that morning, to select Journal of Peanut Butter Studies should R now contain studies from any journal whatsoever? There are a plethora of candidate principles, each generating a distinct set of studies for the anterior studies process where those studies are all in some sense or another similar to s. In light of this, Kotzen may renew his objection, saying that unless one can develop a hard and fast rule for picking out which principle is apposite, weak defeatism is scuppered. We cannot develop such a hard and fast rule, but we do not believe this to be damning to weak defeatism. R is a set of studies saliently similar to s with regards to how s came to be read. Pinning down salient similarity has proven difficult in

10 362 N. Effingham, M. J. Price other areas so it is no surprise that it proves difficult here. But in the same way that, in other areas, guidelines can be offered, some rough guidelines can be offered here. The idea that some resemblances are genuine resemblances which better respect cuts in nature s joints can be extended [3]. For instance, the first detected electron and the Eiffel Tower resemble one another in some respect (e.g. they resemble one another insofar as both of them are the only things mentioned in this sentence). But that does not mean they genuinely resemble each other. Some predicates are more natural than others. For instance, is a negatively charged particle is a more natural predicate than is mentioned in sentence or is an artefact designed by Gustave Eiffel [4, 5]. The first predicate better cuts nature at the joints than the latter two. Things resemble one another to the extent that they fall under the same predicates; things genuinely resemble one another to the extent that they fall under the same natural predicates. Thus, the Eiffel Tower and an electron s resemblance can be accounted for whilst simultaneously capturing the fact that they do not genuinely resemble each other. This in place, one can get a sense of which principles are apposite. A principle for constructing sets of studies is better than another principle when it respects these genuine resemblances. That is, if principle p 1 selects studies whose subject matter genuinely resembles s to one degree whilst principle p 2 selects studies whose subject matter genuinely resembles s to a greater degree, one should opt for p 2 over and above p 1. The apposite principle is simply the principle that is to be preferred over all others. For example, HIV tests all concern themselves with the presence, or not, of a particular disease. Having a disease or not is a fairly natural resemblance. So, a principle selecting other HIV tests (and ignoring tests on other diseases) has a subject matter (i.e., people having HIV) that better genuinely resembles the original test than if tests on other diseases were also included. No wonder, then, that one would focus on a set of such tests when it comes to the anterior studies process. If, in the peanut butter study case, studies on edible substances and heart disease were selected, those studies would have subject matters more closely genuinely resembling that of the peanut butter study than if a principle selecting studies found under sofas were used. If the latter principle were used, one should probably believe that the set one constructed would contain studies with disparate subject matters one should, therefore, favour using the former principle. Thus, we suggest that when faced with a plethora of principles one should select the principle which, to the best of one s knowledge, is best suited to constructing a set of studies with genuinely similar subject matters. Hence, one should change which sets are pertinent to the anterior studies process as one learns more about the world. The thoroughly ignorant researcher imagined above, who ploughs through ten thousand random studies, does not know that, say, peanut butter and lower cholesterol do not genuinely resemble the factors appearing in those ten thousand studies. Hence, she is justified in including them in her set for use in the anterior studies process. However, in contemporary diagnostic testing, we know that an infection of HIV genuinely resembles other infections of HIV more than it genuinely resembles an infection of chlamydia. Hence, the set includes the independent HIV tests, though not other studies or tests, and is the desirable set to inform the relevant prior probabilities. The more one learns about the world, the

11 Multiple studies and weak evidential defeat 363 more one is clued in as to which sets are better suited to help estimate prior probabilities. Thus, there is a constraint on how sets of anterior studies are to be constructed. The constraint is only rough. One could expand upon it by adding in further constraints. For instance, the resemblance of the subject matter of studies is just one desideratum. Another desideratum would be that an apposite principle would include as many studies as practically possible. Without that desideratum, one would always favour the set consisting of just that thing which most genuinely resembles its subject matter, i.e. s itself. But that would be totally uninformative. Hence, with informativeness in mind, one can build sets with multiple studies in them even though those studies imperfectly genuinely resemble the subject matter of s one must balance the demand for informativeness with the demands concerning the genuine resemblance of subject matter. A further constraint can be suggested. Studies should only be included in R if the prior probabilities of there being real connections between the factors in the studies are approximately the same before the results of any of the studies are examined. For instance, if the prior probability of peanut butter lowering cholesterol is 0.01 and the prior probability of peanut butter causing heart arrhythmia is 0.01, then both may be included in R. In the example case, one would include all (saliently similar) studies where it is believed that the prior probability of the factors having a real connection is When the results of those studies are discovered, one gets more information on what proportion of those studies actually demonstrate a real connection. For instance, one might discover that of those studies one selected to be included in the anterior set, 2% demonstrated a real connection rather than, as was assumed, 1%. Information about the anterior studies is simply information about how good one is at estimating those prior probabilities. In the example case, one would discover that when the probability of factors having a real connection is estimated to be 0.01, this is generally an underestimate for studies included in R. More could be said about the construction of anterior sets. This sketch of some constraints on the sets nevertheless ameliorates Kotzen s worries. The original worry was that there are not any guidelines or restrictions on what studies count towards affecting one s credences. The sketch shows that there can be principled reasons to delimit the sets of studies in some way. Whilst Kotzen thinks weak defeatism leads to absurd conclusions (e.g., that it might lead to the diagnostic testing of one disease taking into account the results of prima facie irrelevant diagnostic tests for other diseases), the sketch shows how to resist that line of reasoning. It also explains why our totally ignorant researcher is justified in examining all studies that she comes across. The constraints placed on the construction of the anterior set depend upon the knowledge that one has. The more knowledge one acquires, the greater the limits placed on the composition of the anterior set. In a case of a thoroughly ignorant researcher, no limits are placed on them and thus, when totally ignorant, every study is relevant to estimating one s prior probabilities.

12 364 N. Effingham, M. J. Price Conclusion This concludes our examination of the pertinent arguments Kotzen offers against weak defeatism. 2 We now end by discussing how what we said bears on current medical practice. First, we should note that explicitly deploying weak defeatist reasoning is not new. Not only are there the examples of diagnostic testing, and analysis of DNA data from Scott and Berger, but there are others as well. In one example, Jonathan Sterne and George Davey Smith have already noted much of what we have written about in this article, albeit in the context of interpreting p values [6]. A p value is the probability that either the observed result, or something more extreme than the observed result, would be observed were a real connection between studied factors not present. When it comes to interpreting p values, they are explicit that the results of independently conducted studies should guide one to the proportion of false alarms that one should presume there to be, which factors into informing the prior probability of there being a real connection between studied factors. In a second example, the prior probability of a genetic variant being associated with a disease varies depending upon the number of functional genetic variants along with the number of variants which contribute to the disease. Data about the latter information (i.e., number of functional genetic variants and number of contributing variants) bears on the prior probability of association with a disease [7 9]. In a third example, John Ioannidis believes that the proportion of significant results appearing in a set of studies provides guidance as to the prior probability of there being real connections when significant results appear [10]. As an example, he imagines a whole genome association study testing 100,000 gene polymorphisms for association with schizophrenia [10, p. 699]. He is explicit that the prior probability of any given gene being so associated mirrors the proportion of genes that are associated. Again, this is simply the anterior studies process in action. However, there are practical issues which make implementation of this weak defeatist reasoning tricky. For instance, virtually all medical studies are conducted using classical or frequentist, rather than Bayesian, methods [11]. The anterior study process, being Bayesian in nature, does not feature in works based on a classical methodology, scuppering attempts to use the anterior studies process to better inform one s priors in the vast majority of studies. 3 Further, the simplifying assumptions made of the peanut butter case paint a misleading picture of how easy it would be to build a statistical model involving the 2 Kotzen s other arguments are irrelevant given the current dialectic. The triviality problem [1, p. 160] that the defeatist appears to be weakening the evidence as a motivation for strong defeatism is irrelevant as we do not deploy any such reasoning in arguing for weak defeatism. Similarly, the psychological problem that defeatism is committed to thinking that the private psychological states of researchers [1, p. 161] are relevant is prima facie not a problem for, clearly, weak defeatism commits to no such thing. The commutativity of evidence issue [1, pp ] that it is irrelevant which order one receives information as to what we draw from that information is irrelevant as nothing we say indicates that the order is relevant. 3 Of course, this is merely a descriptive fact just because most studies do not use Bayesian reasoning does not mean that they should not [6, 12].

13 Multiple studies and weak evidential defeat 365 weak defeatist s reasoning. For instance, along with Kotzen, we assumed that real connections are both an all or nothing affair and always turn up significant results when tested. In real world cases, where these assumptions do not apply, statistical modelling methods are more complex; therefore, the ratio of effort to reward for using weak defeatist reasoning may often be quite low. The same is true for other assumptions for instance, we have ignored the influence of bias in studies. Similarly, in many real world cases one often has non-independent studies available. Information from such studies is likely to swamp information garnered from independent studies when it comes to estimating prior probabilities. That is not to say that the information from the independent studies is irrelevant, but just that the modification made in light of it would, in most (but not all!) cases, likely make little difference. Given the probable small effect it would have, it will not, in many cases, be worth the effort to build the appropriate statistical model. In any case, it would be challenging to develop a statistical methodology to correctly synthesise independent and non-independent studies of different types. But this is not to say that the reasoning of the weak defeatist is unsound even if it turns out that in the real world, it is often less useful to pay attention to it. Moreover, whilst in many cases it is inefficient to build weak defeatist reasoning into a statistical model, that is not true of all cases the above case of Scott and Berger s analysis of DNA is one example in which the reasoning of the weak defeatist is not only pertinent but also economical to take into account. Compliance with ethical standards Conflict of interest Nikk Effingham and Malcolm J. Price declare that they have no conflict of interest. Human and animal rights statement This article does not contain any studies with human participants or animals performed by any of the authors. Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License ( which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. References 1. Kotzen, M Multiple studies and evidential defeat. Noûs 47: Scott, J., and J. Berger An exploration of aspects of Bayesian multiple testing. Journal of Statistical Planning and Inference 136: Armstrong, D Universals: An opinionated introduction. Boulder, Colorado: Westview Press. 4. Lewis, D New work for a theory of universals. Australasian Journal of Philosophy 61: Dorr, C., and J. Hawthorne Naturalness. Oxford Studies in Metaphysics 8: Sterne, J., and G. Smith Sifting the evidence What s wrong with significance tests? BMJ 322: Wacholder, S., S. Chanock, M. Garcia-Closas, L. El Ghormli, and N. Rothman Assessing the probability that a positive report is false: An approach for molecular epidemiology studies. Journal of the National Cancer Institute 96:

14 366 N. Effingham, M. J. Price 8. Chanock, S Candidate genes and single nucleotide polymorphisms (SNPs) in the study of human disease. Disease Markers 17: Colhoun, H., P. McKeigue, and G. Davey Smith Problems of reporting genetic associations with complex outcomes. The Lancet 361: Ioannidis, J Why most published research findings are false. PLoS Medicine 2: Burke, D Use of Bayesian methods for the design, analysis and synthesis of clinical trials. Ph.D. diss., University of Birmingham. 12. Browner, W., and T. Newman Are all significant p values created equal? The analogy between diagnostic tests and clinical research. Journal of the American Medical Association 257:

Vina Nguyen HSSP July 13, 2008

Vina Nguyen HSSP July 13, 2008 Vina Nguyen HSSP July 13, 2008 1 What does it mean if sets A, B, C are a partition of set D? 2 How do you calculate P(A B) using the formula for conditional probability? 3 What is the difference between

Læs mere

Basic statistics for experimental medical researchers

Basic statistics for experimental medical researchers Basic statistics for experimental medical researchers Sample size calculations September 15th 2016 Christian Pipper Department of public health (IFSV) Faculty of Health and Medicinal Science (SUND) E-mail:

Læs mere

Skriftlig Eksamen Kombinatorik, Sandsynlighed og Randomiserede Algoritmer (DM528)

Skriftlig Eksamen Kombinatorik, Sandsynlighed og Randomiserede Algoritmer (DM528) Skriftlig Eksamen Kombinatorik, Sandsynlighed og Randomiserede Algoritmer (DM58) Institut for Matematik og Datalogi Syddansk Universitet, Odense Torsdag den 1. januar 01 kl. 9 13 Alle sædvanlige hjælpemidler

Læs mere

Skriftlig Eksamen Kombinatorik, Sandsynlighed og Randomiserede Algoritmer (DM528)

Skriftlig Eksamen Kombinatorik, Sandsynlighed og Randomiserede Algoritmer (DM528) Skriftlig Eksamen Kombinatorik, Sandsynlighed og Randomiserede Algoritmer (DM58) Institut for Matematik og Datalogi Syddansk Universitet, Odense Torsdag den 1. januar 01 kl. 9 13 Alle sædvanlige hjælpemidler

Læs mere

The X Factor. Målgruppe. Læringsmål. Introduktion til læreren klasse & ungdomsuddannelser Engelskundervisningen

The X Factor. Målgruppe. Læringsmål. Introduktion til læreren klasse & ungdomsuddannelser Engelskundervisningen The X Factor Målgruppe 7-10 klasse & ungdomsuddannelser Engelskundervisningen Læringsmål Eleven kan give sammenhængende fremstillinger på basis af indhentede informationer Eleven har viden om at søge og

Læs mere

How Long Is an Hour? Family Note HOME LINK 8 2

How Long Is an Hour? Family Note HOME LINK 8 2 8 2 How Long Is an Hour? The concept of passing time is difficult for young children. Hours, minutes, and seconds are confusing; children usually do not have a good sense of how long each time interval

Læs mere

Engelsk. Niveau D. De Merkantile Erhvervsuddannelser September Casebaseret eksamen. og

Engelsk. Niveau D. De Merkantile Erhvervsuddannelser September Casebaseret eksamen.  og 052431_EngelskD 08/09/05 13:29 Side 1 De Merkantile Erhvervsuddannelser September 2005 Side 1 af 4 sider Casebaseret eksamen Engelsk Niveau D www.jysk.dk og www.jysk.com Indhold: Opgave 1 Presentation

Læs mere

X M Y. What is mediation? Mediation analysis an introduction. Definition

X M Y. What is mediation? Mediation analysis an introduction. Definition What is mediation? an introduction Ulla Hvidtfeldt Section of Social Medicine - Investigate underlying mechanisms of an association Opening the black box - Strengthen/support the main effect hypothesis

Læs mere

Observation Processes:

Observation Processes: Observation Processes: Preparing for lesson observations, Observing lessons Providing formative feedback Gerry Davies Faculty of Education Preparing for Observation: Task 1 How can we help student-teachers

Læs mere

The River Underground, Additional Work

The River Underground, Additional Work 39 (104) The River Underground, Additional Work The River Underground Crosswords Across 1 Another word for "hard to cope with", "unendurable", "insufferable" (10) 5 Another word for "think", "believe",

Læs mere

Department of Public Health. Case-control design. Katrine Strandberg-Larsen Department of Public Health, Section of Social Medicine

Department of Public Health. Case-control design. Katrine Strandberg-Larsen Department of Public Health, Section of Social Medicine Department of Public Health Case-control design Katrine Strandberg-Larsen Department of Public Health, Section of Social Medicine Case-control design Brief summary: Comparison of cases vs. controls with

Læs mere

Statistik for MPH: 7

Statistik for MPH: 7 Statistik for MPH: 7 3. november 2011 www.biostat.ku.dk/~pka/mph11 Attributable risk, bestemmelse af stikprøvestørrelse (Silva: 333-365, 381-383) Per Kragh Andersen 1 Fra den 6. uges statistikundervisning:

Læs mere

Privat-, statslig- eller regional institution m.v. Andet Added Bekaempelsesudfoerende: string No Label: Bekæmpelsesudførende

Privat-, statslig- eller regional institution m.v. Andet Added Bekaempelsesudfoerende: string No Label: Bekæmpelsesudførende Changes for Rottedatabasen Web Service The coming version of Rottedatabasen Web Service will have several changes some of them breaking for the exposed methods. These changes and the business logic behind

Læs mere

Engelsk. Niveau C. De Merkantile Erhvervsuddannelser September 2005. Casebaseret eksamen. www.jysk.dk og www.jysk.com.

Engelsk. Niveau C. De Merkantile Erhvervsuddannelser September 2005. Casebaseret eksamen. www.jysk.dk og www.jysk.com. 052430_EngelskC 08/09/05 13:29 Side 1 De Merkantile Erhvervsuddannelser September 2005 Side 1 af 4 sider Casebaseret eksamen Engelsk Niveau C www.jysk.dk og www.jysk.com Indhold: Opgave 1 Presentation

Læs mere

Vores mange brugere på musskema.dk er rigtig gode til at komme med kvalificerede ønsker og behov.

Vores mange brugere på musskema.dk er rigtig gode til at komme med kvalificerede ønsker og behov. På dansk/in Danish: Aarhus d. 10. januar 2013/ the 10 th of January 2013 Kære alle Chefer i MUS-regi! Vores mange brugere på musskema.dk er rigtig gode til at komme med kvalificerede ønsker og behov. Og

Læs mere

GUIDE TIL BREVSKRIVNING

GUIDE TIL BREVSKRIVNING GUIDE TIL BREVSKRIVNING APPELBREVE Formålet med at skrive et appelbrev er at få modtageren til at overholde menneskerettighederne. Det er en god idé at lægge vægt på modtagerens forpligtelser over for

Læs mere

Remember the Ship, Additional Work

Remember the Ship, Additional Work 51 (104) Remember the Ship, Additional Work Remember the Ship Crosswords Across 3 A prejudiced person who is intolerant of any opinions differing from his own (5) 4 Another word for language (6) 6 The

Læs mere

Trolling Master Bornholm 2015

Trolling Master Bornholm 2015 Trolling Master Bornholm 2015 (English version further down) Panorama billede fra starten den første dag i 2014 Michael Koldtoft fra Trolling Centrum har brugt lidt tid på at arbejde med billederne fra

Læs mere

Brug sømbrættet til at lave sjove figurer. Lav fx: Få de andre til at gætte, hvad du har lavet. Use the nail board to make funny shapes.

Brug sømbrættet til at lave sjove figurer. Lav fx: Få de andre til at gætte, hvad du har lavet. Use the nail board to make funny shapes. Brug sømbrættet til at lave sjove figurer. Lav f: Et dannebrogsflag Et hus med tag, vinduer og dør En fugl En bil En blomst Få de andre til at gætte, hvad du har lavet. Use the nail board to make funn

Læs mere

Sport for the elderly

Sport for the elderly Sport for the elderly - Teenagers of the future Play the Game 2013 Aarhus, 29 October 2013 Ditte Toft Danish Institute for Sports Studies +45 3266 1037 ditte.toft@idan.dk A growing group in the population

Læs mere

Financial Literacy among 5-7 years old children

Financial Literacy among 5-7 years old children Financial Literacy among 5-7 years old children -based on a market research survey among the parents in Denmark, Sweden, Norway, Finland, Northern Ireland and Republic of Ireland Page 1 Purpose of the

Læs mere

Aktivering af Survey funktionalitet

Aktivering af Survey funktionalitet Surveys i REDCap REDCap gør det muligt at eksponere ét eller flere instrumenter som et survey (spørgeskema) som derefter kan udfyldes direkte af patienten eller forsøgspersonen over internettet. Dette

Læs mere

Statistik for MPH: oktober Attributable risk, bestemmelse af stikprøvestørrelse (Silva: , )

Statistik for MPH: oktober Attributable risk, bestemmelse af stikprøvestørrelse (Silva: , ) Statistik for MPH: 7 29. oktober 2015 www.biostat.ku.dk/~pka/mph15 Attributable risk, bestemmelse af stikprøvestørrelse (Silva: 333-365, 381-383) Per Kragh Andersen 1 Fra den 6. uges statistikundervisning:

Læs mere

Skriftlig Eksamen Diskret matematik med anvendelser (DM72)

Skriftlig Eksamen Diskret matematik med anvendelser (DM72) Skriftlig Eksamen Diskret matematik med anvendelser (DM72) Institut for Matematik & Datalogi Syddansk Universitet, Odense Onsdag den 18. januar 2006 Alle sædvanlige hjælpemidler (lærebøger, notater etc.),

Læs mere

applies equally to HRT and tibolone this should be made clear by replacing HRT with HRT or tibolone in the tibolone SmPC.

applies equally to HRT and tibolone this should be made clear by replacing HRT with HRT or tibolone in the tibolone SmPC. Annex I English wording to be implemented SmPC The texts of the 3 rd revision of the Core SPC for HRT products, as published on the CMD(h) website, should be included in the SmPC. Where a statement in

Læs mere

Generelt om faget: - Hvordan vurderer du dit samlede udbytte af dette fag?

Generelt om faget: - Hvordan vurderer du dit samlede udbytte af dette fag? Fag: Monetary Policy % 46 Samlet status % 5% 5% 75% % Ny % Distribueret 63% 9 Nogen svar % Gennemført 37% 7 Frafaldet % % 5% 5% 75% % Generelt om faget: - Hvordan vurderer du dit samlede udbytte af dette

Læs mere

Bilag. Resume. Side 1 af 12

Bilag. Resume. Side 1 af 12 Bilag Resume I denne opgave, lægges der fokus på unge og ensomhed gennem sociale medier. Vi har i denne opgave valgt at benytte Facebook som det sociale medie vi ligger fokus på, da det er det største

Læs mere

ATEX direktivet. Vedligeholdelse af ATEX certifikater mv. Steen Christensen stec@teknologisk.dk www.atexdirektivet.

ATEX direktivet. Vedligeholdelse af ATEX certifikater mv. Steen Christensen stec@teknologisk.dk www.atexdirektivet. ATEX direktivet Vedligeholdelse af ATEX certifikater mv. Steen Christensen stec@teknologisk.dk www.atexdirektivet.dk tlf: 7220 2693 Vedligeholdelse af Certifikater / tekniske dossier / overensstemmelseserklæringen.

Læs mere

Trolling Master Bornholm 2014

Trolling Master Bornholm 2014 Trolling Master Bornholm 2014 (English version further down) Den ny havn i Tejn Havn Bornholms Regionskommune er gået i gang med at udvide Tejn Havn, og det er med til at gøre det muligt, at vi kan være

Læs mere

Choosing a Medicare prescription drug plan.

Choosing a Medicare prescription drug plan. Choosing a Medicare prescription drug plan. Look inside to: Learn about Part D prescription drug coverage Find out what you need to know about Part D drug costs Discover common terms used with Part D prescription

Læs mere

Trolling Master Bornholm 2013

Trolling Master Bornholm 2013 Trolling Master Bornholm 2013 (English version further down) Tilmeldingen åbner om to uger Mandag den 3. december kl. 8.00 åbner tilmeldingen til Trolling Master Bornholm 2013. Vi har flere tilmeldinger

Læs mere

Reexam questions in Statistics and Evidence-based medicine, august sem. Medis/Medicin, Modul 2.4.

Reexam questions in Statistics and Evidence-based medicine, august sem. Medis/Medicin, Modul 2.4. Reexam questions in Statistics and Evidence-based medicine, august 2013 2. sem. Medis/Medicin, Modul 2.4. Statistics : ESSAY-TYPE QUESTION 1. Intelligence tests are constructed such that the average score

Læs mere

Den nye Eurocode EC Geotenikerdagen Morten S. Rasmussen

Den nye Eurocode EC Geotenikerdagen Morten S. Rasmussen Den nye Eurocode EC1997-1 Geotenikerdagen Morten S. Rasmussen UDFORDRINGER VED EC 1997-1 HVAD SKAL VI RUNDE - OPBYGNINGEN AF DE NYE EUROCODES - DE STØRSTE UDFORDRINGER - ER DER NOGET POSITIVT? 2 OPBYGNING

Læs mere

Gusset Plate Connections in Tension

Gusset Plate Connections in Tension Gusset Plate Connections in Tension Jakob Schmidt Olsen BSc Thesis Department of Civil Engineering 2014 DTU Civil Engineering June 2014 i Preface This project is a BSc project credited 20 ECTS points written

Læs mere

Trolling Master Bornholm 2016 Nyhedsbrev nr. 3

Trolling Master Bornholm 2016 Nyhedsbrev nr. 3 Trolling Master Bornholm 2016 Nyhedsbrev nr. 3 English version further down Den første dag i Bornholmerlaks konkurrencen Formanden for Bornholms Trollingklub, Anders Schou Jensen (og meddomer i TMB) fik

Læs mere

Unitel EDI MT940 June 2010. Based on: SWIFT Standards - Category 9 MT940 Customer Statement Message (January 2004)

Unitel EDI MT940 June 2010. Based on: SWIFT Standards - Category 9 MT940 Customer Statement Message (January 2004) Unitel EDI MT940 June 2010 Based on: SWIFT Standards - Category 9 MT940 Customer Statement Message (January 2004) Contents 1. Introduction...3 2. General...3 3. Description of the MT940 message...3 3.1.

Læs mere

To the reader: Information regarding this document

To the reader: Information regarding this document To the reader: Information regarding this document All text to be shown to respondents in this study is going to be in Danish. The Danish version of the text (the one, respondents are going to see) appears

Læs mere

F o r t o l k n i n g e r a f m a n d a l a e r i G I M - t e r a p i

F o r t o l k n i n g e r a f m a n d a l a e r i G I M - t e r a p i F o r t o l k n i n g e r a f m a n d a l a e r i G I M - t e r a p i - To fortolkningsmodeller undersøgt og sammenlignet ifm. et casestudium S i g r i d H a l l b e r g Institut for kommunikation Aalborg

Læs mere

Agenda. The need to embrace our complex health care system and learning to do so. Christian von Plessen Contributors to healthcare services in Denmark

Agenda. The need to embrace our complex health care system and learning to do so. Christian von Plessen Contributors to healthcare services in Denmark Agenda The need to embrace our complex health care system and learning to do so. Christian von Plessen Contributors to healthcare services in Denmark Colitis and Crohn s association Denmark. Charlotte

Læs mere

Åbenrå Orienteringsklub

Åbenrå Orienteringsklub Åbenrå Orienteringsklub Velkommen til det ægte orienteringsløb på Blå Sommer 2009 Din gruppe har tilmeldt spejdere til at deltage i det ægte orienteringsløb på Blå Sommer 2009. Orienteringsløbet gennemføres

Læs mere

Special VFR. - ved flyvning til mindre flyveplads uden tårnkontrol som ligger indenfor en kontrolzone

Special VFR. - ved flyvning til mindre flyveplads uden tårnkontrol som ligger indenfor en kontrolzone Special VFR - ved flyvning til mindre flyveplads uden tårnkontrol som ligger indenfor en kontrolzone SERA.5005 Visual flight rules (a) Except when operating as a special VFR flight, VFR flights shall be

Læs mere

Trolling Master Bornholm 2016 Nyhedsbrev nr. 7

Trolling Master Bornholm 2016 Nyhedsbrev nr. 7 Trolling Master Bornholm 2016 Nyhedsbrev nr. 7 English version further down Så var det omsider fiskevejr En af dem, der kom på vandet i en af hullerne, mellem den hårde vestenvind var Lejf K. Pedersen,

Læs mere

Skriftlig Eksamen Beregnelighed (DM517)

Skriftlig Eksamen Beregnelighed (DM517) Skriftlig Eksamen Beregnelighed (DM517) Institut for Matematik & Datalogi Syddansk Universitet Mandag den 31 Oktober 2011, kl. 9 13 Alle sædvanlige hjælpemidler (lærebøger, notater etc.) samt brug af lommeregner

Læs mere

IBM Network Station Manager. esuite 1.5 / NSM Integration. IBM Network Computer Division. tdc - 02/08/99 lotusnsm.prz Page 1

IBM Network Station Manager. esuite 1.5 / NSM Integration. IBM Network Computer Division. tdc - 02/08/99 lotusnsm.prz Page 1 IBM Network Station Manager esuite 1.5 / NSM Integration IBM Network Computer Division tdc - 02/08/99 lotusnsm.prz Page 1 New esuite Settings in NSM The Lotus esuite Workplace administration option is

Læs mere

Nyhedsmail, december 2013 (scroll down for English version)

Nyhedsmail, december 2013 (scroll down for English version) Nyhedsmail, december 2013 (scroll down for English version) Kære Omdeler Julen venter rundt om hjørnet. Og netop julen er årsagen til, at NORDJYSKE Distributions mange omdelere har ekstra travlt med at

Læs mere

User Manual for LTC IGNOU

User Manual for LTC IGNOU User Manual for LTC IGNOU 1 LTC (Leave Travel Concession) Navigation: Portal Launch HCM Application Self Service LTC Self Service 1. LTC Advance/Intimation Navigation: Launch HCM Application Self Service

Læs mere

Nayda G. Santiago Femprof Program September 18, 2008

Nayda G. Santiago Femprof Program September 18, 2008 Nayda G. Santiago Femprof Program September 18, 2008 Why Persuasive writing Purpose Content Issues Advise Exercise Most important part of your application. Convince the admission committee in a very short

Læs mere

Blomsten er rød (af Harry Chapin, oversat af Niels Hausgaard)

Blomsten er rød (af Harry Chapin, oversat af Niels Hausgaard) Blomsten er rød (af Harry Chapin, oversat af Niels Hausgaard) På den allerførste skoledag fik de farver og papir. Den lille dreng farved arket fuldt. Han ku bare ik la vær. Og lærerinden sagde: Hvad er

Læs mere

Appendix 1: Interview guide Maria og Kristian Lundgaard-Karlshøj, Ausumgaard

Appendix 1: Interview guide Maria og Kristian Lundgaard-Karlshøj, Ausumgaard Appendix 1: Interview guide Maria og Kristian Lundgaard-Karlshøj, Ausumgaard Fortæl om Ausumgaard s historie Der er hele tiden snak om værdier, men hvad er det for nogle værdier? uddyb forklar definer

Læs mere

Statistical information form the Danish EPC database - use for the building stock model in Denmark

Statistical information form the Danish EPC database - use for the building stock model in Denmark Statistical information form the Danish EPC database - use for the building stock model in Denmark Kim B. Wittchen Danish Building Research Institute, SBi AALBORG UNIVERSITY Certification of buildings

Læs mere

NOTIFICATION. - An expression of care

NOTIFICATION. - An expression of care NOTIFICATION - An expression of care Professionals who work with children and young people have a special responsibility to ensure that children who show signs of failure to thrive get the wright help.

Læs mere

DK - Quick Text Translation. HEYYER Net Promoter System Magento extension

DK - Quick Text Translation. HEYYER Net Promoter System Magento extension DK - Quick Text Translation HEYYER Net Promoter System Magento extension Version 1.0 15-11-2013 HEYYER / Email Templates Invitation Email Template Invitation Email English Dansk Title Invitation Email

Læs mere

Userguide. NN Markedsdata. for. Microsoft Dynamics CRM 2011. v. 1.0

Userguide. NN Markedsdata. for. Microsoft Dynamics CRM 2011. v. 1.0 Userguide NN Markedsdata for Microsoft Dynamics CRM 2011 v. 1.0 NN Markedsdata www. Introduction Navne & Numre Web Services for Microsoft Dynamics CRM hereafter termed NN-DynCRM enable integration to Microsoft

Læs mere

Trolling Master Bornholm 2016 Nyhedsbrev nr. 6

Trolling Master Bornholm 2016 Nyhedsbrev nr. 6 Trolling Master Bornholm 2016 Nyhedsbrev nr. 6 English version further down Johnny Nielsen med 8,6 kg laks Laksen blev fanget seks sømil ud for Tejn. Det var faktisk dobbelthug, så et kig ned i køletasken

Læs mere

About the course: (Please comment to your right) - To which degree has the course facilitated learning the skills outlined in the academic aims?

About the course: (Please comment to your right) - To which degree has the course facilitated learning the skills outlined in the academic aims? Course: Monetary Policy % 48 % 7 % Overall Status New % Distributed 54% Partially Complete % Complete 4% Rejected % % 7 % (Please comment to your right) - To which degree has the course facilitated learning

Læs mere

Kvant Eksamen December 2010 3 timer med hjælpemidler. 1 Hvad er en continuous variable? Giv 2 illustrationer.

Kvant Eksamen December 2010 3 timer med hjælpemidler. 1 Hvad er en continuous variable? Giv 2 illustrationer. Kvant Eksamen December 2010 3 timer med hjælpemidler 1 Hvad er en continuous variable? Giv 2 illustrationer. What is a continuous variable? Give two illustrations. 2 Hvorfor kan man bedre drage konklusioner

Læs mere

Patientinddragelse i forskning. Lars Henrik Jensen Overlæge, ph.d., lektor

Patientinddragelse i forskning. Lars Henrik Jensen Overlæge, ph.d., lektor Patientinddragelse i forskning Lars Henrik Jensen Overlæge, ph.d., lektor BMC Health Services Research 2014, 14:89 142 studies that described a spectrum of engagement Engagement was feasible in most settings

Læs mere

Titel: Barry s Bespoke Bakery

Titel: Barry s Bespoke Bakery Titel: Tema: Kærlighed, kager, relationer Fag: Engelsk Målgruppe: 8.-10.kl. Data om læremidlet: Tv-udsendelse: SVT2, 03-08-2014, 10 min. Denne pædagogiske vejledning indeholder ideer til arbejdet med tema

Læs mere

Barnets navn: Børnehave: Kommune: Barnets modersmål (kan være mere end et)

Barnets navn: Børnehave: Kommune: Barnets modersmål (kan være mere end et) Forældreskema Barnets navn: Børnehave: Kommune: Barnets modersmål (kan være mere end et) Barnets alder: år og måneder Barnet begyndte at lære dansk da det var år Søg at besvare disse spørgsmål så godt

Læs mere

Design til digitale kommunikationsplatforme-f2013

Design til digitale kommunikationsplatforme-f2013 E-travellbook Design til digitale kommunikationsplatforme-f2013 ITU 22.05.2013 Dreamers Lana Grunwald - svetlana.grunwald@gmail.com Iya Murash-Millo - iyam@itu.dk Hiwa Mansurbeg - hiwm@itu.dk Jørgen K.

Læs mere

Domestic violence - violence against women by men

Domestic violence - violence against women by men ICASS 22 26 august 2008 Nuuk Domestic violence - violence against women by men Mariekathrine Poppel Email: mkp@ii.uni.gl Ilisimatusarfik University of Greenland Violence: : a concern in the Arctic? Artic

Læs mere

Titel Stutterer. Data om læremidlet: Tv-udsendelse 1: Stutterer Kortfilm SVT 2, , 14 minutter

Titel Stutterer. Data om læremidlet: Tv-udsendelse 1: Stutterer Kortfilm SVT 2, , 14 minutter Pædagogisk vejledning Titel Stutterer Tema: kærlighed Fag: Engelsk Målgruppe: 8.-10.kl. QR-koden fører til posten i mitcfu Data om læremidlet: Tv-udsendelse 1: Stutterer Kortfilm SVT 2, 11-09-2016, 14

Læs mere

Business Opening. Very formal, recipient has a special title that must be used in place of their name

Business Opening. Very formal, recipient has a special title that must be used in place of their name - Opening English Danish Dear Mr. President, Kære Hr. Direktør, Very formal, recipient has a special title that must be used in place of their name Dear Sir, Formal, male recipient, name unknown Dear Madam,

Læs mere

Business Opening. Very formal, recipient has a special title that must be used in place of their name

Business Opening. Very formal, recipient has a special title that must be used in place of their name - Opening Danish English Kære Hr. Direktør, Dear Mr. President, Very formal, recipient has a special title that must be used in place of their name Kære Hr., Formal, male recipient, name unknown Kære Fru.,

Læs mere

Evaluating Germplasm for Resistance to Reniform Nematode. D. B. Weaver and K. S. Lawrence Auburn University

Evaluating Germplasm for Resistance to Reniform Nematode. D. B. Weaver and K. S. Lawrence Auburn University Evaluating Germplasm for Resistance to Reniform Nematode D. B. Weaver and K. S. Lawrence Auburn University Major objectives Evaluate all available accessions of G. hirsutum (TX list) for reaction to reniform

Læs mere

USERTEC USER PRACTICES, TECHNOLOGIES AND RESIDENTIAL ENERGY CONSUMPTION

USERTEC USER PRACTICES, TECHNOLOGIES AND RESIDENTIAL ENERGY CONSUMPTION USERTEC USER PRACTICES, TECHNOLOGIES AND RESIDENTIAL ENERGY CONSUMPTION P E R H E I S E L BERG I N S T I T U T F OR BYGGERI OG A N L Æ G BEREGNEDE OG FAKTISKE FORBRUG I BOLIGER Fra SBi rapport 2016:09

Læs mere

VEDLIGEHOLDELSE AF SENGE

VEDLIGEHOLDELSE AF SENGE DK VEDLIGEHOLDELSE AF SENGE VEDLIGEHOLDELSE AF SENGE Sengen er typisk det møbel i hjemmet som bruges i flest timer gennem døgnet. Det betyder at sengen udsættes for et stort slid, og det er derfor vigtigt

Læs mere

Listen Mr Oxford Don, Additional Work

Listen Mr Oxford Don, Additional Work 57 (104) Listen Mr Oxford Don, Additional Work Listen Mr Oxford Don Crosswords Across 1 Attack someone physically or emotionally (7) 6 Someone who helps another person commit a crime (9) 7 Rob at gunpoint

Læs mere

Trolling Master Bornholm 2016 Nyhedsbrev nr. 8

Trolling Master Bornholm 2016 Nyhedsbrev nr. 8 Trolling Master Bornholm 2016 Nyhedsbrev nr. 8 English version further down Der bliver landet fisk men ikke mange Her er det Johnny Nielsen, Søløven, fra Tejn, som i denne uge fangede 13,0 kg nord for

Læs mere

Feedback Informed Treatment

Feedback Informed Treatment Feedback Informed Treatment Talk in your work groups: Discuss how FIT can make sense in your work context. Discuss benefits and challenges of using FIT in your work place. Generate questions for Susanne

Læs mere

My Opinion about.. The military TVMV, Denmark

My Opinion about.. The military TVMV, Denmark My Opinion about.. Presenter: What are the young people in Denmark thinking of the military. Here are some opinions: Names of participants are written in translation Camera: Editing: Sound: Duration: 2

Læs mere

Titel Found. Data om læremidlet: Pædagogisk vejledning Tema: Kærlighed Fag: Engelsk Målgruppe: kl.

Titel Found. Data om læremidlet: Pædagogisk vejledning  Tema: Kærlighed Fag: Engelsk Målgruppe: kl. Pædagogisk vejledning Titel Found Tema: Kærlighed Fag: Engelsk Målgruppe: 8.-10.kl. QR-kode fører til posten i mitcfu Data om læremidlet: Tv-udsendelse 1: Found Kortfilm SV2 TV0000028173, 19-01-2014, 20

Læs mere

Fejlbeskeder i SMDB. Business Rules Fejlbesked Kommentar. Validate Business Rules. Request- ValidateRequestRegist ration (Rules :1)

Fejlbeskeder i SMDB. Business Rules Fejlbesked Kommentar. Validate Business Rules. Request- ValidateRequestRegist ration (Rules :1) Fejlbeskeder i SMDB Validate Business Rules Request- ValidateRequestRegist ration (Rules :1) Business Rules Fejlbesked Kommentar the municipality must have no more than one Kontaktforløb at a time Fejl

Læs mere

Exercise 6.14 Linearly independent vectors are also affinely independent.

Exercise 6.14 Linearly independent vectors are also affinely independent. Affine sets Linear Inequality Systems Definition 6.12 The vectors v 1, v 2,..., v k are affinely independent if v 2 v 1,..., v k v 1 is linearly independent; affinely dependent, otherwise. We first check

Læs mere

How Al-Anon Works - for Families & Friends of Alcoholics. Pris: kr. 130,00 Ikke på lager i øjeblikket Vare nr. 74 Produktkode: B-22.

How Al-Anon Works - for Families & Friends of Alcoholics. Pris: kr. 130,00 Ikke på lager i øjeblikket Vare nr. 74 Produktkode: B-22. Bøger på engelsk How Al-Anon Works - for Families & Friends of Alcoholics Al-Anons grundbog på engelsk, der indfører os i Al- Anon programmet. Om Al-Anons historie, om forståelse af os selv og alkoholismen.

Læs mere

Cross-Sectorial Collaboration between the Primary Sector, the Secondary Sector and the Research Communities

Cross-Sectorial Collaboration between the Primary Sector, the Secondary Sector and the Research Communities Cross-Sectorial Collaboration between the Primary Sector, the Secondary Sector and the Research Communities B I R G I T T E M A D S E N, P S Y C H O L O G I S T Agenda Early Discovery How? Skills, framework,

Læs mere

Skriftlig Eksamen Automatteori og Beregnelighed (DM17)

Skriftlig Eksamen Automatteori og Beregnelighed (DM17) Skriftlig Eksamen Automatteori og Beregnelighed (DM17) Institut for Matematik & Datalogi Syddansk Universitet Odense Campus Lørdag, den 15. Januar 2005 Alle sædvanlige hjælpemidler (lærebøger, notater

Læs mere

Mandara. PebbleCreek. Tradition Series. 1,884 sq. ft robson.com. Exterior Design A. Exterior Design B.

Mandara. PebbleCreek. Tradition Series. 1,884 sq. ft robson.com. Exterior Design A. Exterior Design B. Mandara 1,884 sq. ft. Tradition Series Exterior Design A Exterior Design B Exterior Design C Exterior Design D 623.935.6700 robson.com Tradition OPTIONS Series Exterior Design A w/opt. Golf Cart Garage

Læs mere

Trolling Master Bornholm 2015

Trolling Master Bornholm 2015 Trolling Master Bornholm 2015 (English version further down) Sæsonen er ved at komme i omdrejninger. Her er det John Eriksen fra Nexø med 95 cm og en kontrolleret vægt på 11,8 kg fanget på østkysten af

Læs mere

HEVAL: EN DANSK SOLDATS AUTENTISKE BERETNING FRA FRONTEN I KRIGEN MOD ISLAMISK STAT (DANISH EDITION) BY JORGEN NICOLAI

HEVAL: EN DANSK SOLDATS AUTENTISKE BERETNING FRA FRONTEN I KRIGEN MOD ISLAMISK STAT (DANISH EDITION) BY JORGEN NICOLAI HEVAL: EN DANSK SOLDATS AUTENTISKE BERETNING FRA FRONTEN I KRIGEN MOD ISLAMISK STAT (DANISH EDITION) BY JORGEN NICOLAI READ ONLINE AND DOWNLOAD EBOOK : HEVAL: EN DANSK SOLDATS AUTENTISKE BERETNING FRA

Læs mere

Help / Hjælp

Help / Hjælp Home page Lisa & Petur www.lisapetur.dk Help / Hjælp Help / Hjælp General The purpose of our Homepage is to allow external access to pictures and videos taken/made by the Gunnarsson family. The Association

Læs mere

how to save excel as pdf

how to save excel as pdf 1 how to save excel as pdf This guide will show you how to save your Excel workbook as PDF files. Before you do so, you may want to copy several sheets from several documents into one document. To do so,

Læs mere

Analyseinstitut for Forskning

Analyseinstitut for Forskning Analyseinstitut for Forskning CIS3 The Danish Non-response Analysis Peter S. Mortensen Notat 2003/1 fra Analyseinstitut for Forskning The Danish Institute for Studies in Research and Research Policy Finlandsgade

Læs mere

Shooting tethered med Canon EOS-D i Capture One Pro. Shooting tethered i Capture One Pro 6.4 & 7.0 på MAC OS-X 10.7.5 & 10.8

Shooting tethered med Canon EOS-D i Capture One Pro. Shooting tethered i Capture One Pro 6.4 & 7.0 på MAC OS-X 10.7.5 & 10.8 Shooting tethered med Canon EOS-D i Capture One Pro Shooting tethered i Capture One Pro 6.4 & 7.0 på MAC OS-X 10.7.5 & 10.8 For Canon EOS-D ejere der fotograferer Shooting tethered med EOS-Utility eller

Læs mere

Web-seminar. 30 March Noter

Web-seminar. 30 March Noter Web-seminar 30 March 2017 Noter Følg mig på www.tomhougaard.dk Hvad er Day Trading og Spekulation? Attachment is the great fabricator of illusions; reality can be attained only by someone who is detached.

Læs mere

Dagens program. Incitamenter 4/19/2018 INCITAMENTSPROBLEMER I FORBINDELSE MED DRIFTSFORBEDRINGER. Incitamentsproblem 1 Understøttes procesforbedringer

Dagens program. Incitamenter 4/19/2018 INCITAMENTSPROBLEMER I FORBINDELSE MED DRIFTSFORBEDRINGER. Incitamentsproblem 1 Understøttes procesforbedringer INCITAMENTSPROBLEMER I FORBINDELSE MED DRIFTSFORBEDRINGER Ivar Friis, Institut for produktion og erhvervsøkonomi, CBS 19. april Alumni oplæg Dagens program 2 Incitamentsproblem 1 Understøttes procesforbedringer

Læs mere

Voice of the People. Manuscript The Parliament in Latvia TVMV, Denmark. Production-team: Reporter: Jesper Mortensen

Voice of the People. Manuscript The Parliament in Latvia TVMV, Denmark. Production-team: Reporter: Jesper Mortensen Voice of the People Manuscript The Parliament in Latvia TVMV, Denmark Production-team: Reporter: Jesper Mortensen Photographer: Lars Damgaard Nielsen Editing: Jesper Mortensen Places of shooting: Riga,

Læs mere

Teknologi & Uddannelse

Teknologi & Uddannelse Teknologi & Uddannelse ~Access determinisme? Samspillet mellem teknologi og samfund We don't need no school...experience strongly suggests that an incremental increase of more of the same building schools,

Læs mere

Dårlig litteratur sælger - Trykkekultur i 1800-tallets Storbritannien og idag. Maria Damkjær Post.doc. i Engelsk Litteratur

Dårlig litteratur sælger - Trykkekultur i 1800-tallets Storbritannien og idag. Maria Damkjær Post.doc. i Engelsk Litteratur Dårlig litteratur sælger - Trykkekultur i 1800-tallets Storbritannien og idag Maria Damkjær Post.doc. i Engelsk Litteratur Horace Engdahl i interview i Politiken Bøger, 7. december 2014: [Hos os i Norden]

Læs mere

What s Love Got to Do With It?

What s Love Got to Do With It? What s Love Got to Do With It? Gram Grid Present Continuous Vi sætter verberne i ing-form, når vi vil beskrive at noget er i gang. Der er fire hovedkategorier af ing-form: 1 Den almindelige form (common

Læs mere

Overblik Program 17. nov

Overblik Program 17. nov Overblik Program 17. nov Oplæg, diskussion og sketchnoting af artikler Pencils before pixels, Drawing as... og Learning as reflective conversation... Intro til markers Øvelser: Formundersøgelser & idegenerering

Læs mere

Danish Language Course for International University Students Copenhagen, 12 July 1 August Application form

Danish Language Course for International University Students Copenhagen, 12 July 1 August Application form Danish Language Course for International University Students Copenhagen, 12 July 1 August 2017 Application form Must be completed on the computer in Danish or English All fields are mandatory PERSONLIGE

Læs mere

Engelsk G Opgaveark. Maj 2011. Dato Prøveafholdende institution Tilsynsførende

Engelsk G Opgaveark. Maj 2011. Dato Prøveafholdende institution Tilsynsførende Engelsk G Opgaveark Maj 2011 Eksaminandens navn Nummer Dato Prøveafholdende institution Tilsynsførende Jeg bekræfter herved med min underskrift, at opgavebesvarelsen er udarbejdet af mig. Jeg har ikke

Læs mere

Curve Modeling B-Spline Curves. Dr. S.M. Malaek. Assistant: M. Younesi

Curve Modeling B-Spline Curves. Dr. S.M. Malaek. Assistant: M. Younesi Curve Modeling B-Spline Curves Dr. S.M. Malaek Assistant: M. Younesi Motivation B-Spline Basis: Motivation Consider designing the profile of a vase. The left figure below is a Bézier curve of degree 11;

Læs mere

Sustainable use of pesticides on Danish golf courses

Sustainable use of pesticides on Danish golf courses Indsæt nyt billede: Sustainable use of pesticides on Danish golf courses Anita Fjelsted - Danish EPA Ministry of the Environment 27 May 2015 - STERF The Danish Environmental Protection Agency 450 employees

Læs mere

Workshop in Participatory Video: 11-12 Dec 2008

Workshop in Participatory Video: 11-12 Dec 2008 Workshop in Participatory Video: 11-12 Dec 2008 Casestory Fortæl en historie om det at være fremmed i en ny kultur. Hvad kan du fortælle danskere, så de bedre forstår, hvordan det er at være fremmed i

Læs mere

University of Copenhagen Faculty of Science Written Exam - 3. April Algebra 3

University of Copenhagen Faculty of Science Written Exam - 3. April Algebra 3 University of Copenhagen Faculty of Science Written Exam - 3. April 2009 Algebra 3 This exam contains 5 exercises which are to be solved in 3 hours. The exercises are posed in an English and in a Danish

Læs mere

Handout 1: Eksamensspørgsmål

Handout 1: Eksamensspørgsmål Handout 1: Eksamensspørgsmål Denne vejledning er udfærdiget på grundlag af Peter Bakkers vejledning til jeres eksamensspørgsmål. Hvis der skulle forekomme afvigelser fra Peter Bakkers vejledning, er det

Læs mere

INTEL INTRODUCTION TO TEACHING AND LEARNING AARHUS UNIVERSITET

INTEL INTRODUCTION TO TEACHING AND LEARNING AARHUS UNIVERSITET INTEL INTRODUCTION TO TEACHING AND LEARNING 8 BÆRENDE PRINCIPPER 1-4: BÆREDYGTIGT OG FLEKSIBELT Billigt Nemt at administrere Skalérbart Fleksibelt 5: RELEVANT Indhold organiseret i themes 6: EKSEMPLARISK

Læs mere