<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	>

<channel>
	<title>Spincycle &#187; Philosophy</title>
	<atom:link href="http://gbytes.gsood.com/category/philosophy/feed/" rel="self" type="application/rss+xml" />
	<link>http://gbytes.gsood.com</link>
	<description></description>
	<pubDate>Fri, 21 Nov 2008 22:10:56 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.6.3</generator>
	<language>en</language>
			<item>
		<title>Analyzing epistemic gains, and robustness of prediction markets</title>
		<link>http://gbytes.gsood.com/2008/03/09/analyzing-epistemic-gains-and-robustness-of-prediction-markets/</link>
		<comments>http://gbytes.gsood.com/2008/03/09/analyzing-epistemic-gains-and-robustness-of-prediction-markets/#comments</comments>
		<pubDate>Sun, 09 Mar 2008 21:10:38 +0000</pubDate>
		<dc:creator>spin</dc:creator>
		
		<category><![CDATA[Philosophy]]></category>

		<guid isPermaLink="false">http://gbytes.gsood.com/2008/03/09/analyzing-epistemic-gains-and-robustness-of-prediction-markets/</guid>
		<description><![CDATA[Since at least James Suroweicki&#8217;s &#8220;Wisdom of the crowds&#8221;, a multitude of scholars involved in the field of epistemic democracy have taken to theorizing epistemic utility of tools like &#8220;Prediction Markets&#8221;, and even the &#8220;Wikipedia&#8221; model. Cass Sunstein, a Professor of Law at University of Chicago, has in particular been effective in advocating the idea [...]]]></description>
			<content:encoded><![CDATA[<p>Since at least James Suroweicki&#8217;s &#8220;Wisdom of the crowds&#8221;, a multitude of scholars involved in the field of epistemic democracy have taken to theorizing epistemic utility of tools like &#8220;Prediction Markets&#8221;, and even the &#8220;Wikipedia&#8221; model. Cass Sunstein, a Professor of Law at University of Chicago, has in particular been effective in advocating the idea through a stylized analysis that cherry picks successfully working corporate prediction markets and ignores problems like the current morass of InTrade. Here below I analyze the conditions under which predictions markets can deliver their theorized epistemic gains, and test their robustness to violation of optimal conditions. I however start with analyzing a comparison that political scientist Josiah Ober makes between Ostracism and Prediction Markets and in doing so lay out some of the essential features of markets.</p>
<p><strong>Josiah Ober and Learning from Athens</strong></p>
<p>Ober has been a keen exponent of the idea that ancient Athens had institutions that ably aggregated information from citizens, and fostered &#8220;considered&#8221; judgments. In his <a href="http://bostonreview.net/BR31.2/ober.html">Boston Review article</a>, he strangely argues that the decision to build hundreds of warships, prodded by Oracle (!) and now known deliberate misinformation by Themistocles, led to an ultimately &#8216;right&#8217; decision by the assembly to build warships and not say distribute the windfall from the silver mines to the average citizen. There are two problems here – one is epistemological with its reliance on Oracles for signs, and the other is use of manipulative information ala Cheneyesque. It is impossible to answer whether Persia attacked because they felt inklings of a threat due to the huge armada of ships that Athens had built.</p>
<p>At another place, Ober has compared the first step of Ostracism proceedings - the Demos taking a vote to determine whether to hold ostracism or not - with Prediction Markets.  He argues that the vote to hold Ostracism or not aggregated individual level information or predictions about whether there is &#8220;someone&#8221; whose presence is pernicious enough so as to merit Ostracism. There are three pitfalls to such comparisons and I will deal with them individually. Firstly, Ostracism didn&#8217;t provide people with direct private economic incentives to reveal private information or seek &#8220;correct&#8221; information, and something which economists believe is essential (it is also born out in experiments).  To counteract this argument, Dr. Ober argues that the manifest threat of making a &#8220;wrong&#8221; decision was large enough to impel citizens to gather the best information. There are two problems with this argument – penalties for making wrong decision fall on a continuum and are rarely either prosperity or annihilation (certainly the case in Themistocles and Persia), and secondly even in presence of immanent threats (something not quiet true in this case as the threat is defined vaguely as &#8220;wrong decision&#8221;- which is a little different from the most informed decision) to groups &#8220;collective action problem&#8221; prevails - albeit in an extenuated form. </p>
<p>In ancient Athens, decision to hold Ostracism or not was made through a vote. Vote is a deeply impoverished aggregator of private information for with each dip you get only a yes or a no. This impoverished information sharing also exerts enormous pressure on distribution of &#8220;right&#8221; information among the population for a small minority of &#8220;right&#8221; voters can easily be silenced by a misinformed majority. The only way in fact a Voting system can reliably aggregate information (if choice is binary) is if each dip –on average -has more than 50% chance of being correct. (Condorcet&#8217;s insight)  Markets on the other hand provide for information to be expressed much more precisely through price. (We will come to the violations of this tenet in markets later.) </p>
<p>Unlike in voting, markets deter information (and misinformation unless strategically) sharing although price does send cues (information) to the market. (Of course strategic players fudge investments so as monetize their investment maximally) Suffice it is to say however that voting systems are more prone to aggregating disinformation, than market systems where incentives for gaining &#8220;right information&#8221; increase in tandem with people investing with &#8220;wrong information&#8221;. </p>
<p><strong>Markets, Betting Markets</strong></p>
<p>I will deal with some other issues including assumptions about distribution of private information later in the article. Let me briefly stop here to provide an overview of markets and betting markets in particular.</p>
<p>Markets, when working optimally, are institutions that aggregate all hidden and manifest information and preferences and express it in a one-dimensional optimally defined parameter, price. Since all individual preferences are single-peaked with reference to price, markets are always single-peaked, avoiding aggregation issues and Condorcet&#8217;s paradox. Markets aggregate not only information about demand, and supply but also the utility afforded by the commodity to each individual consumer, and such aggregation optimizes the &#8220;allocative efficiency&#8221;. And apparently all this is done magically – and in Adam Smith&#8217;s coinage at the beckoning of the famous &#8220;invisible hand&#8221;. </p>
<p>Prediction markets – also known under the guises of &#8220;information markets&#8221; or &#8220;idea futures&#8221; among others – tie economic gains to fulfillment of some prediction. The premise is that possibility of economic gain will provide people to reveal hidden information – or more precisely bet optimally without revealing information. Prediction markets are quiet different from regular markets for trading is centralized against a bookmaker that decides the odds after aggregating bets. This type of architecture puts significant constraints on the market than say the architecture of a share market, which is essentially decentralized. I will come to the nature of the constraints later but suffice it is to say that it avoids some of the &#8220;variances&#8221; and &#8220;excesses&#8221; and &#8220;excess variances&#8221; of the decentralized system – the kinds which made Robert J. Shiller turn to behavioral economics from playing with math and monkey wrench models. </p>
<p>Expanding on the nature of prediction markets – &#8220;A prediction market is a market for a contract that yields payments based on the outcome of a partially uncertain future event, such as an election. A contract pays $100 only if candidate X wins the election, and $0 otherwise. When the market price of an X contract is $60, the prediction market believes that candidate X has a 60% chance of winning the election.&#8221;  (Prediction Markets in Theory and Practice -2005 Draft, Justine Wolfers and Eric Zitzewitz) A more robust description is perhaps necessary to explain how bookies come to know about these odds. In much of sports betting, bookies commence betting by arriving at consensus that reflects expert opinions of a small group of professional forecasters. &#8220;If new information on the relative strengths of opposing teams (e.g., a player injury) is announced during that week, the bookie may adjust the spread, particularly if the volume of behavior favors one of the teams. In addition, since the identity of the bettors is known, bookies may also change the spread if professional gamblers place bets disproportionately on one team. To make these adjustments, the bookie moves the spread against the team attracting most of the bets to shift the flow of bets toward its opponent. Shortly before game time, the bookie stops taking bets at the ‘closing’ point spread. Like securities prices at the end of trading, closing spreads are assumed to reflect an up-to-date aggregation the information and, perhaps, biases of the market participants.&#8221; (Golec and Tamarkin, Degree of inefficiency in the football betting market, 1991, Journal of Financial Economics: 30). There are other ways through which a similar arrangement can be executed. For example, computerized software now continually adjust the odds depending on bets. The danger is that you can quickly short the system if you solely rely on anonymous betting data. I will come back to his later. One additional point to finish the description - Given the nature of the commodities or assets traded, we can only get results on questions that have binary answers, and not say discovery questions unless discovery questions can be split into innumerable binary questions. </p>
<p>Before we analyze the betting market efficiency, I would like to present a short list of the previously theorized (and proven) betting market failures or &#8220;instances where the operation of the market delivers outcomes that do not maximize collective welfare.&#8221; There are several forms of market failure:</p>
<blockquote>
<ul>
<li> Imperfect competition – where there is unequal bargaining power between market participants;</li>
<li>Externalities – where the costs of a particular activity are external to the individual or business and imposed on others (e.g. Assassination Markets);</li>
<li>Public goods – where there are goods for which property rights cannot be applied; and </li>
<li> Imperfect information – where market participants are not equally informed.</li>
</ul>
</blockquote>
<p>* Taken from <a href="http://www.olgr.nsw.gov.au/pdfs/ncap_chapter4.doc">Objectives of Betting and Racing Legislation (doc)</a> </p>
<p>*As always, penalties follow some function of the extent of violation. Most effects are non-linear.</p>
<p>Let&#8217;s analyze the epistemic dimension of the market as in its capability to deliver information that is somehow better. The supposition in a prediction market is that people aren&#8217;t revealing (or finding information) for they have inadequate incentives to do so. So betting is merely a way to incentivize the discovery process. It is important to note that merely the fact it assumes that people have private reserves of information (generally amounting to knowledge that other people aren&#8217;t smart) severely limits the role of the prediction markets in areas where there isn&#8217;t such knowledge. Certainly I can&#8217;t think of a lot of public policy arena where it is the case. (It is also important to keep in mind that most policy decisions have a normative dimension aside from some fully informed preference dimension.) Otherwise betting markets merely try to aggregate – and don&#8217;t do so well – public information cues. Simon Jackman in his forthcoming paper that analyzes betting behavior in political markets in Australia has found that betting markets essentially move following the cues of opinion polling results. There is no information source outside of what is already publicly accessible that people rely on to make their bets. So the idea that somehow prediction markets will deliver better results even where privately held reserves of information are low or zero is ludicrous and easily empirically disproved. </p>
<p>More importantly, betting markets – even sophisticated ones like the sports betting markets – are incurably biased - proven statistically multiple times over – they underestimate home field advantage, and all too often &#8220;go with the winners&#8221;. The bias is supported by two intertwining psychological biases - &#8220;safe betting&#8221; and &#8220;betting on favorites&#8221; – and it is a bias found in nearly all betting markets.  </p>
<p>Betting markets behave best if there is complete adversarial betting – which is never the case for most of the price is set by investment by small players following the elite herd. This has defined by Sushil Bikhchandani, David Hirshleifer and Ivo Welch, in a classic 1992 article, as “information cascades” that can lead people into serious error. Shiller recently wrote about this while explaining how the housing bubble (essentially banks betting on loans) stayed under the radar so long.  He quotes the paper at length –</p>
<blockquote><p>
&#8220;Mr. Bikhchandani and his co-authors present this example: Suppose that a group of individuals must make an important decision, based on useful but incomplete information. Each one of them has &#8230; information&#8230;, but the information is incomplete and “noisy” and does not always point to the right conclusion. </p>
<p>Let’s update the example&#8230;: The individuals in the group must each decide whether real estate is a terrific investment&#8230; Suppose that there is a 60 percent probability that any one person’s information will lead to the right decision. &#8230;<br />
Each person makes decisions individually, sequentially, and reveals &#8230; decisions through actions — in this case, by entering the housing market and bidding up home prices. </p>
<p>Suppose houses are really of low investment value, but the first person to make a decision reaches the wrong conclusion (which happens, as we have assumed, 40 percent of the time). The first person, A, pays a high price for a home, thus signaling to others that houses are a good investment. </p>
<p>The second person, B, has no problem if his own data seem to confirm the information provided by A’s willingness to pay a high price. But B faces a quandary if his own information seems to contradict A’s judgment. In that case, B would conclude that he has no worthwhile information, and so he must make an arbitrary decision — say, by flipping a coin to decide whether to buy a house.<br />
The result is that even if houses are of low investment value, we may now have two people who make purchasing decisions that reveal their conclusion that houses are a good investment. </p>
<p>As others make purchases at rising prices, more and more people will conclude that these buyers’ information about the market outweighs their own. </p>
<p>Mr. Bikhchandani and his co-authors worked out this rational herding story carefully, and their results show that the probability of the cascade leading to an incorrect assumption is 37 percent. &#8230; Thus, we should expect to see cascades driving our thinking from time to time, even when everyone is absolutely rational and calculating. </p>
<p>This theory poses a major challenge to the “efficient markets” view of the world&#8230; The efficient-markets view holds that the market is wiser than any individual: in aggregate, the market will come to the correct decision. But the theory is flawed because it does not recognize that people must rely on the judgments of others. &#8230;</p>
<p>It is clear that just such an information cascade helped to create the housing bubble. And it is now possible that a downward cascade will develop — in which rational individuals become excessively pessimistic as they see others bidding down home prices to abnormally low levels. &#8220;</p></blockquote>
<p>Betting markets like all other markets are &#8220;sequential&#8221; with each investor trying to parse tea leaves and motives of prior investors. The impulse to do original research is counterveiled by the costs, and by the fear that others know something that they don&#8217;t.</p>
<p>The other intersecting psychological factor that complicates markets is complete blind betting. Time and again even as information and probabilities converge, some bettors hold out for a miracle. </p>
<p>It is also important to keep in mind the following tenet that governs prediction market behavior– &#8220;Garbage in, garbage out&#8230; Intelligence in, intelligence out…&#8221; So prediction markets – to the extent that they rely on speculation are remarkably likely to follow any information that is likely to give them a leg up. While misinformation theoretically incentivizes procurement of good information, it never pans out empirically for major investment by another is seen as an informational cue, more powerful than whatever access you may have. This is an important point – for the competitor has no way of knowing your information for all s/he has access to is the investment that you make on it, and the space for conjecture about the veracity of the competitor&#8217;s information is immense. This is a market based on never revealing information, and that diminishes the efficiency considerably. </p>
<p>Betting markets merely rely on the fact that you are less misinformed than others, and that gradient can be built through strategically spreading misinformation (quiet common in betting circles) or through some theorized virtuous cycle of increasingly good information. </p>
<p>Betting markets can be easily shot by someone willing to lose some money. Asymmetry in finances can hobble the incentives for betting market and information discovery process. </p>
<p>Lastly, laws against insider trading limit the kind of information bettors have access to. They limit information discovery process severely. Relatedly, information – for it to be monetizable – has to be brought into the system privately so bettors may try to sabotage release of public information. Not only that, they have to be strategic in how they send cues to the market so that they earn the most money from their bets. If done en masse or rashly, it will almost certainly short their bets. So not only do betting markets have only one way of expressing information – price/investment- bettors go to great lengths to hide that cue especially if they know how the cues are being aggregated. </p>
<p>In summary, the above list of problems with betting markets underscores the analytical and empirical evidence against the naïve ill-substantiated unbridled faith in the epistemic prowess of the betting markets.</p>
]]></content:encoded>
			<wfw:commentRss>http://gbytes.gsood.com/2008/03/09/analyzing-epistemic-gains-and-robustness-of-prediction-markets/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Democracy and information: The case for epistemic controls</title>
		<link>http://gbytes.gsood.com/2008/02/14/epistemic-controls/</link>
		<comments>http://gbytes.gsood.com/2008/02/14/epistemic-controls/#comments</comments>
		<pubDate>Fri, 15 Feb 2008 04:01:50 +0000</pubDate>
		<dc:creator>spin</dc:creator>
		
		<category><![CDATA[Philosophy]]></category>

		<guid isPermaLink="false">http://gbytes.gsood.com/2008/02/14/epistemic-controls/</guid>
		<description><![CDATA[First Amendment mandates that &#8220;Congress shall make no law … abridging the freedom of speech …&#8221; Courts have over the years construed the clause in a way that privileges political speech in its various manifestations while ruling to limit the protections afforded to commercial speech. Hence - however limitedly – different regulatory frameworks have emerged [...]]]></description>
			<content:encoded><![CDATA[<p>First Amendment mandates that &#8220;Congress shall make no law … abridging the freedom of speech …&#8221; Courts have over the years construed the clause in a way that privileges political speech in its various manifestations while ruling to limit the protections afforded to commercial speech. Hence - however limitedly – different regulatory frameworks have emerged to control commercial speech in a variety of arenas. So for example, FDA through its Division of Drug Marketing, Advertising, and Communications sets standards for all drug advertisements. For example, it mandates that &#8220;all drug advertisements contain (among other things) information in brief summary relating to side effects, contraindications, and effectiveness.&#8221; Similarly any company listed publicly has to comply with a host of disclosure laws about its finances and business practices that dramatically restrict the kind of claims companies can make – at least about their accounts. The principle behind these mandates is the understanding that public good (in case of stock market – investor good) is served when we limit or penalize disinformation. The further pretext for such laws is that such laws are necessary where supply of information is essentially a monopoly of organizations or people with explicit incentives to lie or strategically misrepresent information. </p>
<p>Arguments for setting epistemic standards for speech in the political arena have been criticized in America on a variety of grounds including that such a law will be unduly restrictive and hard to implement, that free speech is necessary for democracy, free speech is a &#8220;fundamental&#8221; &#8220;human right&#8221; (absent of its necessity or utility) – it is part of Article 19 of UN Declaration of Human Rights, and free speech promotes search for truth, etc. More broadly, there are two major defenses for freedom of speech - a deontological conception of the sanctity of freedom of speech (expression – more broadly), and an instrumental defense of its merits – its necessity for preserving democratic values and ideals etc. It is hard to contest either of the claims: the claim for normative supremacy is hard to make in face of axiomatic judgments about the &#8220;fundamental&#8221; nature of these &#8220;rights&#8221;, and instrumental supremacy is hard to argue given &#8220;democratic values and ideals&#8221; are so loosely defined that they can be spun every which way, and an incommensurable value attached to any of those parts. But let&#8217;s hold this chain of thought for now.<br />
Black&#8217;s Law Dictionary, 5th ed., by Henry Campbell Black, West Publishing Co., St. Paul, Minnesota, 1979, defines fraud as, &#8220;All multifarious means which human ingenuity can devise, and which are resorted to by one individual to get an advantage over another by false suggestions or suppression of the truth. It includes all surprises, tricks, cunning or dissembling, and any unfair way which another is cheated.&#8221;</p>
<p>It is an unsurprisingly vague definition cognizant of the artfulness of the subtlety with which fraud is perpetrated. The law relies on the skill of the prosecutor, and in company&#8217;s case – the defense attorney, and the perspicacity of the judge (or) jury to come up with a judgment as to whether fraud was perpetrated. One can come up with a more restrictive definition of the &#8220;law&#8221; but it would most likely be counterproductive for it would channel effort in perpetrating &#8220;fraud&#8221; that is still technically legal – much like compliance with tax law through using tax havens – and by taking away discretion from the judges, make it impossible to award judgments against patent cases of fraud. In the political arena, people are justifiably skeptical of arriving at limiting definitions, and at submitting speech to be analyzed by a body with fairly large discretionary limits on interpretation of the &#8220;letter of the law&#8221;.  More nefarious motives undoubtedly exist for such protestations – least of them perhaps include worries that such a law would jeopardize their chances at electoral success. Then there is empirical evidence to suggest that politicians are very skillful at being honest without ever telling the truth. A stylistic narrow minded honesty that includes choice picking of their own life and opposition&#8217;s words is currently in vogue, and very hard to guard against. Not to mention the perverse ability to bludgeon the voter with the inconsequential, or ability to strategically shift focus on issues. For example – the 2000 campaign was essentially fought on the grounds of &#8220;whom would one like to have beer with?&#8221;, or the &#8220;Willie Horton&#8221; ad used in 1988 election featuring real life person and story – though of limited evidential value - to skillfully convey race and crime cues to the disadvantage of the Democratic challenger, Michael Dukakis. </p>
<p>Quiet apart from the justifications for &#8220;freedom of speech&#8221; is the claim that we should let the market dictate roughly the proportion of what is heard at what volume, and what isn&#8217;t. The supposition is that market will somehow tune up the volume of the speech in proportion to its appeal to people – with no claims made about its epistemic worth. The ancillary argument is that &#8220;marketplace of ideas&#8221; will sift through ideas in a way that the &#8220;best&#8221; ideas and opinions rise to the top, and additionally even if someone buys more airtime it doesn&#8217;t quiet matter for the public decides whether the idea is in its interest and hence dictates its adoption (popularity). Understandably it is a hopelessly unsupported proposition lacking any merit whatsoever. </p>
<p>The argument that competition alone would be enough to bring the &#8220;product&#8221; with the &#8220;best utility&#8221; (economic utility) to come to the top is doubtful at best, and predicated on a host of bizarre wholly empirically unsupported assumptions. The argument is particularly inapplicable to the domain of &#8220;public goods&#8221; where people have limited incentives to gather enough information, and in systems where information distribution is asymmetric. Anthony Downs expressed worries about &#8220;asymmetric information&#8221; in his 1957 opus, An Economic Theory of Democracy.  There is indeed a steadily increasing penalty for disinformation and the resulting sub-optimal decisions, but given the low efficacy that people feel (among other things), their interest and motivation remains in making themselves more informed low. Given such conditions, we need – more strongly than a regulatory framework governing information dispersal in private economic choices – a similar mechanism so as to mitigate some of the most severe problems. </p>
<p>One of the ways - and one that would be appealing to all political parties and free speech advocates - through which we can mitigate some of the problems in the current information regime would be to mandate release of government information. Transparency has been found to increase attendance of teachers in rural schools, and distribution of funds to people in rural employment scheme in India, attendance of legislators in Uganda etc. FOIA works to a great degree in US and it is arguable that the gravest trespasses occur where the reach of the statute is the most limited – &#8220;national defense&#8221;. Transparency is effective because it creates opportunities for accountability. It however also foments strategic compliance. For example, as I mentioned earlier – we now have fairly truthful ads that systematically misrepresent issues and positions of opposition. Graver still is the issue that transparency only works to a limited degree in a country where people are apathetic, and media absconding. For example, while America has inarguably the largest trove of publicly available data including statistics on economics, labor etc. – they are hardly ever part of the public discourse. The corrective solution flows directly from the way I describe the problem –creating an aware media that works to highlight these facts and put issues and positions in context. </p>
<p>Let me take a moment to argue that given mass media is currently the dominant way through which people get information, any proposal for instituting epistemic controls has to cover media.  Similarly, any proposal for epistemic controls has to not only ensure epistemic superiority of the resulting commentary, but also regulate how it is presented so as to be useful to the masses. In other words, the framework has to take into account the state of the masses, and how they process information. Given the psycho-cognitive research by Kahneman and others, we know that people regularly ignore base rate information in favor of illustrative anecdotes - the way news is traditionally offered. We also know enough through the priming literature that repeatedly bringing up an issue –regardless of context – increases its salience in decision making. </p>
<p>Given the difficulty in mounting such controls, perhaps the best epistemic intervention that we can provide is an educative one. There is ample evidence that if we improve people&#8217;s understanding of what constitutes valid and pertinent evidence, and even help inculcate simple skills like numeric literary - we can have a tangible impact on the way people make decisions and how they respond to appeals.</p>
]]></content:encoded>
			<wfw:commentRss>http://gbytes.gsood.com/2008/02/14/epistemic-controls/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Causality and Generalization in Qualitative and Quantitative methods: A second look (part 2)</title>
		<link>http://gbytes.gsood.com/2007/11/19/causality-and-generalization-in-qualitative-and-quantitative-methods-a-second-look-part-2/</link>
		<comments>http://gbytes.gsood.com/2007/11/19/causality-and-generalization-in-qualitative-and-quantitative-methods-a-second-look-part-2/#comments</comments>
		<pubDate>Tue, 20 Nov 2007 02:50:58 +0000</pubDate>
		<dc:creator>spin</dc:creator>
		
		<category><![CDATA[Philosophy]]></category>

		<guid isPermaLink="false">http://gbytes.gsood.com/2007/11/19/causality-and-generalization-in-qualitative-and-quantitative-methods-a-second-look-part-2/</guid>
		<description><![CDATA[King et al. (1994: 75, note 1): ‘[a]t its core, real explanation is always based on causal inferences’. 
Limiting Discussion to positivist Qualitative Methods
Qualitative Methods can be roughly divided into positivist (case-studies etc.) and interpretive. I will limit my comments to positivist Qualitative Methods. The differences between positivist qualitative and quantitative methods ‘are only stylistic [...]]]></description>
			<content:encoded><![CDATA[<p>King et al. (1994: 75, note 1): ‘[a]t its core, real explanation is always based on causal inferences’. </p>
<p><strong>Limiting Discussion to positivist Qualitative Methods</strong></p>
<p>Qualitative Methods can be roughly divided into positivist (case-studies etc.) and interpretive. I will limit my comments to positivist Qualitative Methods. The differences between positivist qualitative and quantitative methods ‘are only stylistic and are methodologically and substantively unimportant’ (King et al., 1994:4). Both methods share ‘an epistemological logic of inference: they all agree on the importance of testing theories empirically, generating an inclusive list of alternative explanations and their observable implications, and specifying what evidence might infirm or affirm a theory’ (King et al. 1994: 3). </p>
<p><strong>Causal Inference in Empirical Data</strong></p>
<p>To impute causality, science relies either on evidence based process knowledge, or clever experiment design that obviates (perhaps more correctly, mitigates) the need to know the process – though researchers often are encouraged to have a story to explain the process, and test variables implicated in the &#8217;story&#8217;. </p>
<p>Experimentation provides one of the best ways to reliably impute causality. However for experiments to have value outside (the labs), the &#8216;treatment&#8217; must be &#8216;ecological&#8217;  as in reflect the typical values that the variables takes in the world –for example, effect of news is best measured with either real life news clips or something similar, and the findings must hold up in the field (through surveys/field experiments). The problem is that most problems in Social Science cannot be studied experimentally. Brady et al. (2001:8) write: ‘A central reason why both qualitative and quantitative research are hard to do well is that any study based on observational (i.e., non-experimental) data faces the fundamental inferential challenge of eliminating rival explanations’. While most Social Science papers (and certainly practitioners) talk about &#8216;eliminating&#8217; rival explanations, one doesn&#8217;t quiet have to do that. Social Scientists often times include variables reflecting &#8216;rival explanations&#8217; as &#8217;straw variables&#8217; (to refer to the straw man they will blow at the end) in a regression equation, to show how much variance is &#8216;explained&#8217; by their variable of choice as compared to the &#8217;straw variables&#8217;.  </p>
<p>In Quantitative Methods, to impute causality, one makes a variety of assumptions including: a &#8216;ceteris paribus&#8217; (all other things being equal – which may mean assigning away everything &#8216;else&#8217; to randomization) clause, error term (non-systematic) part is not correlated with other independent variables, to infer the correlation between an explanatory variable x and dependent variable y can only be explained as x&#8217;s effect on y. In analyzing survey data, one &#8216;controls&#8217; for variables using regression, or some other similar way. There are a variety of assumptions in regression models and penalty for violation of each of these assumptions. In Qualitative Methods, one can either analytically (or where possible empirically) control for variables, or trace the process. </p>
<p><strong>Qualitative Methods: some handles on generalizability</strong></p>
<p>Traditional probability sampling theories are built on the highly conservative assumption that we that we know nothing about the world. And the only systematic way to go about knowing it is through &#8216;random sampling&#8217;, a process that delivers &#8216;representative data&#8217; on average. Newer sampling theories, however, acknowledge what we know about the world by selectively over-sampling things (or people) we are truly clueless about, and under-sampling where we have a good idea. For example, polling organizations under-sample self described partisans, and over-sample non-partisans. This provides a window for positivist qualitative methods to make generalizable claims. Qualitative methods can overcome their limitations and make legitimate generalizable claims if their sampling reflects the extent of prior knowledge about the world.</p>
<p>Other than sampling, there are other analytical ways of getting a handle on the variables that &#8216;moderate&#8217; the effect of a particular variable that we may be interested in studying. For example, we can analytically think through how education will affect (or not affect) racist attitudes. Analytical claims are based on deductive logic and <em>a priori</em> assumptions or knowledge. Hence the success of analytical claims is contingent upon the accuracy of the knowledge, and the correctness of the logic. </p>
<p>One of the problems that have been repeatedly pointed out about Qualitative research is its propensity to select on the dependent variable. Selection on dependent variable deviously leaves out cases where for example the dependent variable doesn&#8217;t take extreme values. Selection bias can not only lead to misleading conclusions about causal effects but also about causal processes. It is important hence not to use a truncated dependent variable to do one&#8217;s analysis. One of the ways one can systematically drill down to causal processes in qualitative research is by starting off with the broadest palette, either in prior research or elsewhere, to grasp the macro-processes, and other variables that may affect the case. Then cognizant of the particularistic aspects of a particular case, analyze the microfoundations or microprocesses present in the system.</p>
]]></content:encoded>
			<wfw:commentRss>http://gbytes.gsood.com/2007/11/19/causality-and-generalization-in-qualitative-and-quantitative-methods-a-second-look-part-2/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Causality and Generalization in Qualitative and Quantitative methods: A second look (part 1)</title>
		<link>http://gbytes.gsood.com/2007/11/19/causality-and-generalization-in-qualitative-and-quantitative-methods-a-second-look-part-1/</link>
		<comments>http://gbytes.gsood.com/2007/11/19/causality-and-generalization-in-qualitative-and-quantitative-methods-a-second-look-part-1/#comments</comments>
		<pubDate>Tue, 20 Nov 2007 00:40:11 +0000</pubDate>
		<dc:creator>spin</dc:creator>
		
		<category><![CDATA[Philosophy]]></category>

		<guid isPermaLink="false">http://gbytes.gsood.com/2007/11/19/causality-and-generalization-in-qualitative-and-quantitative-methods-a-second-look-part-1/</guid>
		<description><![CDATA[Positivism and Empiricism
Scientific method roughly refers to systematic analysis of empirical data. The quality and the strength of the &#8217;system&#8217; - forever open to challenge - determine any claims of epistemic superiority that the &#8217;scientific method&#8217; may make over other competing claims of gleaning &#8216;knowledge&#8217; from data. The extent to which claims are solely arbitrated [...]]]></description>
			<content:encoded><![CDATA[<p><strong>Positivism and Empiricism</strong></p>
<p>Scientific method roughly refers to systematic analysis of empirical data. The quality and the strength of the &#8217;system&#8217; - forever open to challenge - determine any claims of epistemic superiority that the &#8217;scientific method&#8217; may make over other competing claims of gleaning &#8216;knowledge&#8217; from data. The extent to which claims are solely arbitrated on scientific merit is limited by a variety of factors, as outlined by Lakatos, Kuhn, and Feyerabend, resulting in at best an inefficient process and at worst something far more pernicious. I however ignore such issues and focus narrowly on methodological questions around causality and generalizability in qualitative methods.</p>
<p>In science, inquiry into generalizable causal processes is greatly privileged, and for good reason - causality and generalizability taken together can provide basis for policy action, for mounting intervention, among other things. One can also think of knowledge of causal processes as providing predictive power. However, not all kinds of data make themselves readily accessible to imputing causality, or even to making generalizable descriptive statements. For example, causal inference in most historical research remains out of bounds. AddKeeping this in mind, I analyze how qualitative methods within Social Sciences (can) interrogate causality and generalizability.</p>
<p><strong>Causality:</strong> </p>
<p>Hume felt that there was no place for causality within empiricism. He argued that the most we can find is that &#8220;the one [event] does actually, in fact, follow the other&#8221;. More broadly, causality is nothing but an illusion occasioned when events follow each other with regularity. That formulation however didn&#8217;t prevent Hume from believing in scientific theories for he felt that regularly occurring constant conjunctions were sufficient basis for scientific laws. Theoretical advances in the 200 or so years since Hume have been able to provide a deeper understanding of causality, including a process based understanding and an experimental understanding. </p>
<p>Donald Rubin, a Professor of Statistics at Harvard, defines causal effect as, &#8220;Intuitively, the causal effect of one treatment, E, over another, C, for a particular unit and an interval of time from t1 to t2 is the difference between what would have happened at time t2 if the unit had been exposed to E initiated at t1 and what would have happened at t2 if the unit had been exposed to C initiated at t1: &#8216;If an hour ago I had taken two aspirins instead of just a glass of water, my headache would now be gone,&#8217; or because an hour ago I took two aspirins instead of just a glass of water, my headache is now gone.&#8217; Our definition of the causal effect of the E versus C treatment will reflect this intuitive meaning.&#8221; </p>
<p>It is important to note that RCM as presented above depicts an elementary causal connection between two Boolean variables: one level of explanatory variable (two aspirins) with single effect (headache is gone). Often times, the variables take multiple values and to study that, we need to mount a series of experiments. Similarly one may want to analyze the effect of a variable in different subgroups of populations, for example, effect of aspirin on women as compared to men. All the above two scenarios do is highlight the problems in coming up with a robust understanding of causal processes between (here) two variables. Fundamentally though, our RCM understanding of causal effect remains unchanged. </p>
<p>Rubin Causal Model provides a counterfactual deterministic understanding of causality that is firmly based in the logic of experiment design. RCM formulation can be expanded to include a probabilistic understanding of causal effect. Just as a note: A probabilistic understanding of causality implicitly accepts that certain parts of the explanation are still missing, and hence is absent of a necessary and sufficient condition though attempts have been made to include necessary and sufficient clauses in probabilistic statements. David Papineau (<em>Probabilities and Causes</em>, 1985, Journal of Philosophy) writes, &#8220;Factor A is a cause of some B just in case it is one of a set of conditions that are jointly and minimally sufficient for B. In such a case we can write A&#038;X ->B. In general there will also be other sets of conditions minimally sufficient for B. Suppose we write their disjunction as Y. If now we suppose further that B is always determined when it occurs, that it never occurs unless one of these sufficients sets (let&#8217;s call them B&#8217;s full causes) occurs first, then we have, A and X condition conjugated with Y is equivalent with B. Given this equivalence, it is not difficult to see why A&#8217;s causing B should be related to A&#8217;s being correlated with B. If A is indeed a cause of B, then there is a natural inference to Prob(B/A) > Prob(B/-A): for, given A, one will have B if either X or Y occurs, whereas without A one will get B only with Y. And conversely it seems that if we do find that Prob(B/A) > Prob(B/-A), then we can conclude that A is a cause of B: for if A didn&#8217;t appear in the disjunction of full causes which are necessary and sufficient for B, then it wouldn&#8217;t affect the chance of B occurring.&#8221;</p>
<p>Papineau&#8217;s definition is a bit archaic, and doesn&#8217;t quite cover the set of cases we define as probabilistically causal. John Gerring (<em>Social Science Methodology: A Criterial Framework</em>, 2001: 127,138; emphasis in original), provides a definition of probabilistic causality: ‘[c]auses are factors that raise the (prior) probabilities of an event occurring. (…) [Hence] a sensible and minimal definition: X may be considered a cause of Y if (and only if) it raises the probability of Y occurring.&#8217; </p>
<p>A still more &#8217;sensible&#8217; and still &#8216;minimal&#8217; definition of causality, can be found in Gary King et al. (<em>Designing Social Inquiry: Scientific Inference in Qualitative Research</em>, 1994: 81-82), ‘the causal effect is the difference between the systematic component of observations made when the explanatory variable takes one value and the systematic component of comparable observations when the explanatory variable takes on another value.’</p>
<p><strong>Brief discussion on Causal Inference in Qualitative and Quantitative Methods</strong></p>
<p>While the above formulations of causality – Rubin Causal Model, Gerring, and King – seem more quantitative, they can be applied equally to qualitative methods. A parallel understanding of causality, used much more often in qualitative social science, is a process based understanding of causality wherein you trace the causal process to construct a theory. Simplistically speaking, in Quantitative methods in Social Sciences, one often times deduces the causal process, while in Qualitative methods the understanding of the causal process is induced from deep and close interaction with &#8216;data&#8217;.  </p>
<p>Both deduction and induction processes, however, are rife with problems. Deduction privileges formal rules – statistics – that straightjacket the systematic deductive process so that the deductions are systematic and cognizant of explicit assumptions (like normal distribution of data, linearity of the effect, lack of measurement error, etc.). The formal deductive process bestows a host of appealing qualities like generalizability (when an adequate random sample of population is taken) or even systematic handle on causal inference. In quantitative methods, the methodological assumptions for deduction are cleanly separated from data. The same separation - between the formal deductive process with a rather arbitrarily chosen statistical model and data – however makes the discovery process less than optimal, and sometimes deeply problematic. Recent research by Ho and King (<em>Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference</em>, Political Analysis, 2007), and methods like Bayesian Model Averaging by Volinsky, have gone some ways in providing ways to mitigate problems with model selection.</p>
<p>No such sharp delineation between method and data exists in qualitative research, where data is collected iteratively – [in studies using iterative abstraction (Sayer 1981, 1992; Lawson 1989, 1995) or grounded theory (Glaser 1978; Strauss 1987; Strauss and Corbin 1990)] - till it explains the phenomenon singled out for explanation. Grounded data driven Qualitative methods often run the risk of modeling in particularistic aspects of data, which impedes the reliability with which they can come up with a generalizable causal model. This is indeed only one kind of qualitative research for there are others who do qualitative analysis in the vein of experiments – for example with a 2&#215;2 model, and yet others who will test apriori assumptions by analytically controlling for  variables in a verbal regression equation to get at the systematic effect of explanatory variable on the explanandum. Perhaps more than grounded theory method, the pseudo-quantitative style qualitative analysis runs the risk of coming to deeply problematic conclusions based on the cases used.</p>
]]></content:encoded>
			<wfw:commentRss>http://gbytes.gsood.com/2007/11/19/causality-and-generalization-in-qualitative-and-quantitative-methods-a-second-look-part-1/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Role of Argument in Sciences, Law, and Social Sciences</title>
		<link>http://gbytes.gsood.com/2007/08/20/role-of-argument-in-sciences-law-and-social-sciences/</link>
		<comments>http://gbytes.gsood.com/2007/08/20/role-of-argument-in-sciences-law-and-social-sciences/#comments</comments>
		<pubDate>Mon, 20 Aug 2007 10:21:06 +0000</pubDate>
		<dc:creator>spin</dc:creator>
		
		<category><![CDATA[Philosophy]]></category>

		<guid isPermaLink="false">http://gbytes.gsood.com/2007/08/20/role-of-argument-in-sciences-law-and-social-sciences/</guid>
		<description><![CDATA[The following article has been written by Chaste, who has contributed to this blog before. 
I will assume for the purposes of this piece that argument is the dominant form of writing in academia.  This is also true of public discourse, but this piece will limit itself to academic writing, and more specifically to [...]]]></description>
			<content:encoded><![CDATA[<p>The following article has been written by <b>Chaste</b>, who has contributed to this blog before. </p>
<p>I will assume for the purposes of this piece that argument is the dominant form of writing in academia.  This is also true of public discourse, but this piece will limit itself to academic writing, and more specifically to writing in the social sciences.  If academia aims to produce worthwhile knowledge then the argument is the form that mediates our view of the object studied, and academia is the structure that mediates the production of the specific types of knowledge.</p>
<p>Mediating forms are layers of abstraction that can help understanding.  They define a process for understanding that prevents distortion due to visceral or other perceptions.  Yet as Adorno warns us, forms of viewing and the structures that regulate those forms can limit our understanding of the object studied.  To take a simple instance, researcher-teachers argue a position to get published, and the success of such arguments in staking out and establishing a specific position within the field gets them promoted.  Yet we expect researcher-teachers to conduct independent research, and train students to think with an open mind and to acquire comprehensive knowledge in a field.  We must be wary lest the form of the argument and the structure of academia advance original/individualistic positions at the expense of responsible scholarship.  We must also worry about the lure of political power for academics.  Politics desires simple, narrow and sharply defined positions, whether for political posturing or for public programs.  Succumbing to this lure can only exacerbate the effects of argument on knowledge.</p>
<p><strong>Nature of Argument and its Role in Academia</strong></p>
<p>I will quickly lay out the nature of the argument as used in academia.  The argument typically takes the form of a declared purpose, followed by a description of the theoretical method, which the researcher will use for his analysis.  It then applies this method to the selected data to come up with a conclusion that mirrors the declared aim.  The primary critique of this form of argument uses a simple piece of reasoning.  Applying a theoretical method to a selection of data should always produce the same result and conclusion.  Therefore if “reasonable” (sic) minds disagree, this can only be because their aim / conclusion has pre-determined their choice of theoretical method and / or their selection of data.</p>
<p>The primary virtue of argument is its clarity.  This is due to two qualities: consistency and discreteness.  Yet consistency provides much greater explanatory power when we combine it with complexity than when we use it to support a single point.  Argument often achieves discreteness by excluding other perspectives.  We can gain greater explanatory power by defining relations between disparate issues perspectives, rather than by limiting them.  “Cohere” is useful as it suggests both cohesion and coherence.</p>
<p>The popularity of the argument is doubtless because it mimics similar forms in science and law.  Despite its recent success, scientific research is hardly a model of philosophical rigor.  Recall the search for the “gay gene,” where scientists confused the biological phenomenon of sexual urge with the likely social phenomenon of sexual attractiveness.  Or witness the ongoing fiasco about the continuous upward revision of global warming estimates because scientists had missed such obvious factors as the methane release from a permafrost melt, or missed the systematic differences caused by changes in methods for measuring temperature over the past century.  Most scientific research is simple because it deals in the existence of facts.  Reporting the properties of an element at 1000c has much scientific value.  On the other hand, reporting my thoughts at any given moment has little value even though it may be an appropriate object of study for psychology or political science.  Most scientific research does not involve speculative selection and aggregation of data.  When it does, as in astronomy, public health, and climatology, its conclusions are no more reliable than those in the social sciences.  “Speculative” is crucial when dealing with a seemingly infinite number of variables and infinite data.  It underlines the necessity of an a priori judgment when faced with infinite variables and data.  The analysis then turns into a test of the speculative judgment.  It is at this point that ethics become crucial in such research.  The researcher can choose his theoretical methods and select his data to prejudge the outcome in favor of the a priori judgment.  Alternatively, the researcher can choose to be ethical.  He could either come up with a new hypothesis and test it, or he could simply state the conclusion supported by the most appropriate selection of data and choice of methods.</p>
<p>The argument also mimics the dominant form used by law.  However, the legal context is also quite different from that in social science research.  It is true that lawyers select and even slant the data.  However, the data is very limited.  Again, the lawyer has no choice in the theoretical methods.  Every legal point in dispute has a clearly established set of legal elements, which the lawyer must prove.  It is this systematic exhaustion of every relevant legal element that makes legal briefs both thorough and thoroughly tedious.  In academic arguments, exhaustive lists of theoretical methods are not possible.  The infinite data and variables provide infinite scope for cherry picking: the only criterion is that the method or data support the argument.  Cross-disciplinary studies exacerbate these dangers.  They make it easier to ignore any agreement in a discipline about the criteria for selecting relevant data, or about the best methods to analyze a particular type o data.  In this instance, the proliferation of theoretical methods simply provides even more tools to derive a conclusion of one’s choosing.  An extreme case of this phenomenon is that of the cross disciplinary case study, which narrows the selection of data to a single instance, providing fertile ground for any conclusion whatever.  </p>
<p>I do not suggest that such lax cross-disciplinary studies or case studies do not have any value.  Their value is that of interpretive works, and is similar to the value of literary works.  Literary works sometimes reveal networks of meaning that cannot b openly discussed in their time.  Cross-disciplinary case studies can straddle the boundary between what can and cannot be viably discussed in academia.  As such, they can provoke thought and provide insights and skeletal structure for further analysis.  An excellent work of this kind is Patricia Williams’ “The Alchemy of Race and Rights,” which weaves together insightful arguments and moving, thought-provoking life experiences on various issues.</p>
<p>Another critical difference is that the law uses argument within an adversarial context.  There is no counterpart in academic writing wherein a counter-argument immediately follows the argument.  In this sense, an academic piece resembles an ex parte hearing in which the lawyer is required to disclose all facts favorable to the absent opponent.  No such requirement exists in academic writing.</p>
<p>When used in the unsuitable academic context, the primary disadvantage of an argument is that it induces a loss of perspective by giving disproportionate emphasis to the position argued for.  To a reader without extensive knowledge of the field, it is not possible to infer anything about the validity or worth of any claims.  Unless the argument is part of a conversation, the only appropriate response is skepticism and a reserving of judgment. Judged by the credibility of its claims, the argument becomes worthless except as a data point in a survey or as part of a meta-reading.</p>
<p><strong>Reforming the Argument</strong></p>
<p>I will briefly examine a few alternatives to the argument as typically practiced.  The first option is to abandon the argument in favor of a meditation that densely weaves together patterns of related insights.  Meditation need not imply any loss of evidentiary or logical rigor, merely a flexible structure.  The form of the meditation has several advantages.  It dramatically reduces the problem of disproportionate emphasis on the one position.  The substantive part of most arguments is less than 20% of their length.  The rest is low value elaboration masquerading as thoroughness.  The more flexible structure of the meditation will encourage authors to replace the low value elaboration with related information / insights.  The weaving of patterns will become a pedagogical exercise, which will train the reader to map and relate the data in the field.</p>
<p>Meditation may be the ideal form; its practice is very likely to be something else.  Authors will be tempted to spawn patchworks of recycled insights.  This will make the editor’s job both time consuming and difficult.</p>
<p>Another solution involves a minor modification of the form of the argument.  Editors can insist that the articles be self-aware: that they demonstrate how different conclusions can be drawn with different selections of data or variables, and different choices of theoretical methods.  This is the least resource-intensive of my three solutions.  However, it runs the risk that the author will demonstrate only those alternatives that support rather than undermine his conclusion.</p>
<p>The most pragmatic solution is to have peer-reviewed publications.  Unfortunately, most “peer reviewed” journals are a misnomer since they are only peer approved.  The journals should publish the peer reviews, and allow the author to respond to the reviews.  The reviews themselves should be an engagement with the material, and not merely indicate the quality of the piece.  The editors must choose reviewers from different methodological expertise and disciplinary backgrounds (where that is appropriate).  This will deter the author from making expedient selections of data and of theoretical methods and traditions.  It will also give the reader an adequate perspective on the author’s argument.  The interactive nature of the reviews and response will have pedagogical value not only for the reader but also for the author and the reviewers.  It will enable the author and reviewers to possibly expand on the conversation outside the journal, and provide networking-related scholarly and career benefits.  The article will come with a relatively objective assessment of its worth, which will help both readers and anyone else who may be interested in evaluating the work of the author.  The editors should keep the approval process separate from the review process, and keep the submissions to reviewers anonymous.  The editors should take care that the reviews not mimic the journalistic practice of seeking input from hacks representing stereotypes of established positions.  However, this is achieved relatively easily in academia.</p>
<p>Peer review is reduced to peer approval in the sciences because unlike the social sciences, scientific research often deals in results rather than conclusions, and because the researcher is the only person with direct access to the results.  Therefore, peers in sciences are largely concerned with fraudulent claims of results rather than with the validity of conclusions.  In social sciences, the data is often public, and the value of the article lies primarily in the validity of the conclusions.  Peer review will help determine this validity.  It will also encourage responsible scholarship from authors.  Not only will every article have to survive a more rigorous engagement; this engagement will be invigorating for all.  Above all, it is achievable in practice because it does not impose unacceptable burdens on editors.</p>
]]></content:encoded>
			<wfw:commentRss>http://gbytes.gsood.com/2007/08/20/role-of-argument-in-sciences-law-and-social-sciences/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Social Science in a guest appearance in the play, Capitalism</title>
		<link>http://gbytes.gsood.com/2007/07/02/social-science-in-a-guest-appearance-in-the-play-capitalism/</link>
		<comments>http://gbytes.gsood.com/2007/07/02/social-science-in-a-guest-appearance-in-the-play-capitalism/#comments</comments>
		<pubDate>Tue, 03 Jul 2007 02:34:51 +0000</pubDate>
		<dc:creator>spin</dc:creator>
		
		<category><![CDATA[Philosophy]]></category>

		<guid isPermaLink="false">http://gbytes.gsood.com/2007/07/02/social-science-in-a-guest-appearance-in-the-play-capitalism/</guid>
		<description><![CDATA[Social scientists are technology&#8217;s historians, anthropologists, sociologists, and scientists – measuring the social impact of technology. It is important to note that all this activity is forever doomed to survive in the echo chambers of the forgotten consciousness of society and consigned to only enter in casual desultory (or heated but always ineffectual) discussions. Social [...]]]></description>
			<content:encoded><![CDATA[<p>Social scientists are technology&#8217;s historians, anthropologists, sociologists, and scientists – measuring the social impact of technology. It is important to note that all this activity is forever doomed to survive in the echo chambers of the forgotten consciousness of society and consigned to only enter in casual desultory (or heated but always ineffectual) discussions. Social scientists also produce knowledge that is directly useful to Capitalism and there of course it plays a more important role. </p>
<p>Society is led by the 800 pound gorilla of Capitalism and the &#8216;logic&#8217; of market, which is quite separate from the &#8216;logic&#8217; of social good, determines what is sold, how it is sold, and when. Social scientists merely study effects of new technologies as they are unleashed on the world. Universities open up new schools, departments, disciplines, and certainly new topics within disciplines as technology and reality march on. Take for example the following - two decades after television became a common amongst US households, David Phillips found evidence for &#8216;Werther effect&#8217; like phenomena that linked suicides in real life to television suicides, and later still Robert Putnam linked heightened social alienation to television, and now there is a slew of literature detailing negative impact of violence on television. Of course nobody ever thought that they might want to research the impact of something before it is released. </p>
<p>Social scientists are consigned to doing research that will only rarely wend its way to policy making.  And of course they will never get a chance to determine the course of technological growth, or other policies for those are tethered to Capitalism. </p>
<p>So what is the role of social science or for that matter science aside from helping create wealth, and helping society in a small number of cases where money making and social good coincide? There is really none in a world where increasingly the word regulation is seen as plague. </p>
<p>Perhaps we can write our own epitaph – we wagged our fingers and tongues, and scribbled furiously, as the chasm between the economic engine and the social good widened and Capitalism swallowed us whole. We also made some money doing that.</p>
]]></content:encoded>
			<wfw:commentRss>http://gbytes.gsood.com/2007/07/02/social-science-in-a-guest-appearance-in-the-play-capitalism/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Need for epistemic standards for evidence and argumentation in governance</title>
		<link>http://gbytes.gsood.com/2007/07/02/need-for-epistemic-standards-for-evidence-and-argumentation-in-governing-bodies/</link>
		<comments>http://gbytes.gsood.com/2007/07/02/need-for-epistemic-standards-for-evidence-and-argumentation-in-governing-bodies/#comments</comments>
		<pubDate>Tue, 03 Jul 2007 01:22:52 +0000</pubDate>
		<dc:creator>spin</dc:creator>
		
		<category><![CDATA[Philosophy]]></category>

		<category><![CDATA[Politics]]></category>

		<guid isPermaLink="false">http://gbytes.gsood.com/2007/07/02/need-for-epistemic-standards-for-evidence-and-argumentation-in-governing-bodies/</guid>
		<description><![CDATA[Preface
Epistemic standards for evidence delineate the kind of decisions reached in a decision making system though different systems need different kinds of explicit statutes for evidence to reach decisions of same &#8216;quality&#8217; on average. Explicit standards for evidence and argument are critical in a competitive system where competing groups have palpable incentives to withhold information, [...]]]></description>
			<content:encoded><![CDATA[<p><strong>Preface</strong></p>
<p>Epistemic standards for evidence delineate the kind of decisions reached in a decision making system though different systems need different kinds of explicit statutes for evidence to reach decisions of same &#8216;quality&#8217; on average. Explicit standards for evidence and argument are critical in a competitive system where competing groups have palpable incentives to withhold information, monger stilted information, use irrelevant information, or use any tactic to win.  In the following paragraphs, I etch out my argument using US government as an example.</p>
<p><strong>Epistemic standards in government</strong></p>
<p>Differing epistemic standards pervade different branches of the US government. The epistemic standards are loosely correlated with the idealized &#8216;expected&#8217; function of the branch of government. </p>
<p>Let me begin by outlining the differing epistemic standards and then I will go into detail as to the possible effects of those &#8217;standards&#8217; or lack thereof. </p>
<p><strong>Epistemic standards in judiciary</strong></p>
<p>US judicial system uses the adversarial system in which each of the parties present its case to a neutral party (judge or jury). Each side is supposed to furnish evidence in support of its argument, and an &#8216;impartial&#8217; judge decides on what evidence is better in terms of its applicability and strength. </p>
<p>The adversarial system is a competitive system that relies on the sparring parties to furnish evidence. Like any competitive system, the sparring parties have explicit incentives to withhold information from each other and misrepresent information. The system relies on the &#8216;other&#8217; party to excavate any such violations, and sometimes on the neutral party. There are some other formal procedures to limit the kind of evidence that can be presented (though some are rooted in alternate theories) and procedures for sharing corroborative evidence. There are also formal procedures as to what kind of arguments can be presented. </p>
<p>The adversarial judicial process inarguably uses the strictest standards of evidence amongst any branch of government. </p>
<p><strong>Epistemic standards in Legislative and Executive branch</strong></p>
<p>While the legislative process is largely a &#8216;competitive&#8217; system, it has no formal epistemic standards limiting the kind of evidence or arguments that can be presented.  The strength of the evidence presented, its applicability, etc. are either &#8216;judged&#8217; by &#8216;citizens&#8217; (substantially mediated by media) or by members of the other competing party.  </p>
<p>The problem with legislative branch is not only that it is a competitive system but that is a corrupt, special interest driven, competitive system. The system provides little incentive to the members to judge the evidence in an impartial manner with the &#8216;nation&#8217;s&#8217; best interests in mind. </p>
<p>There are literally no epistemic standards that hold back the executive branch except for some loose constraints that tie those standards to marketability of a particular policy decision. </p>
<p><strong>Side note: Adversarial systems flirt with Inquisitorial systems</strong></p>
<p>Congress also uses the &#8216;Inquisitorial system&#8217; when it conducts &#8216;Congressional Hearings&#8217; to &#8216;investigate&#8217; a particular issue. Of course due to partisanship pressures, the inquisitorial system often uncomfortably borders on &#8216;inquisition&#8217;. </p>
<p><strong>Conclusion</strong></p>
<p>Lack of epistemic standards for evidence and argumentation hobble the democratic system immensely.  One way to correct the problem would be to create governance structures that explicitly involve independent bodies that judge the strength and applicability of evidence presented.</p>
]]></content:encoded>
			<wfw:commentRss>http://gbytes.gsood.com/2007/07/02/need-for-epistemic-standards-for-evidence-and-argumentation-in-governing-bodies/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Desideratum: Qualitative Vs. Quantitative Methods</title>
		<link>http://gbytes.gsood.com/2007/06/09/desideratum-qualitative-vs-quantitative-methods/</link>
		<comments>http://gbytes.gsood.com/2007/06/09/desideratum-qualitative-vs-quantitative-methods/#comments</comments>
		<pubDate>Sat, 09 Jun 2007 23:51:26 +0000</pubDate>
		<dc:creator>spin</dc:creator>
		
		<category><![CDATA[Philosophy]]></category>

		<guid isPermaLink="false">http://gbytes.gsood.com/2007/06/09/desideratum-qualitative-vs-quantitative-methods/</guid>
		<description><![CDATA[Epistemology of Causality
How do we know that something is the &#8217;cause&#8217; of something and how do we impute &#8216;causality&#8217; through data? 
To impute causality in quantitative models, we rely on the argument that it is unlikely that the change in Y could be explained by anything else other than X since we have &#8217;statistically controlled [...]]]></description>
			<content:encoded><![CDATA[<p><strong>Epistemology of Causality</strong></p>
<p>How do we know that something is the &#8217;cause&#8217; of something and how do we impute &#8216;causality&#8217; through data? </p>
<p>To impute causality in quantitative models, we rely on the argument that it is unlikely that the change in Y could be explained by anything else other than X since we have &#8217;statistically controlled for other variables&#8217;. We &#8216;control&#8217; for variables via experiments or we can do it via regression equations. This allows us to isolate the effect of say variable x on y. There are of course some caveats and some assumptions that go along with using these methods but robust experimental designs still allow us to impute causality in a fairly robust way. Generally the causal claim is buffeted with description of a plausible causal pathway. All of the analysis and the resulting benefits of reliably imputing causality are predicated on our ability to &#8216;correctly&#8217; assign numbers to &#8216;constructs&#8217; (the real variables of interest). </p>
<p>Let&#8217;s analyze now how qualitative methods can impute causality. While it seems reasonable to assume that &#8217;systematic&#8217; &#8216;qualitative&#8217; analysis of a problem can provide us with a variety of causal explanations and under most circumstances provide us with a reasonably good idea of how much each of the explanatory variables affects the dependent variable, there are crucial problems and limitations that may induce bias in the analyses. Additionally, we must define what constitutes as &#8217;systematic&#8217; analysis. </p>
<p>Another thing to keep in mind is that ethics and rigor are not enough to impute causality. What one needs are the right epistemic tools. </p>
<p>A lot of qualitative research is marred by the fact that it &#8217;selects on the dependent variable&#8217;. In other words it sees a dependent variable and then goes sleuthing for the possible causal mechanisms. It is hard in that case to impute wider causality between variables because the relationship hasn&#8217;t been tested for varying levels of X and Y. It is useful to keep in mind that sometimes it is all that we can hope to achieve. Additional problems can emerge from things like &#8220;selection bias&#8221; and logical fallacies like &#8220;Post hoc ergo propter hoc&#8221;. Partly the way qualitative research is written can also impose its own demands and biases including demands for narrative consistency. </p>
<p>It is unclear to me whether a system exists to impute causality reliably using qualitative methods. There are however some techniques that qualitative methods can borrow from quantitative methods to improve any causal claims that they may be inclined to make – one is to use a representative set of variables, the other is to look for &#8216;natural experiments&#8217;, and pay attention to larger sociological issues and iterate through why alternative explanations don&#8217;t apply as well here – a sort of a verbal regression equation. </p>
<p>There are of course instances where deeper more in depth analysis of few cases allows one to get a deeper understanding of the issue but that shouldn&#8217;t be mistaken as coming up with causes. </p>
<p><strong>Epistemology of generalization in empirical methods</strong></p>
<p>There is very little space that we get edge ways when we think about a systematic theory of generalization for empirical theories unless. To generalize we must either &#8216;know&#8217; fundamental causal mechanisms and how they work under a variety of contextual factors or use probability sampling. Probability sampling theories are built on the belief that we know nothing about the world. Hence we need to take care to collect data (which ideally transposes to the constructs) in a way that makes it generalizable to the entire population of interest. </p>
<p><strong>Causal arguments in Qualitative research</strong></p>
<p>For making &#8216;well grounded&#8217; causal arguments in qualitative research - say with a small <strong>n</strong> - the case must be made for generalizability of the selected cases, use deduction to articulate possible causal pathways, and then bring them together in a &#8216;verbal regression equation&#8217; and analyze which of the causal pathways are important - as in likely or have a large effect size- and which are not.   </p>
<p><strong>Epistemic standards in interpretation and methodology</strong></p>
<p>Quantitative methods share a broad repertoire of skills that is shared across the disciplines while comparatively no such common epistemic standards exist across variety of qualitative sub-streams that differ radically in terms of what data to look at and how to interpret the data. Common epistemic standards allow for research to be challenged in a variety of ways. From Gay and Lesbian studies to Feminist Scholarship to others – there is little in common in terms of epistemic standards and how best to interpret things. What we then have is merely incommensurability. Partly of course different questions are being asked but even when same questions are being asked – there appears to be little consensus as to what explanation is preferred over the other. While each new way to &#8220;interpret&#8221; facts in some ways does expand our understanding of the social phenomena, given the incommensurability in epistemic standards –we cannot bring all of them to a qualitative &#8216;verbal regression equation&#8217; (my term) through which we can reliably infer the size of the effect of each. </p>
<p><strong>Caveat</strong><br />
The above article deals with the debate between qualitative methods and quantitative methods on a small select sample of issues - generalizability and causality - that are explicitly more tractable through quantitative models. It would be unwise to construe larger points about relevance of qualitative methods from the article.</p>
]]></content:encoded>
			<wfw:commentRss>http://gbytes.gsood.com/2007/06/09/desideratum-qualitative-vs-quantitative-methods/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Social Science and the theory of all</title>
		<link>http://gbytes.gsood.com/2007/04/22/the-theory-of-all/</link>
		<comments>http://gbytes.gsood.com/2007/04/22/the-theory-of-all/#comments</comments>
		<pubDate>Sun, 22 Apr 2007 23:11:24 +0000</pubDate>
		<dc:creator>spin</dc:creator>
		
		<category><![CDATA[Philosophy]]></category>

		<guid isPermaLink="false">http://gbytes.gsood.com/wp/2007/04/22/the-theory-of-all/</guid>
		<description><![CDATA[Social phenomenon, unlike &#8216;natural science phenomenon&#8217;, is bound and morphed not only by nature (evolution etc.) but also history, institutions (religious, governance etc.), and technology, among others. Before I go any further, I would like to issue a caveat to point out that the categories that I mention above are not orthogonal and in fact [...]]]></description>
			<content:encoded><![CDATA[<p>Social phenomenon, unlike &#8216;natural science phenomenon&#8217;, is bound and morphed not only by nature (evolution etc.) but also history, institutions (religious, governance etc.), and technology, among others. Before I go any further, I would like to issue a caveat to point out that the categories that I mention above are not orthogonal and in fact do trespass into each other regularly. We can study particular social phenomenon in aggregate through disciplines like political science, which study everything from study of psychology to institutions to history, or study them by focusing on one particular aspect – psychology or genetics – and investigating how each effect multiple social phenomenon like politics, communication etc. </p>
<p>Given the disparate range of fields that try to understand the social phenomenon, often times the field is straddled with multiple competing paradigms and multiple theories within or across those paradigms with little or no objective criteria on which the theories can be judged. This is not to say that theories are always mutually irreconcilable for often times they are not (though they may be seen as such - which is an artifact of how they are sold), or that favoring one theory automatically implies rejecting others. Success of a theory, hence, often times depend on how well it is sold and the historical proclivities of the age. </p>
<p><strong>Proclivities of an age; theories of an age</strong></p>
<p>Popular paradigms emerge over time and then are discarded for entirely new ones. It is not that the old don&#8217;t hold but just that the new ones hold the imagination of the age. Take for example variables that people have chosen to describe culture over the ages - Weber argued religion was culture, Marx argued that political economy was culture, Freud proposed a psycho-analytical take on culture (puritan, liberated etc.), Carey proposed communication as culture, political theorists have argued institutions as culture, bio-evolutionarists argue that cognition and bio-rootedness are primary determinants of culture, Tech. evangelists have argued technology is culture, while others have argued that infrastructure dictates culture. </p>
<p>It is useful to acknowledge that the popularity of the paradigms that were used to define culture had something to do with the most important forces shaping culture at that particular time. For example, it is quite reasonable to imagine that Marx&#8217;s paradigm was a useful one for explaining the industrial society (in fact it continues to be useful), while Carey&#8217;s paradigm was useful to explain the results of rapid multiplication (and accessibility) of communication (mass-) media. I would like to reissue this caveat that adopting new paradigms doesn&#8217;t automatically imply rejecting the prior ones. In fact intersection of old and new paradigms provide fecund breeding grounds for interesting arguments and theories – for example political economy of mass media and its impact. Let me illuminate the point with another example from Political Science which a decade or so ago saw resurgence of cultural theory at the back of Huntington&#8217;s theory of &#8216;Clash of civilizations&#8217;. Huntington&#8217;s theory didn’t mean an end to traditional paradigms like economic competition; it just postulated that there was another significant variable that needed to be factored in the discourse. </p>
<p><strong>The structure of scientific revolutions</strong></p>
<p>Drawing extensively from historical evidence from the natural sciences, Thomas Kuhn, a Harvard physicist, argued in his seminal book, The Structure of scientific revolutions, that science progressed through &#8220;paradigm shifts&#8221;. While natural sciences paid scant attention to the book, the book provoked an existentialist crisis within the social sciences. To arrive at that crisis point, social scientists made a number of significant leaps (not empirically based) from what Kuhn said – they argued that growth of social science was anarchic, its judgments historically situated and never objective, and hence the social sciences were pointless – or more correctly had a point but were misguided. This self-flagellation is typical in social sciences that have always been more introspective about their role and value in society as compared to the natural sciences, which have always proceeded with the implicit assumption that &#8216;progress&#8217; cannot be checked and eventually what they produce are merely tools in service of humanity. Of course, that is quite bunk and has been exposed as such without making even the slightest dent in the research in science and technology. Criticizing natural sciences, especially the majority of it that is in service of &#8216;value free&#8217; economics, doesn&#8217;t take away from the questions that Kuhn posed for the social sciences. Social scientists, in my estimation, put disproportionate emphasis on Kuhn&#8217;s work. Social science is admittedly much behind in terms of coming up with generalizable theories but they have been quite successful in identifying macro-variables and phenomena. </p>
<p>The most intractable problem that social scientists need to deal with is answering what is the purpose of their discipline. Is it to describe reality or to critique it or engineer alternative realities? If indeed it is all of above, and I believe it is, then social science must think about melding its often disparate traditions – theory and practice. </p>
<p><strong>Rorty and the structure of philosophical revolutions</strong></p>
<p>Richard Rorty in his book, Philosophy and the Mirror of Nature, launches a devastating attack on philosophy – especially its claims to any foundational insights. Rorty traces the history of philosophy and finds that the discipline is embedded, much more deeply than social science, in the milieu of paradigm shifts – philosophers from different ages not only offer different &#8220;foundational&#8221; insights but often times deal with different problems altogether.</p>
<p><strong>Battling at the margins</strong></p>
<p>Those who argue that the singular purpose of social science should be to normatively critique it and offer alternative paradigms are delusional. Understanding how a society works (or how institutions work, people work) is important to craft interventions – be it drug policy or engineering new governance systems. Normative debates often times are nothing but frivolous debates at the margins. The broad overarching problems of today don&#8217;t need normative theorists devoted to analysis - though I don&#8217;t dispute their contribution - they are evident and abundantly clear. When we take out the vast middle of what needs to be decided, normative theory becomes a battle at the margins. </p>
<p><strong>Post-positivist theorizing; and the sociology of research</strong></p>
<p>The most significant challenges for social science as discipline lie within the realm of how the discipline aggregates research and moves forward and how that process is muzzled by a variety of factors.<br />
Imre Lakatos sees &#8220;history of science in terms of a continuous competition between alternative research programs rather than of successive conjectures and refutations on the one hand, or of total paradigm-switches on the other.&#8221; Lakatos argues that any research program possess a kernel of theoretical principles which are taken as fixed and hence create a &#8216;negative heuristic&#8217; that forbids release of anomalous results, and instead scientists are directed to create a &#8220;protective belt&#8221; of auxiliary assumptions intended to secure correctness of theoretical principles at the core.  Finally, &#8216;positive heuristic&#8217; is at work to &#8220;Defend and extend!&#8221; (Little, 1981) </p>
<p>Post-positivist scientific philosophy, like the ones forwarded by Kuhn and Lakatos, raise larger questions about the nature (and viability) of the scientific enterprise. While we may have a firmer grasp of what we mean by a good scientific theory, we are still floundering when it comes to creating an ecosystem that foments good social science and creates a rational and progressive research agenda. (Little, 1981) We must analyze the sociology, and political economy of journal publication as the whole venture is increasingly institutionalized and as careerism etc. become more pronounced.</p>
]]></content:encoded>
			<wfw:commentRss>http://gbytes.gsood.com/2007/04/22/the-theory-of-all/feed/</wfw:commentRss>
		</item>
		<item>
		<title>Political Economy of everyday conversation</title>
		<link>http://gbytes.gsood.com/2007/04/11/political-economy-of-everyday-conversation/</link>
		<comments>http://gbytes.gsood.com/2007/04/11/political-economy-of-everyday-conversation/#comments</comments>
		<pubDate>Thu, 12 Apr 2007 06:11:10 +0000</pubDate>
		<dc:creator>spin</dc:creator>
		
		<category><![CDATA[Philosophy]]></category>

		<guid isPermaLink="false">http://gbytes.gsood.com/wp/2007/04/11/political-economy-of-everyday-conversation/</guid>
		<description><![CDATA[&#8220;Communication&#8221; comes from the Latin word communicare, which means &#8220;to make common&#8221;. We communicate not only to transfer information but also to establish and reaffirm identities, mores, and meanings. The two major localities where &#8220;communication&#8221; takes place are the consumption of mass media, and everyday conversation. While both inform how we view the world, and [...]]]></description>
			<content:encoded><![CDATA[<p>&#8220;Communication&#8221; comes from the Latin word communicare, which means &#8220;to make common&#8221;. We communicate not only to transfer information but also to establish and reaffirm identities, mores, and meanings. The two major localities where &#8220;communication&#8221; takes place are the consumption of mass media, and everyday conversation. While both inform how we view the world, and what is considered important, scant attention has been paid to understanding the nature and shape of everyday communication and charting its impact. </p>
<p>In the entire realm of what is considered communication, arguably the most important part is the &#8220;everyday conversation&#8221; – the repeated mundane conversation. I say this not because &#8220;everyday conversation&#8221; occupies the most time, for admittedly consuming mass media does that, but because &#8220;everyday conversation&#8221; is still the primary site where people seek approval. While the motivations for entering into a conversation have remained largely the same, the nature of everyday conversation has changed dramatically over the last century. Firstly, today the conversation is carried out between socially competitive peers rather than empathetic family members, and secondly the things that provide value, or things that people seek approval on, have changed from &#8220;being a good son or daughter or some other social relation&#8221; to fickle, competitive identity markets based on consumption of commercial products (or related training like cooking shows, home improvement shows, travel shows) and entertainment. In other words, with increasing atomization and resulting heightened anxieties about identity, for we no longer get most of our identity from family or some other archaic system, but through consuming the right kind of entertainment and consuming appropriate products, everyday conversations have effectively become negotiations of cultural identity among social or (generally &#8220;and&#8221;) economic equals. </p>
<p>The negotiation of commercialized cultural identities is done via issues like sports, movies, and other cultural products while contentious topics like politics, religion, and race with little or no commercial value are frowned upon as conversation topics. The key ideal in conversation is politeness (and conformity) and it is just not polite to bring in contentious topics except to mention harmonious approval, cues for which may have been exchanged before. </p>
<p>Given that the motivation for everyday conversation is garnering social approval, attention is paid to story telling, artful handling of anecdotes, sarcasm etc. and not on &#8220;accurate&#8221; objective reasons. Additionally, the exchange about product preferences is liable to be subjective, and hence not eligible for closer scrutiny, and anchored to some accepted commercial shtick or parameters of &#8220;coolness&#8221; or &#8220;hipness&#8221;.  This ineligibility for closer scrutiny is there for a reason for it is in the protection of that kernel of &#8216;irrationality&#8217; and some vague notion of &#8216;individuality&#8217; can one sell absolutely anything. The fact is that trillions of dollars in this economy rides on the fact that tomorrow millions of people will wake up and make a suboptimal decision - or more accurately be convinced about their economically sub-optimal decisions – about their decision to buy some product. </p>
<p>The other important facet of everyday conversation, as I mentioned earlier, is that it is done primarily between economic and social equals. Conversation between classes has altogether dried up. This drying up can be seen as a result of drying up of places where these interactions used to take place. Cross class interaction or conversations always took place when the person from a lower class offered a service to the person from the higher class. The fora for these exchanges of anecdotes and stories between economic classes have almost dried up under current economic regime. For example, the mom and pop stores manned by neighborhood people have been replaced by chain stores that hire salaried employees with high turnover and whose only focus is to provide an efficient economic transaction and offer an empty courtesy. These routine commercial interpersonal transactions not only keep us from learning the difficulties across classes and hence possibly build empathy, but also have a profound impact on our everyday interaction with other people- even of similar social status. Let me weave in another anecdote here to illustrate the point. When I first came into this country, I was often asked some variation of &#8220;how I was doing?&#8221; at the beginning of each conversation. I frequently responded by providing full descriptions of how I was doing. It was only after many months and after receiving numerous impatient glances that it dawned on me that people expected nothing but empty curtsies. </p>
<p>The normative point that I want to make is that our everyday conversation affects the nature and extent of our knowledge and style of argumentation. For example, it affects whether one is interested in politics or not, and the political proclivities one may have. The site of &#8220;everyday conversation&#8221; needs to be reclaimed to build a healthy body politic. Specifically for politics, we may need revival of public conversational spaces what Habermas writes about and what Tocqueville observed.</p>
]]></content:encoded>
			<wfw:commentRss>http://gbytes.gsood.com/2007/04/11/political-economy-of-everyday-conversation/feed/</wfw:commentRss>
		</item>
	</channel>
</rss>
