<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Some stuff &#187; Coding</title>
	<atom:link href="http://blog.yhuang.org/?feed=rss2&#038;tag=coding" rel="self" type="application/rss+xml" />
	<link>https://blog.yhuang.org</link>
	<description>here.</description>
	<lastBuildDate>Wed, 27 Aug 2025 08:50:58 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.1.1</generator>
		<item>
		<title>is winner-take-all broken?</title>
		<link>https://blog.yhuang.org/?p=912</link>
		<comments>https://blog.yhuang.org/?p=912#comments</comments>
		<pubDate>Sat, 04 Aug 2012 22:31:55 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[code]]></category>
		<category><![CDATA[Coding]]></category>
		<category><![CDATA[Coding theorists]]></category>
		<category><![CDATA[optimization]]></category>
		<category><![CDATA[reward]]></category>
		<category><![CDATA[sponsor]]></category>
		<category><![CDATA[sponsor money]]></category>

		<guid isPermaLink="false">http://scripts.mit.edu/~zong/wpress/?p=912</guid>
		<description><![CDATA[Olympic athletes use a huge amount of sponsor money &#8212; not to mention legal and illegal performance aids &#8212; to reach gold. Soon we will have genetically engineered physiology to reach even greater records. Schools compete for an annual #1 ranking. They spend more and more money to bid for the best professors and build [...]]]></description>
			<content:encoded><![CDATA[<p>Olympic athletes use a huge amount of sponsor money &#8212; not to mention legal and illegal performance aids &#8212; to reach gold. Soon we will have genetically engineered physiology to reach even greater records. Schools compete for an annual #1 ranking. They spend more and more money to bid for the best professors and build the best facilities, driving up tuition. Coding theorists run massive simulations to find the best code to compete for the one spot in standards. But is the second place athlete, school, and code that much worse? No, usually they are nearly as good as #1.</p>
<p>I&#8217;ve often wondered whether many problems in the world are not variations of attempting &#8220;exact optimization&#8221; &#8212; this being the only way to guarantee success in a winner-take-all reward system.<br />
<span id="more-912"></span><br />
In engineering at least, when any kind of iteratively converging algorithm is run, the prototypical behavior is a fast convergence to a neighborhood of the solution, and then a really long process of getting to the exact one. In choosing exact optimization, a practically &#8220;good enough&#8221; solution is rejected in favor of expending a huge amount of resources to obtain the last 1% of the gap to optimality.</p>
<p>Where there is no bound to performance, a winner-take-all competition encourages ever-higher performance, driving progress. In reality, there is no system without some constraint that imposes a bound. We <em>hope</em> that rational allocation decisions will cause us to collectively halt at an approximate solution and move on to something else. However, this requires cooperative strategies. Winner-take-all is not stable for cooperative strategies, so we end up collectively committing resources disproportional to the amount of improvement we get in any observable metric. With the exception of the lone winner in each competition, everybody else suffers massive misallocation.</p>
<p>There are a number of absurd problems that arise from not developing a reward system consistent with a &#8220;soft&#8221; metric that gives some value to anything but the top rank.</p>
]]></content:encoded>
			<wfw:commentRss>https://blog.yhuang.org/?feed=rss2&#038;p=912</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Csiszar &amp; Korner</title>
		<link>https://blog.yhuang.org/?p=9</link>
		<comments>https://blog.yhuang.org/?p=9#comments</comments>
		<pubDate>Mon, 30 Oct 2006 18:37:27 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[chip foundry]]></category>
		<category><![CDATA[Coding]]></category>
		<category><![CDATA[ebay]]></category>
		<category><![CDATA[hungarian names]]></category>
		<category><![CDATA[janos korner]]></category>
		<category><![CDATA[kazoo books]]></category>
		<category><![CDATA[list]]></category>
		<category><![CDATA[nobody]]></category>
		<category><![CDATA[PDF]]></category>
		<category><![CDATA[press]]></category>

		<guid isPermaLink="false">http://scripts.mit.edu/~zong/wpress/?p=9</guid>
		<description><![CDATA[Imre Csiszar and Janos Korner are two Hungarians with very Hungarian names. But more importantly, they wrote a thrilling page-turner called, Information Theory: Coding Theorems for Discrete Memoryless Systems. It is a book most difficult to obtain. It seems that the book has been out of print ever since the day it was in print. Academiai Kiado [...]]]></description>
			<content:encoded><![CDATA[<p>Imre Csiszar and Janos Korner are two Hungarians with very Hungarian names. But more importantly, they wrote a thrilling page-turner called, <strong>Information Theory: Coding Theorems for Discrete Memoryless Systems</strong>. It is a book most difficult to obtain. It seems that the book has been <em>out </em>of print ever since the day it was <em>in</em> print. Academiai Kiado of Budapest and Academic Press of New York (same thing?), I&#8217;m looking in your general direction(s). Hmm. I wonder if the cost structure of running a printing press is akin to that of running a chip foundry?</p>
<p><img src="wp-content/uploads/images/9630574403.01._AA240_SCLZZZZZZZ_.gif" alt="http://ec1.images-amazon.com/images/P/9630574403.01._AA240_SCLZZZZZZZ_.gif" align="right"/></p>
<p>Anyway, forget the publishers. There is one copy in the library, permanently checked out, on hold, or requested. Almost never seen in online stores, it sells for several times the list price when scalper123 occasionally trots it out on YahooMazonBay. Worst of all, nobody has bothered to make and distribute a pdf of it for the good of the masses. Er, wait, I mean, nobody has bothered to make a Fair Use copy for <em>personal</em> use.</p>
<p>And accidentally leave the pdf on an unprotected public server. (Please?)</p>
<p>Well, that was last week, and this is now. I am to this day amazed that <a href="http://www.kazoobooks.com/">Kazoo Books</a> still had one (1) old, used, but perfectly good copy <em>at list price</em>. I wrote &#8220;had.&#8221; Good service and fast delivery, too. No fraud committed against me despite there being a phone transaction with a credit card. Highly recommend. Wait, this isn&#8217;t eBay, why am I writing this?</p>
]]></content:encoded>
			<wfw:commentRss>https://blog.yhuang.org/?feed=rss2&#038;p=9</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
	</channel>
</rss>
