{"id":551911,"date":"2007-03-31T11:20:45","date_gmt":"2007-03-31T11:20:45","guid":{"rendered":"http:\/\/localhost:8888\/wordpress\/technology\/551911-computing-the-burden-of-proof.html"},"modified":"2007-03-31T11:20:45","modified_gmt":"2007-03-31T11:20:45","slug":"computing-the-burden-of-proof","status":"publish","type":"post","link":"https:\/\/mybroadband.co.za\/news\/technology\/551911-computing-the-burden-of-proof.html","title":{"rendered":"Computing the burden of proof"},"content":{"rendered":"<p><font size=\"2\">THE year: 1611. The person: Johannes Kepler, mathematician and astrologer. The problem: Kepler wanted to give his sponsor, John Matthew Wacker, a new year\u2019s present, but was short of cash. The solution: he wrote a book dedicated to Wacker. The work, Strena Seu de Nive Sexangula (On the Six-Cornered Snowflake), debated the tendency of snowflakes to form beautiful shapes with roughly sixfold symmetry.<!--blurb0--> <\/font><\/p>\n<p><!--par1--><!--par0--><\/p>\n<p><!--par1--><font size=\"2\">We now know that these shapes result from crystal growth in the varying temperature and humidity of storm clouds. A snowflake builds itself particle by particle. At first the structure resembles a microscopic honeycomb. The snowflake retains its hexagonal symmetry as more particles attach themselves to this initial seed. But conditions in storm clouds fluctuate, leading to an endless variety of snowflake shapes.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">In the 17th century, the atomic structure of matter belonged to the realm of philosophical speculation. Kepler deduced \u2014 in a few pages and without experimental evidence \u2014 that a snowflake must be made from many identical tiny spherical units, closely packed together. <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">The densest way to pack identical spheres is in a honeycomb \u2014 consider snooker balls at the start of a frame. Kepler put forward that the most efficient way to pack spheres into a three-dimensional space was similar to the way in which greengrocers stack oranges.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">This may seem obvious, but it took nearly 400 years for someone to put together a logical proof that Kepler was right. <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">In 1998 Thomas Hales announced such a proof, but it involved a 3GB computer file. <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">What made the proof so complicated? It took a lot of work to rule out vast numbers of irregular packings \u2014 showing that these are not as dense as those which greengrocers use. <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">The wonder is that the question can be reduced to a computation at all. It is no surprise that the answer is gigantic.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Proofs like Hales\u2019s raise a serious philosophical question. Until recently, mathematical proofs could be verified by a competent human being. It may have taken weeks to work through a proof, but it could be done. <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Computers have changed the game. They can perform more calculations in a few seconds than the unaided human can in a lifetime. This does not make mathematicians obsolete \u2014 the problem still needs to be turned into something that a computer can answer. This is often as difficult and creative as a traditional proof.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Can something be considered a proof if no human can verify it without a computer? For that matter, what is a proof? And why are proofs needed at all?<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">The traditional model has its roots in the writings of Euclid of Alexandria, particularly his famous Elements. For Euclid, it was not enough to provide circumstantial evidence or numerous examples for mathematical statements. Everything had to be proved, with logic. A familiar example is Pythagoras\u2019s theorem: the square on the longest side of a right-angled triangle is the sum of the squares on the other two sides. This is proposition 47 of Book I of the Elements, and its proof relies on most of the previous 46.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Euclid\u2019s successors made proof the cornerstone of mathematics. <!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">How do we guarantee that an alleged proof has no logical errors or gaps? The time-honoured method is to write it down, so that anyone can check the logic for themselves. The formal definition of proof places no limit on the number of logical steps involved, but there used to be a tacit assumption that the verification process could, and should, be carried out by one unaided human brain.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">A 3GB computer file is equivalent to about 10000 full-length novels. It would take about 30 years just to read it. Making sense of it, and checking each deduction, would take several lifetimes. If computers were infallible, we might be happy to accept the results without question. We would only need to check that the computer was obeying the correct instructions, and satisfy ourselves as to the logical structure of the computation. <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Unfortunately, computers can make mistakes. The most famous example is a design flaw in the Pentium chip, discovered in 1994. It sometimes got division sums wrong. In practice, such flaws seldom cause serious problems, either because they have no effect or because they lead to such egregious nonsense that it stands out like a sore thumb. <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Can a computer-aided proof ever be as trustworthy as traditional proofs, though?<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Perhaps not, but humans are far more likely to make undetected errors than computers. If the same program is run on several computers using different operating systems and the results agree, then computer errors are unlikely to have affected the result. Moreover, the problem of size is not confined to computer-aided proofs. One of the big breakthroughs of the late 20th century was a complete list of all possible \u201cfinite simple groups&quot; \u2014 the basic building blocks of symmetry. The proof \u2014 the joint effort of hundreds of mathematicians \u2014 occupies about 15000 pages. Can anyone truly read through that and swear that every single step is right?<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">One school of thought considers these problems to be insurmountable. <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Writing in Scientific American in 1993, John Horgan boldly declared the \u201cdeath of proof&quot;. Andrew Wiles\u2019s magnificent proof of Fermat\u2019s last theorem, obtained a few months earlier without computers, was mentioned under the heading, \u201cA splendid anachronism?&quot; Logical proofs, Horgan suggested, might become obsolete \u2014 to be replaced by experiments. To prove Pythagoras\u2019s theorem, draw a lot of triangles. To prove the Kepler conjecture, play with oranges. However, rejecting a computer- assisted proof because it might have logical gaps only to replace it with experiments that certainly have gaps makes no sense. Indeed, there are plenty of cases where experimental evidence points to one conclusion while a proof points to a different one.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Most mathematicians rejected Horgan\u2019s article as a selective presentation of a complicated issue. More than a decade later, proof is thriving. But there is nevertheless a fundamental tension between the philosophical definition of a proof \u2014 what mathematicians should do \u2014 and what they actually do. Mathematicians are much more interested in solving problems than in philosophising about their methods. They set very high logical standards, but they are also pragmatic. Life is too short to write proofs the way philosophers say we should, and the results would be incomprehensible if we did. It took Bertrand Russell and Alfred North Whitehead several hundred pages to give a for<br \/>\nmal proof, in their Principia Mathematica, that 2+2&gt;4. The proof is virtually unreadable, and Russell nearly had a nervous breakdown checking it. So the formal definition of proof may be neat and tidy, but it has several defects. It focuses solely on content and ignores context, it fails to distinguish important ideas from trivial ones, and it does not represent what people do in practice.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Suppose you ask for directions to a small village in Devon. What you don\u2019t want is a lengthy description of how to get your car out of the garage, reverse into your home street and avoid next door\u2019s cat. A list of 10000 instructions, presented as if they were all equally important, is useless. <!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">A more useful set of instructions, then, would be something like this: \u201cGet on the M5 going south until you get past Bristol. Take exit 27 on to the A361 heading for Tiverton.&quot; <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">When you get close to your destination you really do want the details: \u201cDrive along Old Barn Lane, past the duck pond; then take the first right by the dead oak tree onto the cart track \u2014 and watch out for the concrete block filling a pothole.&quot; <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Real proofs, written and published by real mathematicians for the benefit of other mathematicians, are like that. \u201cBy a straightforward generalisation of the Bloggs-Smith theorem \u2026 an obvious calculation now shows that \u2026\u201d <!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">An accurate formal description of War and Peace might be \u201ca series of words that follow the rules of grammar\u201d. But what matters about any novel is quite different: it has to tell a story. It is the same for proofs. A proof is a series of logical deductions, but it is more informative to see it as a story \u2014 a story told by mathematicians to mathematicians, in a familiar language. If it contains logical gaps, or errors, the readers can, and eventually will, notice. <!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">What working mathematicians really mean by a proof, then, is both more and less than a formal list of logical steps. It is more, because the steps have a narrative structure and are equipped with signposts; it is less because gaps are deliberately left whenever the corresponding logical steps are routine and can be reconstructed by anyone familiar with the topic.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">This style of proof is more acceptable to human thought patterns than a structureless series of tiny steps, all explicitly cross- referenced to sources that justify them. However, there is a pitfall: steps that in prospect look routine, and are therefore omitted, may conceal unexpected difficulties. Few attempted proofs fall down because some explicit step has been carried out illogically, but a lot fall down because \u201cobvious&quot; steps turn out to be wrong.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">For example, it may seem obvious that you can\u2019t cut a solid sphere into a finite number of pieces and fit the same pieces back together to make two solid spheres \u2014 each the same size and shape as the original. Obviously the total volume of the pieces can\u2019t change if they are rearranged. However, this argument tacitly assumes that the volumes of the pieces can sensibly be defined. <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">As it happens, sufficiently complicated pieces need not have sensible volumes at all \u2014 and the \u201cimpossible&quot; dissection can actually be achieved.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Mathematicians are aware of the danger of omitting allegedly obvious steps, but because the formal style of proof is incomprehensible, they prefer to follow the narrative line. As a result, there are many styles of proof. There is the short, snappy proof, like a poem. There is the proof that carefully assembles key facts, one at a time, and puts them together, like a magazine feature article. There is the 300-page blockbuster that develops entire new theories, and uses them to demolish a major problem \u2014 roughly like a novel. And there is the massive, computer-assisted compilation, akin to a telephone directory.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Here\u2019s a simple \u201cpoetic&quot; proof. Remove two diagonally opposed corner squares of a chessboard, then try to cover all the remaining squares using 31 \u201cdominoes&quot;, each the same size and shape as two adjacent squares. It\u2019s impossible: however you try to make the pieces fit, you always run into trouble. But how do you prove it? <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">The proof requires one simple idea: every domino must cover one black square and one white square, so the total numbers of each square covered are equal. But the mutilated chessboard has 32 squares of one colour and 30 of the other. Once you get the clever idea of looking at the colours, this proof is short, sweet and convincing.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">The novel-like proof is familiar to any professional mathematician; most of us have to work through several of these blockbusters during our careers. Quite a few of us write them. My longest is about 60 pages \u2014 a novelette. Wiles\u2019s proof of Fermat\u2019s last theorem is a good example. <!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Thomas Hales\u2019s proof of the Kepler conjecture is mostly of the phone-directory type, though it sets up the computer calculation with something closer to a poem. That is, there is a simple, very clever idea, which reduces the problem to a very large list of routine computations; this reduction is \u201cpoetic&quot;. But the poem has no implications until the calculations are carried out, and that bit is a phone book.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Mathematicians prefer poetry to phone books. The famous mathematician Paul Erd\u00f6s described poetic proofs as from \u201cthe Book&quot; \u2014 a fanciful image in which God owns a book containing the best proofs, and mere mortals are occasionally afforded a glimpse at it.<!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><font size=\"2\"><!--par1--><!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">In most areas of human activity, accomplishing something difficult is seen as a triumph. It\u2019s the same in mathematics. <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">Computers open up new realms of discovery, relieving the human brain of routine tasks, leaving it free to concentrate on the big picture. Using computers in proofs \u2014 provided it is done carefully \u2014 is an intelligent application of technology to extend the powers of the human mind. <!--par0--><\/font><\/p>\n<p><!--par1--><font size=\"2\">And if a long, complicated proof is all we can find, it should be celebrated as a major intellectual achievement, not derided because it\u2019s difficult.<\/font><\/p>\n<p><a href=\"http:\/\/mybroadband.co.za\/vb\/showthread.php?t=71146\">Comments<\/a><\/p>\n<p><!--par0--><\/p>\n","protected":false},"excerpt":{"rendered":"<p>IAN STEWART ponders whether the age of Computers has killed the need for veracity.<\/p>\n","protected":false},"author":23,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_sma_x_autopost_status":"idle","_sma_x_autopost_error":"","_sma_x_post_id":"","_sma_facebook_post_id":"","_sma_instagram_post_id":"","_sma_threads_post_id":"","_sma_x_attempts":0,"footnotes":""},"categories":[17],"tags":[],"class_list":["post-551911","post","type-post","status-publish","format-standard","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/551911"}],"collection":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/comments?post=551911"}],"version-history":[{"count":0,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/551911\/revisions"}],"wp:attachment":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media?parent=551911"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/categories?post=551911"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/tags?post=551911"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}