BBO Discussion Forums: Error in par analysis on hand records - BBO Discussion Forums

Jump to content

  • 2 Pages +
  • 1
  • 2
  • You cannot start a new topic
  • You cannot reply to this topic

Error in par analysis on hand records

#1 User is offline   FrancesHinden 

  • Limit bidder
  • PipPipPipPipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 8,482
  • Joined: 2004-November-02
  • Gender:Female
  • Location:England
  • Interests:Bridge, classical music, skiing... but I spend more time earning a living than doing any of those

Posted 2012-September-30, 04:30

I have a set of hand records, which claim to be created by "HandPrint version 2.0.0" and come from a Duplimate file.
In common with most modern hand records, they include the full DF tables i.e. how many tricks each side can make in each denomination.

They also include the Optimal Result (what I call the par result) for each hand e.g. if NS can made 1370 and EW have a save, it says Opt. Res. 1100, if the "save" is 1400 it says Opt. Res. 1370

On one board the calculation of the Optimal Result is wrong. I'm 100% certain it's wrong, as is everyone else to whom I've shown this.
(EW can make 9 tricks in NT and 10 tricks in diamonds; NS cannot make more than 7 tricks in a major or 8 tricks in clubs and are vulnerable; it has Opt. Res. as EW +130 rather than +500)

I was astonished.

Does anyone care to be told this? I can't work out where the software actually comes from.
0

#2 User is offline   lalldonn 

  • PipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 1,066
  • Joined: 2012-March-06

Posted 2012-September-30, 05:18

Weird, I just looked at a website under design for a bridge club club (mostly for formatting and style suggestions) but I looked at exactly one hand from a game there and par was wrong. By the website's own double dummy analysis (which my analysis confirmed was true) NS could make 10 tricks in diamonds or 9 tricks in hearts and EW could make 9 tricks in spades, but it said par was NS -100 in 4X instead of +130 in 4 (EW were vul so would go for 200 in 4X). I have no idea where that analysis comes from, or if the source could even be the same as the one you are looking at.
"What's the big rebid problem? After 1♦ - 1♠, I can rebid 1NT, 2♠, or 2♦."
- billw55
0

#3 User is offline   1eyedjack 

  • PipPipPipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 6,575
  • Joined: 2004-March-12
  • Gender:Male
  • Location:UK

Posted 2012-September-30, 05:20

I have seen this happen before. I was likewise astonished the first time I came across it. Less so now.

I am not familiar with the particular software package or version that you use.

Some early versions of various DD analysers had the occasional bug. I got the impression that the popular ones had ironed them out by now.
Psych (pron. saik): A gross and deliberate misstatement of honour strength and/or suit length. Expressly permitted under Law 73E but forbidden contrary to that law by Acol club tourneys.

Psyche (pron. sahy-kee): The human soul, spirit or mind (derived, personification thereof, beloved of Eros, Greek myth).
Masterminding (pron. mPosted ImagesPosted ImagetPosted Imager-mPosted ImagendPosted Imageing) tr. v. - Any bid made by bridge player with which partner disagrees.

"Gentlemen, when the barrage lifts." 9th battalion, King's own Yorkshire light infantry,
2000 years earlier: "morituri te salutant"

"I will be with you, whatever". Blair to Bush, precursor to invasion of Iraq
0

#4 User is offline   mattias 

  • PipPipPip
  • Group: Full Members
  • Posts: 55
  • Joined: 2010-October-20

Posted 2012-September-30, 06:19

The duplimate makers are aware of this problem, and it is solved in later versions of their software. A newer version can be downloaded from http://www.duplimate.com/Download.html, see BOS-package.
0

#5 User is offline   Zelandakh 

  • PipPipPipPipPipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 10,744
  • Joined: 2006-May-18
  • Gender:Not Telling

Posted 2012-October-01, 05:02

I often find mistakes in the par scores for printed records at my local club. Since I always go through the hands and do some analysis based around this they are usually found.
(-: Zel :-)
0

#6 User is offline   PeterAlan 

  • PipPipPipPipPip
  • Group: Full Members
  • Posts: 617
  • Joined: 2010-May-03
  • Gender:Male

Posted 2012-November-26, 10:34

View PostFrancesHinden, on 2012-September-30, 04:30, said:

I have a set of hand records, which claim to be created by "HandPrint version 2.0.0" and come from a Duplimate file.
In common with most modern hand records, they include the full DF tables i.e. how many tricks each side can make in each denomination.

They also include the Optimal Result (what I call the par result) for each hand e.g. if NS can made 1370 and EW have a save, it says Opt. Res. 1100, if the "save" is 1400 it says Opt. Res. 1370

On one board the calculation of the Optimal Result is wrong. I'm 100% certain it's wrong, as is everyone else to whom I've shown this.
(EW can make 9 tricks in NT and 10 tricks in diamonds; NS cannot make more than 7 tricks in a major or 8 tricks in clubs and are vulnerable; it has Opt. Res. as EW +130 rather than +500)

I was astonished.

Does anyone care to be told this? I can't work out where the software actually comes from.

There are several different angles to this matter, and the comments that follow are probably not the complete picture, but may nevertheless add some light. I'd be very interested to see the hand that provoked the problem, and would be grateful if you are able to post it together with the corresponding DF table.

First, this problem definitely exists and in several different forms - some further examples below.

Second, and in answer to your last question, "HandPrint version 2.0.0" is a utility written by Kaj G Backas (http://www.sackab.fi...tm/KGB_main.htm) that takes a deal file in .dlm format, runs the Deep Finesse engine against the hands, gathers the makeable contract information, attempts to calculate the optimum result, and finally puts all this together (using the Ghostscript utility) in .pdf output form. This utility used to be bundled with the BOS software that came with Duplimate dealing machines; the current position is a bit different (see below). It may also be used with other dealing software / machines, but I have no information on that.

More recent versions of the DupSoft dealing software that now comes with Duplimate machines differ from earlier versions in a number of respects: in particular (1) it builds in makeable contract analysis (now using Bo Haglund's double-dummy analyser rather than Deep Finesse), and (2) it uses its own Jannersten-written optimum result calculator to feed the hand print utility that's bundled (and which you call from the DupSoft menu structure).

That Jannersten-written calculator had its own bugs - I saw it produce an optimum contract of 8X in a printout early this year (from the software version downloaded at about the same time - I don't have the version number handy). Because of this, I e-mailed both Jannersten and Kaj Backas about it - it was then that he told me that it was no longer his optimum contract analyser that Jannersten were using, and that theirs was still buggy. He also said that "My original handprint functions better, although i know that it is not perfect."

As mattias says, the Jannersten software continues to be updated, and I haven't run my earlier problem hand through the latest version.

There can also be other issues - you can use other dealing programs, such as DealMaster, with Duplimate machines, and they have their own facilities for producing handprints which, even when using Backas's utility, can introduce their own problems. For example, it's possible with several such set-ups to limit the analysis that's done to eliminate certain (lack of) trump fits, probably because it used to take up to 15 minutes or so to DF-analyse a typical 32 board set on the PCs typically used a few years ago. At the Northants Swiss Pairs 3 years ago, through a misunderstanding my partner and I ended in 6 with AKQJx opposite a void (Ron Davis and his partner were the only others in this contract!). Trumps were 4-4, there were 6 tricks and A outside, and no defence to the slam. We were astonished to see the hand analysis telling us that we couldn't make any contract; the reason was apparently that the analyser hadn't even looked at contracts our way.

The conclusion I draw from all this is that the quality of the hand records you get will depend on what software has been used to produce it, and how old the version in use actually is. This is likely to remain the case for quite some time, until both all the software in use exists in a completely correct version and everyone producing hand records has updated to that software.

It's actually not a trivial problem to determine the optimum contract in an algorithmic form that you can implement in software, because there are many traps for simple-minded approaches, quite apart from the obvious ones like N/S can make 4NT for 4/630, E/W have a 3/500 save in 5X, but N/S can then make 4/600 in 5. For example, you might, as a first stab, say "Let's start with the dealer, treat them as bidding the highest-scoring makeable contract at the corresponding level (ie taking 4NT as the opening bid if 4/630 is the highest making score played from that position), and work round the table in the obvious way to see if either side can improve their position." Then you realise that this won't do - suppose dealer can make 5, but no other game, but partner can make 4NT - so then you might try adapting the approach in such cases to start with something notional that doesn't out-bid partner's higher-scoring maximum positive score. Then you realise that there are hands that can make 3NT for both N/S and E/W, so you need to get the dealing side in first. But now let's suppose (and unless you can prove in advance that there isn't, that's what you have to do) that there's a hand where N as dealer can make just 2NT, yet both E and S can make 3NT as declarer, and so the optimum result is N playing 3NT-1. And so on ...

Obviously there's a solution to this - these examples are off the top of my head, I haven't had occasion to try and work it out fully, and quite possibly someone will post the answer. But the point is that it's quite difficult, and I'm not surprised that those who have tried to implement an algorithm may not have got it 100% correct.
3

#7 User is online   hrothgar 

  • PipPipPipPipPipPipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 15,626
  • Joined: 2003-February-13
  • Gender:Male
  • Location:Natick, MA
  • Interests:Travel
    Cooking
    Brewing
    Hiking

Posted 2012-November-26, 10:52

View PostPeterAlan, on 2012-November-26, 10:34, said:

Obviously there's a solution to this - these examples are off the top of my head, I haven't had occasion to try and work it out fully, and quite possibly someone will post the answer. But the point is that it's quite difficult, and I'm not surprised that those who have tried to implement an algorithm may not have got it 100% correct.


I haven't thought about this carefully, but this strikes me as a standard example where a minimax approach will yield a sub game perfect equilibrium.
Alderaan delenda est
0

#8 User is offline   PeterAlan 

  • PipPipPipPipPip
  • Group: Full Members
  • Posts: 617
  • Joined: 2010-May-03
  • Gender:Male

Posted 2012-November-26, 10:59

View Posthrothgar, on 2012-November-26, 10:52, said:

I haven't thought about this carefully, but this strikes me as a standard example where a minimax approach will yield a sub game perfect equilibrium.

Oh, I'm quite sure that you can throw a bit of CS / game theory at it and solve the problem that way. But if you're not well versed in that, and quite probably those who've written the software we see don't have that sort of background and have instead approached it in the kind of way I've described, then you'll come across the sort of traps that I've mentioned and may fall into one or more of them.
0

#9 User is offline   mycroft 

  • Secretary Bird
  • PipPipPipPipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 7,886
  • Joined: 2003-July-12
  • Gender:Male
  • Location:Calgary, D18; Chapala, D16

Posted 2012-November-26, 12:07

One problem with anything that uses DF to generate results is that par can be 6 or fewer tricks (6x-6 at favourable, for instance), and DF (when I had to use it to determine something odd) wouldn't tell you how many tricks made in a suit by a side if it wasn't a contract.
When I go to sea, don't fear for me, Fear For The Storm -- Birdie and the Swansong (tSCoSI)
0

#10 User is offline   PeterAlan 

  • PipPipPipPipPip
  • Group: Full Members
  • Posts: 617
  • Joined: 2010-May-03
  • Gender:Male

Posted 2012-November-26, 17:33

View Postmycroft, on 2012-November-26, 12:07, said:

One problem with anything that uses DF to generate results is that par can be 6 or fewer tricks (6x-6 at favourable, for instance), and DF (when I had to use it to determine something odd) wouldn't tell you how many tricks made in a suit by a side if it wasn't a contract.

You can certainly use the current version of the stand-alone Deep Finesse to get this information (use Modify / Modify Total Tricks), and as I remember (I've not got it installed any more) you could do the same with the original - it's just that the main interface only presents playable contracts. However, it's the underlying calculation "engine" that the analysers use, and I think it's always been possible to get the relevant information (the number of tricks available to each of the 4 possible declarers in each of the 5 denominations) from that.
0

#11 User is offline   dwar0123 

  • PipPipPipPipPip
  • Group: Full Members
  • Posts: 770
  • Joined: 2011-September-23
  • Gender:Male
  • Location:Bellevue, WA

Posted 2012-December-03, 13:55

Yesterday the club result hand records had an 8X sac -2000 as a par result against a making 7nt.

Actually I can post the handrecord, they have them online
http://www.eastsideb...rds/121202A.pdf
board 28.
0

#12 User is offline   barmar 

  • PipPipPipPipPipPipPipPipPipPipPipPip
  • Group: Admin
  • Posts: 21,729
  • Joined: 2004-August-21
  • Gender:Male

Posted 2012-December-03, 19:24

Maybe that joke is why there's a big smiley on the hand record ;)

#13 User is offline   PeterAlan 

  • PipPipPipPipPip
  • Group: Full Members
  • Posts: 617
  • Joined: 2010-May-03
  • Gender:Male

Posted 2012-December-03, 21:02

View Postdwar0123, on 2012-December-03, 13:55, said:

Yesterday the club result hand records had an 8X sac -2000 as a par result against a making 7nt.

Actually I can post the handrecord, they have them online
http://www.eastsideb...rds/121202A.pdf
board 28.

Seems familiar - from the formatting (and the bug) it looks like it was produced with the Jannersten software I mentioned in #6 above. Jannersten certainly know about it (they acknowledged it to me in March), but their e-mail suggested it might be a while before it was fixed. I'll ask again, and post the answer here.
0

#14 User is offline   PeterAlan 

  • PipPipPipPipPip
  • Group: Full Members
  • Posts: 617
  • Joined: 2010-May-03
  • Gender:Male

Posted 2012-December-04, 03:21

I've now had an e-mail back from Jannersten / Duplimate to say that bug is fixed in the current release.
0

#15 User is offline   pigpenz 

  • PipPipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 2,554
  • Joined: 2005-April-25

Posted 2012-December-29, 19:18

isnt the deep finesse anaylysis different that what the par result is?

if DF says 6making is normal +1430, but 6x other way -4 -1100 or even -5 -1400 then that is the par
I would take par assumes that the most perfect score is obtained either on offense or defense. Where Deep Finesse
analaysis or DD just says what contracts can make.
0

#16 User is offline   barmar 

  • PipPipPipPipPipPipPipPipPipPipPipPip
  • Group: Admin
  • Posts: 21,729
  • Joined: 2004-August-21
  • Gender:Male

Posted 2012-December-29, 22:03

The idea is that if you have the DD analysis for each strain, and know the vulnerability, you should be able to calculate the par result from that.

#17 User is offline   pigpenz 

  • PipPipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 2,554
  • Joined: 2005-April-25

Posted 2013-January-01, 12:26

View Postbarmar, on 2012-December-29, 22:03, said:

The idea is that if you have the DD analysis for each strain, and know the vulnerability, you should be able to calculate the par result from that.

I think what is interesting is to go to regional results where
the hand records are posted with the travelers and see what
par gets you in relation to avg matchpoint results

par doesnt necessarily mean avg or avg plus
there are still alot of other variables involved
0

#18 User is offline   Zelandakh 

  • PipPipPipPipPipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 10,744
  • Joined: 2006-May-18
  • Gender:Not Telling

Posted 2013-January-02, 08:51

Another error on this week's results. This one seems to be caused by not looking for a higher level contract. NS can make 10 tricks in hearts (420) or 11 tricks in diamonds (400). EW can make 10 tricks in spades (620). The par score is given as 100EW, presumably for 5X-1(N). Obviously the correct result is 200NS. Despite these mistakes, I find the DD analysis very helpful in going through the boards quickly and it generally takes very little time to find the errors.

Incidentally, my ritual after every session is to produce numbers for how many hands are declared by my partner, by myself and how many we defend, plus a total of how many tricks we were over or under par. Then the number of hands where we beat, were below, or equal to par. And for the MP results themselves grouped by (roughly) bottom > minus > ave- > ave > ave+ > plus > top. Over time these numbers give a reasonable approximation to how well we are doing overall and how aggressive or swingy we are. But the most important part is to go through the hands individually, with the auctions recorded so I can refer back when I spot patterns.

Anyone else have a similar ritual? or ideas on anything else I should be doing to get the most from this?
(-: Zel :-)
0

#19 User is offline   barmar 

  • PipPipPipPipPipPipPipPipPipPipPipPip
  • Group: Admin
  • Posts: 21,729
  • Joined: 2004-August-21
  • Gender:Male

Posted 2013-January-02, 12:45

View PostZelandakh, on 2013-January-02, 08:51, said:

Another error on this week's results. This one seems to be caused by not looking for a higher level contract. NS can make 10 tricks in hearts (420) or 11 tricks in diamonds (400). EW can make 10 tricks in spades (620). The par score is given as 100EW, presumably for 5X-1(N).

Yeah, that seems like a bug. It sounds like it saw that the strain with the best positive score for NS was hearts, so ignored diamonds when determining what could be done to improve their results over 4 by EW.

#20 User is offline   pigpenz 

  • PipPipPipPipPipPipPip
  • Group: Advanced Members
  • Posts: 2,554
  • Joined: 2005-April-25

Posted 2013-January-04, 11:03

interesting thread but I am still wondering what the fuss is about what is par only because what is its relevance to
matchpoints or imp results unless you are being compared to what the par result should be?

yesterday played in a ll 1/2 table game, there were 36 boards in play 8 being top

went through each board and compared matchpoint results for par
results:
score 129.5 avg 144 for N/S for the 36 boards
imps could be more drastic as there are quite a few hands where what is par is flat 0 (zero) at matchpoints could be more at imps

I was playing in a tournament this summer with a 10,000 plus player (Richard Potter) and we got into this discussion on how
worhtless the par result marking on the hand records really was....so after that discussion I started doing this for club games
at that time and noticed there def. is a luck of the draw on which direction you sit for a particular round when comparing to par.
0

  • 2 Pages +
  • 1
  • 2
  • You cannot start a new topic
  • You cannot reply to this topic

1 User(s) are reading this topic
0 members, 1 guests, 0 anonymous users