Puzzle 1465 "SCORING BUG"

Started by ZeroLeak7

spvincent Lv 1

OK, I have managed to catch the bug both solo and evo on 1560. I'm currently #1 on both boards, but the scores are inflated by 330 points.

phi16 Lv 1

I just jumped from 11216 on 1560, my actual score as r1, to 11549, my score without adding -333, the penalty for having 1 bad residue and 14 extra residues. There is definitely a bug in there somewhere.

georg137 Lv 1

Well, it now appears that active puzzles 1559 and 1560 are displaying fictitious scores for pole positions on the leader-boards.

It is not unfair to ask - if two of the three active puzzle scores are compromised, then what confidence should foldit contributors have in scoring accuracy? The same question also applies to solutions selected for further development, and to contributor ratings which are calculated from scores.

Possibly analogous to a situation where voters lose confidence in electronic balloting.

LociOiling Lv 1

This has been a long-term problem. Part of the problem seems to be bonus-related or maybe penalty-related is a better term. For a long time, recentbest tended to overlook the penalty for added segments. This seems to have been fixed (?) as of 20180725-d14dae34c3-win_x86-devprev.

Now we're seeing a similar problem, where absolutebest gets pushed out to the server as if it were creditbest.

Not sure if penalties account for all the differences. On 1559, georg137 has a lead of over 300 points, and that puzzle has only disulfide bonus, not penalty. Others are seeing similar unexplained jumps on 1560.

Here are some examples from puzzle 1557, where it appears absolutebest was pushed out to the server instead of creditbest.



On the first one, absolutebest is only a couple of points ahead. I didn't catch this one in time to save the absolutebest pose.

[img_assist nid=2005569 title= desc= link=node align=left width=640 height=515]



The next one was kind of similar.
[img_assist|nid=2005570|title=|desc=|link=node|align=left|width=640|height=512]



I was able to save the "very best" pose for the second case and open it on a different client. It opened at 10,610 instead of 10,620. The 10,620 score seems to overlook the net penalty, -10 points.
[img_assist|nid=2005571|title=|desc=|link=node|align=left|width=640|height=512]

LociOiling Lv 1

PS, I actually did end up with a score of 10620.191 with no scoring glitch on my 1557 solo. (The saved solution opens with the same score, and the penalty/bonus math seems correct.) So actiasluna was not robbed at the end, despite where things stood with 5 hours 10 minutes remaining.

LociOiling Lv 1

Somewhere Murphy is laughing, the bug bit on me on puzzle 1560. All of a sudden both absolutebest and recentbest incorrectly show a score of 10595, 330 points higher than the creditbest score. The net penalty just happens to be 330 points. What's worse is the 10595 has been pushed out to the scoreboards.

Actually, 330 free points is not so bad, we should upgrade this bug to a feature…but seriously, willing to have this invalid high zapped. There's a slight chance I can make up the points, but it'll be tough.

A little image magic was applied to get all the bests on the screen.

[img_assist nid=2005573 title= desc= link=node align=left width=640 height=360]

LociOiling Lv 1

OK, I have managed to catch the bug both solo and evo on 1560. I'm currently #1 on both boards, but the scores are inflated by 330 points.

georg137 Lv 1

My confidence is scoring is zero. This bug has affected scores on almost every recent puzzle. My 1561 score is now fictitious, too. Looking around, one has to wonder how many other scores are fictitious.

jflat06 Staff Lv 1

Thanks for the feedback everyone - we're continuing to look into this bug.

In the future, this may not be much of an issue regardless, as we will be transitioning to positive-only filter bonuses in puzzles posted from here on out. In this case, your best score will always (or nearly always) be with the filters on, so there shouldn't be any scoring mishaps.