Scoring A Twice Released Protein

Started by karstenw

AsDawnBreaks Lv 1

That's fine. In the end, it shows in the hand folding round, the lowest energy states are generally closest to the native, as opposed to the regular round, where that was not always true.

"This leads me to Hand-Folding:

(Pic 1)

The above figure is an RMSD plot for Puzzle 689b: Hand-Folding CASP10 T0711 Repost. It was a 33 residue freestyle puzzle, with templates, and had 3 disulfide bridges (which you totally got perfectly!). The rosetta energy (y-axis) is what you see in the game as it corresponds to the Foldit score (except that it is negative on this plot). On the x-axis is the RMSD representing how far from the native each Foldit solution is (RMSD = 0 is a perfect match, RMSD = 33 is completely wrong).

You can see above that the lowest Rosetta Energy—the top-scoring Foldit solution—the one that is easy to pick out by score, is actually one of the closest to the native.

Now compare that RMSD plot to the one for Puzzle 694: CASP T0711 Disulfide Repost Round 2:

(Pic 2)

This is the same plot as above, except for Round 2 of this puzzle (when Lua scripts and sharing was allowed) where you can see that if we now selected the best Foldit score (lowest Rosetta energy) it would not be the solution that is closest to the native. What we want is for the lowest points to be as far to the left as possible."

Seems like it's fairly obvious HF round's highest score is closer to the native than the LUA round.

gitwut Lv 1

Thank you for the explanation. So you meant that the devs provided statistics. My confusion was with both the interpretation of we (as in Foldit, Beta Folders, or devs) and what it was we did.

I can see where a case for hand folding could be made for that pair of puzzles, but is it sound to generalize beyond that 1 set?

I was hoping to see results based on a broader and more varied puzzle population (larger proteins, more varied SS, etc.). Granted that may not be possible yet, as I have no idea if the natives are known for any of the other puzzle pairs we've done so far. I'm not even sure how many pairs we've done, though it seems like a lot.

AsDawnBreaks Lv 1

I follow. Sorry about the confusion, I see I wasn't very clear. And I agree, it would be nice to see it on other types, but much of that really comes with time. I bet we may see some with CASP, but I can't say for sure.

AsDawnBreaks Lv 1

But it's not meant as a new solution. It's really meant for you to do the Hand folding round (so Devs get varied solutions that are not pushed into false local minimums within the first day, in theory), then you load them in to refine your solution. If hand folding gets better points, and that's your only goal (which personally, it shouldn't matter that much as our goal here is science), then do the hand folding.