PDB export and project aims

Started by ipatrol

ipatrol Lv 1

You know, on denovo puzzles, you can use a script combined with the script log to export the letter sequence, then substitute the newlines for hyphens and the letters for the three-letter sequences and import that into Avogadro, so export can always be arranged. I'm also sure that the IR_PUZZLE files can be spoofed and manipulated to point to a PDB file, so import is always possible. Since with a little time it can happen anyway, I suggest you stop being obstinate and just add the feature so we can work with you instead of against you.

tealight Lv 1

Perhaps if you werent so disgustingly rude, they would be more inclined to take notice of what you have to say.
I read your posts ipatrol and you raise my ire, and Im just a player.

" you get more bees to honey than you do with vinegar"…you may wish to take that on board

B_2 Lv 1

Is ipatrol just making noise? It doesn't seem from the rankings that he/she is very much involved with playing the GAME of FoldIt.

I don't think using outside tools is at all good for the GAME. It will take all competitiveness out of it if we have things like this http://foldit.wikia.com/wiki/Puzzle_482 going on, where there is perhaps one in a thousand players who could use this process, and it immediately puts other solo and group contributions down to also-ran status.

It will make the original goals of FoldIt meaningless, and turn it into just another competition between a few people who have the skills and tools that are not part of the GAME. Apparently there is no way to prevent the use of such tools, but hopefully players will take the honorable approach and not use them.

Use ONLY what is provided in the game, what information is provided in the puzzles by the developers, and whatever creativeness you can achieve using the recipe system as provided.

infjamc Lv 1

Brick:

I totally saw your comment coming, so I'll respond to your concerns regarding Puzzle 482.

  1. The concern regarding fairness is exactly why I made my team's approach to that puzzle public afterward– so that everyone could try it. Now, in retrospect, I do admit that I could have mentioned the existed of the 2L3B NMR model as soon as I discovered it. But I chose not to do so because I don't want to skew the aggregate results, which could occur if everyone tries to attempt a full copy without thinking.
    .

  2. I would argue that having the extra information actually HELPED the goal of advancing science in this case. The result of Puzzles 482 and 485 speak for themselves: no other team, not even wudoo's super-scripts (which have been very successful in most other puzzles), even came close. My interpretation of this result is that this is one of those proteins where the existing automated methods have trouble with. Since the NMR model is in a public database, and I manually incorporated the information from 2L3B into the game the hard way (as opposed to simply loading the PDB into the game), I don't see anything wrong with the way I approached this puzzle.
    .

  3. Now, you could legitimately argue that I should not get soloist credit for the puzzle because I was essentially evolving the 2L3B model. That would be fine for me, because my intention behind looking up the sequence on RCSB was for the sake of science, to get one step closer to the correct structure by conducting homology modeling manually. It just happened that there was an exact match this time, so I can understand why you feel this is unfair.
    .

  4. If you are concerned that looking up outside information would consistently as a strategy for maximizing Foldit score (and thus put other players at a disadvantage), I can assure from personal experience that this is not the case as a rule. I can say this because–at the risk of boasting–I know that I'm very good at reverse-engineering solutions. Based on my past experiments with a few puzzles for which the native is known, my conclusion is that manual copying, doesn't pay, because you will almost always end up with a lower score than playing normally. Take Puzzle 482 for example: my initial solution only scored 10085, and it was extensive further rebuilding by myself and teammates that picked up the 600+ extra points. In other words, the decision to use outside information made a difference this time, but this is the exception rather than the rule.
    .

  5. Now, as for allowing PDB imports and exports (so that people can edit structures directly with a 3rd-party program rather than having to manually incorporate extra outside information into the game like I did in Puzzle 482):

Personally, I'm neutral on the issue because I can see both sides. On one hand, this might help advance science if the use of a 3rd-party program could achieve things that are difficult with only Foldit. At the same time, I also understand your concern that this could give "experts" an advantage. So, if I have to choose, my compromise solution would be "allow it with limitations: anything that's exported/imported puts you in evolver mode."

infjamc Lv 1

And before I forget:

Look up the NMR structure yourself ( http://www.pdb.org/pdb/explore/explore.do?structureId=2L3B ) and compare that to my team's 10776 solution. You'll see that while the sheet sections are similar, the loop sections deviated significantly. So this is not a case where we scored high due to "cheating" (i.e. simply copying a known structure), but rather that an inaccurate NMR structure was further improved.

beta_helix Staff Lv 1

"I'm also sure that the IR_PUZZLE files can be spoofed and manipulated to point to a PDB file, so import is always possible"

if that becomes a problem, we will address it.
Until then, as Foldit is game there is no reason to let you import/export files.

If you "want the ability to interface directly with the game using molecular dynamics software" yourself (for scientific reasons or for fun) then you can do exactly that with the standalone version:
http://depts.washington.edu/uwc4c/express-licenses/assets/foldit/
You can load in any file you want, run Foldit and output your results. Then you can interface with external programs all you want.

If there is a particular external program that you feel would be beneficial to Foldit, then you can open a specific feedback about that. We could add it to the game, that way every Foldit player would be able to use it.
______

In regard to Brick & infjamc's comments about Puzzle 482… I'll try to keep this simple:

Not every Foldit puzzle is a CASP or Unsolved protein. Basically, those cases are rare (getting our hands on those puzzles is not easy, it's not like unsolved structures are being solved every day, that's why we need Foldit in the first place!) and if we only posted unsolved cases you would have very few puzzles.

Every new feature we come up with requires a lot of tweaking (as you all know, just look at Exploration puzzles!) and there is no way we could find out how well these new features are doing if we can't check your solutions against the native. This means that we would have to wait until the native comes out to get ANY feedback on your puzzles, which is not a feasible solution.
To make it fair, we could include the native guide on every non-unsolved puzzle, but that would be pointless except to make sure the tools are sufficient (which we sometimes do).

Every puzzle that has the word "unsolved" in the description (or is a new CASP puzzle) will not have a publicly available native. We could only give out points for those puzzles, and the rest could just be for fun (or essentially BETA puzzles to improve the tools in the game) but if that is a route players want to go down, it would require a developer chat as this would be quite a change!

Specifically speaking of Puzzle 482… I PMed infjamc about his top-scoring solution and got an even more detailed reply than what is posted in the wiki.
I showed his reply at last week's Foldit meeting and because of it 2 things were decided:

1) we are going to try to find even more unsolved cases (we have already contacted the PDB to be able to get their sequences 3 weeks before they release them, just heard back today that this could be possible)

2) Puzzle 482 was actually designed to test whether or not the current version of the Alignment Tool was sufficient to find the correct alignment. All of you and I have known for a while that the Alignment Tool was difficult to use, but the results from 482 finally proved to the entire Foldit Team that we need to add cutpoints to the Alignment Tool. infjamc has been saying this for over a year:
http://fold.it/portal/node/986943

Thanks to the results for Puzzle 482, the current top priority is to implement cutpoints into Foldit so that you can add them yourselves (it was always on the list, but is now at the top of the queue!). This should significantly help in Exploration Puzzles, Electron Density Puzzles, Symmetry, and obviously with the Alignment Tool.

I hope this makes your day, infjamc! :-)

I'll be happy to discuss this further, but a different feedback or Forum post would be more appropriate. Thanks!

B_2 Lv 1

I guess if a puzzle is based on a known or previously predicted solution, we should just start with that solution to save everyone the work of trying to manually replicate it in the FoldIt client, and we can all be on a level playing field. We certainly don't need the exercise of assembling the long string starting positions if people can just go to the databases and get the solutions.

The ideal of "advancing science" is admirable, but I thought the intent of this game was to develop tools and processes WITHIN the game confines to improve the ability to predict structures.

B_2 Lv 1

Well, since we can't load it into foldit, and your team solution isn't shared for everyone to open, I guess we can't do that.

infjamc Lv 1

  1. I'm actually in favor of your idea of pre-loading a known solution to level the playing field if the purpose of the puzzle is to, say, refine an NMR model (because a crystal structure is not available). Of course, this wouldn't work in puzzles that are meant to test the tools (e.g. 482), but it should work in other cases. Believe me, even though I'm good at reverse engineering solutions, I would prefer not to have to do that manually myself either.

  2. Well, the game contributes to both improving automatic algorithms and predicting structures for which current methods simply fail to solve. The two goals are not mutually exclusive.

infjamc Lv 1

For the record, I would have uploaded my earlier 10085 solution or even the latter 10658 if there's a way to do so. After all, as much as I like to see myself and my team score high, I care about the science even more; if uploading means not being able to be top-ranked, so be it.

But the problem is that the program currently doesn't allow for uploading to everyone.