Originally Posted by BlueAngel
Don't think I believe the BOT can do all that is written about it (i.e., predictions).
Looking for key words and taking snap shots of the text before and after the key word, sounds plausible.
Where is it stored?
Why is the information collected?
Well I'm pretty sure the yahoo and google type bots are used for their advertising. Say you post in a thread that is about Fried Chicken. When you open that page (if it has google/yahoo ads embedded in the page) you are most likely going to see ads that have something in common with Fried Chicken. Maybe for Crisco, maybe for KFC, maybe chicken recipes.
Here's an example:
You'll see that just a little bit under the header they have google ads. Most of these are going to be related to fish or fishtanks.
As for the web bot that is predicting things, that's a whole other thing.