Web Crawler Prediction Software?

I am sure some of you have heard of this type of prediction tool. I heard about it briefly on coast to Coast and was very very intrigued. Some kind of software
that 'crawls' the web analyzing chatter from chat rooms, message boards, web sites etc. etc. then basing predictions from that. This type of thing apparently predicted 9/11 months prior among other things.


Anyone know more about this, how it works? And if there is software you can use to do this? Can anyone utilize such a web crawling tool and analyze data off internet hubs?

Thanks!

errm is "Web Crawler Prediction Software" the name of the software? I can do some research, but it would help if I search for the right thing lol

Originally posted by partyforbeer

Anyone know more about this, how it works? And if there is software you can use to do this? Can anyone utilize such a web crawling tool and analyze data off internet hubs?

Hi partyforbeer. I think you may be referring to the Web Bot system developed by Geroge Ure's friend; the mysterious 'Cliff'. You can get some background information on this fascinating technology by going here...and here. Subscriptions are available here. $240 for each new series of reports

Good Luck

You can find out more on Half Past Human, the website of the project discussed on C2C.

They use computational linguistics to mine the web for information that could be predictive, though they call themselves nutjobs and say that the data in their ALTA Reports is for entertainment purposes only.

It seems to me that it is definitely *not* reliable for predicting the future. The language on the web describes things that have already happened, even down to the nano-second. Because it is a record, it cannot do anything more *than* describe.

You probably could find some interesting correlations and matches, but beyond that, I seriously doubt that these relationships would have any predictive power in themselves.

Another name for it is web-bot - try a search

It's my understanding that the Web Bot collects bits of Internet chatter, collates the information, and discards all present and past tense references in the process. It only analyzes progressive language trends to establish probabilities. Dean Radin's 'random numbers generator' experiments are more ethereal in nature, but the two systems do appear to be testing at least two similar theses....the sensitivity of the collective unconscious to events of magnitude, and the predictive capabilities of the global psyche.

I can't help but compare the Web Bot, with technical stock analysis. While traditional TA differs because it attempts to predict and exploit future stock movements based exclusively on past and present performance trends, the foundation of both systems is the same...human emotion, and psychology.

I wouldn't be fooled by the frivolous appearance of the halfpasthuman website, or by their tongue-in-cheek disclaimer...I'm pretty sure these people take their work seriously.

For comparison check-out this excerpt from [Friend-of-Bot] George Ure's disclaimer:

"Only a weak-willed sissy (or a lawyer - and a slimy one at that) would ever really read a disclaimer. By reading this you are admitting that you are not in charge of your personal life, that you have no self confidence and can not be trusted to make your own intelligent decisions. Is that what you really want? Do you want your friends to know what a flake you are? Do you want the whole world to know that if something goes wrong - rather than fixing it - you'll run simpering to a shyster to make it right.

Any idiot should know that the Internet is a wild West kind of place and that when you visit an Internet site, you take your chances. Come on, grow up!"

This from a leading futures trader...held in some esteem. George also takes his work seriously, but clearly these folks are concerned about potential litigation. All one needs to do is check today's stats to understand why.

reply to post by partyforbeer


Such "bot" stuff, is secret. Noory is a big shot, and gets free big shot info and quality predictions.

Take care. --------------------------------------PC

Was it a hit? Sounds like it, but I'm not thoroughly convinced yet. I'm not a Web Bot subscriber, and I've only been paying attention to George's Bot-briefs for a few months now. From the viewpoint of a Market-Geek, I am intrigued...hope you enjoy the update.

Another update from George Ure today. It appears that Web Bot analysis continues to reference the strong possibility of a major event occurring in September. Near the end of this missive George offers three possible scenarios. Just scroll down to Scaling September. The unusual S&P (SPY options) activity that he mentions is valid, and currently the subject much speculation on the stock boards. Here's a link to the first post on the Market Ticker thread where it all began on Wednesday...12 pages and growing. With all this emphasis on September, next month may provide the Litmus Test for Web Bot credibility.

[edit on 24-8-2007 by OBE1]

No, I am not resurrescting a thread, well yes I am

But this seems to be an update on the original post, and it saves making a new thread when one exists :

Web spy software hacks into secretive online forums

THE dark corners of cyberspace are being illuminated by indexing software that can reach into secretive websites that are normally inaccessible to search engines. This could allow search engines to cover online forums lurking within the "dark web", and provide insights into what is being said by groups who would rather keep their conversations secret.

Conventional search engines use programs called spiders or web crawlers that scuttle around the internet and index what they find. However, many websites are protected by security restrictions that fend off such software. Screening out all traffic from IP addresses belonging to well-known search engines is one way to do this.

The dark web can provide a haven for extremist groups to exchange ideas, says Hsinchun Chen, director of the artificial intelligence laboratory at the University of Arizona in Tucson. So Chen and his team devised software to access and index protected online forums (Journal of the American Society for Information Science and Technology, DOI: 10.1002/asi.21323).

Source

*****EDIT FOR CONTENT*****

I have found the answer to my own question, sorry for digging up an old thread....