Curiosity is a web scraper and an extensible push agent.
Curiosity mission is retrieving on the web information that matters for you, and notify you when updates of such information happen.
You have the control, as you can define:
- the web sites you want to be monitored
- the data you want to be extracted
- how you should be notified of changes
- how data should be formatted
The rules for information extraction are defined through the XPath language, and can be easily engineered by means of a visual tool.
By means of Curiosity, you can for example attach RSS feeds to whatever site you want, and about whatever information you want – not just news. And, if you prefer, Curiosity can email such information to you or to a list of contacts, letting you decide how the data will be displayed in the email body.
Curiosity can also provide the extracted information in xml format using your own xml schema, and then upload to an FTP site the generated xml file, or even email it as an attachament. This way, you can exploit the extracted data also in your own applications.
But Curiosity isn't limited to notify you just of new items added, it can also identify changes and deletions.
Moreover, Cusiosity is extensible. You can implement (using .NET) whatever method of notification you want: for example, you can push extracted data into legacy systems.
Finally, Curiosity functions can be invoked too through SOAP web services - which are exposed by means of an embedded ASP.NET application server.
Now, you can go through the Quick Start tour or read more about:
As Curiosity is a work in progress, you may also want to checkout the Cusiosity roadmap.