Linux.com

Author Message
Joined: Jan 25, 2008
Posts: 1
Other Topics
Posted Jan 28, 2008 at 8:03:44 PM
Subject: What program can I use to monitor web pages for changes?

I need a program or script to monitor a list of web pages and alert me (via email or RSS) when specified parts of any of the pages change. I'd like to run it on a shared web hosting account, so PHP, Python, etc. would be nice. I've used Webmon in the past, but it doesn't do email or RSS alerts and it's Windows only. I'd like to avoid having my desktop machine on all the time.

Back to top Profile Email Website
Shashank Sharma
Joined Jan 01, 1970
Posts: 1536
Location:New Delhi, India

Other Topics
Posted: Feb 05, 2008 3:00:46 PM
Subject: What program can I use to monitor web pages for changes?

I don't know of any program, but there is a service called http://www.watchthatpage.com/

Also, there's a WEbmon port for Linux: http://sniperbeamer.de/webmonx/

Cheers!

Coauthor of Beginning Fedora: From Novice to Professional published by Apress.

Please follow the Forum Guidelines

Back to top Profile Email Website Yahoo!
techbrain55
Joined Feb 15, 2008
Posts: 4

Other Topics
Posted: Feb 15, 2008 10:04:36 AM
Subject: What program can I use to monitor web pages for changes?

A lot of these sort of website now use something called syndication usually through RSS feeds. Mozilla already supports these and Internet Explorer 7 does as well. I think an open source project named paragent can help you a lot with alerts

Regards,
techbrain

Back to top Profile Email Website
netcat
Joined Mar 26, 2008
Posts: 24

Other Topics
Posted: Mar 26, 2008 10:26:53 AM
Subject: What program can I use to monitor web pages for changes?

Try Specto [http://specto.sourceforge.net] . Its a desktop application like Webmon

Back to top Profile Email Website
Brett H.
Joined Mar 26, 2008
Posts: 1

Other Topics
Posted: Mar 26, 2008 2:28:46 PM
Subject: What program can I use to monitor web pages for changes?

From Linux.com there is Specto. Haven't used it, but will in about 15 minutes.

http://www.linux.com/feature/128855

Back to top Profile Email Website
Anonymous
Other Topics
Posted: Mar 26, 2008 8:22:24 PM
Subject: What program can I use to monitor web pages for changes?

Firefox does RSS feeds too
[Modified by: author on March 26, 2008 08:23 PM]

Back to top
Mat Kovach
Joined Jan 01, 1970
Posts: 1

Other Topics
Posted: Apr 02, 2008 9:25:59 PM
Subject: What program can I use to monitor web pages for changes?

Quote maven:
I need a program or script to monitor a list of web pages and alert me (via email or RSS) when specified parts of any of the pages change. I'd like to run it on a shared web hosting account, so PHP, Python, etc. would be nice. I've used Webmon in the past, but it doesn't do email or RSS alerts and it's Windows only. I'd like to avoid having my desktop machine on all the time.

Uptime http://uptime.openacs.org does not have RSS feeds, but it is Open Source so you should be able to find somebody to add it.

Back to top Profile Email
Horizon
Joined Apr 02, 2008
Posts: 5
Location:Omaha, NE

Other Topics
Posted: Apr 02, 2008 11:38:09 PM
Subject: What program can I use to monitor web pages for changes?

I haven't looked into the other options here, but I hacked this script up for you. :) It will either display xhtml 1.0 strict compliant output, rss2 complaint output, or it will email you with a list of changes.

It's just a dirty hack right now, I'll clean it up as I've got time, but I've tested it out and it seems to be working right. You can see the main file at http://scriptsamurai.com/projects/changemon/index.phps - it uses a text file to contain the site information, and you'll need to set it up. The format is http://siteurl.com::x for every site you want to monitor. Make sure there's no newline character at the end of the file. The "x" will get replaced with an MD5 hash the next time it gets run.

Good luck! Let me know if you've got any problems with it, and any feedback is appreciated.

Edit: Just as a note, even though it's a .php extension file, most modern feed readers should let you subscribe to it - I've tested it with Liferea and it ought to work with Firefox's live bookmarks, too, but I've not tested that. Then whenever your feed reader updates, the script'll run and generate new RSS content if anything has changed.

To use the mail setup, what I'd probably do is set up a cron job to call php from the command line and log it to a file, something like '/usr/bin/php changemon.php > changemon.log' ought to work. In mail output mode the only thing that gets output is either a fail or success message, so you could just not log it, if you're not concerned with it.

And the html setting will spit out a full XHTML1.0 strict page, so it's pretty bare, but if you wanted to do that and set it as your homepage or something, I suppose you could. When I've got more time I'll clean it up and make it a deal more customizable, but I got out of classes an hour and a half early or so today so I figured I'd throw at least something up. :)

[Modified by: Horizon on April 02, 2008 11:49 PM]

Back to top Profile Email Website MSN AOL Instant Messenger
Shashank Sharma
Joined Jan 01, 1970
Posts: 1536
Location:New Delhi, India

Other Topics
Posted: Apr 04, 2008 11:06:33 AM
Subject: What program can I use to monitor web pages for changes?

I'm actually quite fond of Specto. I wrote that article on Linux.com (insert sheepish smile).
http://www.linux.com/feature/128855

Coauthor of Beginning Fedora: From Novice to Professional published by Apress.

Please follow the Forum Guidelines

Back to top Profile Email Website Yahoo!
Horizon
Joined Apr 02, 2008
Posts: 5
Location:Omaha, NE

Other Topics
Posted: Apr 04, 2008 3:16:48 PM
Subject: What program can I use to monitor web pages for changes?

Yeah, Specto's a nice app, but unfortunately the solutions posted - Webmon, Specto, etc - don't quite do what maven wants, as far as I can tell. Maven need's a way to watch pages for changes without leaving a desktop machine on all the time, something that could be run off shared hosting.

The script I posted will watch sites for changes, send email or generate an rss feed, and can be run off any host that has PHP5/Curl support. No word back if it's what they're looking for though.

Back to top Profile Email Website MSN AOL Instant Messenger
Tableless layout Validate XHTML 1.0 Strict Validate CSS Powered by Xaraya