This bundle will check a set of webpages every interval and index the result, time, size and optionally content and or crc of page(s). It's cool to do searches to see when your pages change, take long to load, or many other cool things.
ABOUT WEBPING BUNDLE
====================
This bundle will check a set of webpages every interval and index the result, time, size and optionally content and or crc of page(s).
To start:
Copy bundle into your etc/bundles directory
Modify the following arguements in urls.conf
For each url you wish to check, add a stanza like the following
mypage
url = http://www.mypage.com
timeout = 10
indexResults = false
userAgent = Mozilla/4.0
indexMD5 = false
indexResults = false
You can add as many pages above as you wish.
Make sure that each page has a unique name ex. mypage
If you index the Results, be careful the payload can be large.
If you have bugs or suggestions please let me know. erik@splunk.com.
Good luck!
e
TODO:
============
- add in the filtering and matching from the imap bundle so you can filter content
- add back in the n level crawling
- add support for auth/login
Most of the applications and content on Splunkbase are submitted by parties other than us. That third-party content is the sole responsibility of the originator of that content. We are not responsible for any third-party content, whether or not we reviewed or moderated such content. You agree that you bear all risks ass ociated with using or relying on applications and content on Splunkbase. We do not in any way warrant the accuracy, reliability, completeness, usefulness, non-infringement, or quality of any applications or content on Splunkbase, regardless of who originated that content (including our employees, partners, affiliates or moderators), and even if an application is designated as "certified". We hereby disclaim all warranties, including but not limited to any implied warranties of merchantability or fitness for a particular purpose, relating to such applications or content. We shall not be liable or responsible in any way for any losses or damage of any kind, including lost profits or other indirect or consequential damages, relating to your use of or reliance upon any applications or content on Splunkbase.