Web Crawler

RSS is great technology, but one of its shortcomings is that it doesn't always represent all of a site's content stream. Many times there are parts of a news or content site that change either through an editorial hand, or with items chosen by users. A new Firefox add-on called AlertBox helps track these "scraps" of content, and can be used to keep an eye out for any changes. This includes things like price changes, edits or updates to a news story, and the top stories on content sites.

To make sure it's not looking for activity on an entire Web page, AlertBox is designed to let you grab bits and pieces of any site--not the entire thing. Once installed, you can summon it by clicking the little bell shape in the bottom corner of the browser, or using a keyboard combination. It then pops up with a selection screen that, similar to Apple's Web clips widget, lets you pick what part of the page you want it to track. You can then choose how often you want it to check for future changes in increments of two minutes, up to one day.

The AlertBox in-box lets you keep track of all your alerts, and delete ones you no longer use.

(Credit: CNET)

AlertBox's way of tracking new content is an in-box-style counter down in the bottom of your browser. When clicked, it takes you to a page of Web clippings that are constantly updated with whatever the latest text is of the page elements you had selected. To be honest, this part of the add-on could use a little work, as it's just a text rip that loses all of the formatting on the page. And all of these alerts are housed not in the cloud, but on your local machine, which has two big downsides: One is that you need to have Firefox going at all times for it to alert you. The other is that you can only access those alerts on that particular machine.

Faults aside, I really like the idea of creating a simple in-box of changing content that does not rely on RSS. I think this, with a little bit of archiving to let you track changes in content throughout the day (like Web archiving service Iterasi does), would make for a very useful alternative to widget start pages and feed readers.

AlertBox lets you choose particular sections of a site to keep an eye on for updates.

(Credit: CNET)

Here's a must-have Firefox add-on. Called Multi Links, this extension lets you simply right click and drag your mouse across the screen to select multiple links at once. It's just like selecting multiple files on your computer, and highly effective for tearing through a page of links you want to look at or save for later.

By default, selected links open up in new browser tabs, although you can go into the options to choose whether you want them to open up in new windows, or be bookmarked instead. You're also able to change the color scheme of the box, and the outlines of the selected links--just in case you're into that sort of thing.

Want to open up multiple URLs? Just drag your mouse over them with this handy extension.

(Credit: CNET)

Advanced users can utilize keyboard shortcuts to limit mouse work. For instance, holding down the control or shift button while creating a box means you can hop around a page of results--selecting the items you want to open or save, while skipping over others. The extension is also coded to ignore extra links on search pages, which keeps you from unintentionally opening up the cached and similar links on each result. This worked fine on Google and Bing, but not on Yahoo or Ask.

This extension is definitely worth keeping around because it does not interfere with normal, right-click behavior. My one hope is that future versions will forgo the options menu in place of a small pop-up, or slide-out menu that asks what you want to do with links after selecting them.

See also: Snap Links (which does the same thing, but has not been updated since February) and Selection Links.

If you're the type of person who uses a lot of search engines and doesn't mind having a toolbar installed, you might want to check out Firefox Super Search. This Firefox-only add-on puts the power of 160 search engines in one toolbar, with about 70 that can be searched right from the toolbar itself.

If you're used to Firefox's built-in search box, this is a pretty big step up both from selecting one engine at a time and having to add additional engine tools from Mozilla's catalog. It's also laid out in a really straightforward manner, putting search engines with which you can search (from within the toolbar) in drop-down menus on the right side of the query box. There's also a directory of the other 90 or so engines that require a visit before beginning a new search.

Super Search is set up to let you search from nearly 70 search engines right from the blue options on the right of the search box. And the green button on the left is a directory of ones where you have to begin the search from that particular site. (Note, this screenshot has been edited to show off all of the toolbar's features at once).

(Credit: CNET)

My only qualm is that you cannot reorganize the order of the engines or make a shortlist of your favorites. It's also missing out on modern search box niceties like auto-complete and search-as-you-type suggestions--two things that require the search box to know which engine you're searching with first. On the plus side, though, the curation and organization of the engines is spot-on.

Note: This add-on is experimental, which means that it may not work perfectly in your browser. We used Super Search on Firefox version 3.5.1 without issues.

Mozilla has introduced a new pilot program for Firefox developers to make a little money off add-ons they've created. Developers now have the option to place a "contribution" button on their add-on page, which lets users donate any amount they wish via PayPal.

Contributions are optional, meaning users can continue to download and use add-ons without having to pay anything. Mozilla is also letting developers pick their own suggested price, although users can choose to pay whatever they wish.

For the pilot program, add-on creators get the entire amount of the contribution, minus PayPal's transaction fee. However, in the future that could change with Mozilla taking a small cut. Mozilla is also encouraging developers to set up special PayPal accounts for contributions under $12, since PayPal's fees are less if set up for micropayments.

Mozilla is running the pilot with a limited number of developers, and will likely open it up to all if it's a success. It's definitely a smart way to attract add-on developers to host their creations on Mozilla's site, since there's now a simpler way for them to get paid. However, it will be interesting to see if users are willing to part with their money when they don't really have to.

How much would you be willing to pay a developer for their add-on? Vote in the poll to the right.

Update: Here's an example of what it looks like live as seen on the Download Statusbar extension:

(Credit: CNET)