|
phitsc
|
 |
« on: December 11, 2009, 09:51:25 AM » |
|
DescriptionFarrWebMetaSearch is another generic web retrieval FARR plugin. Unlike ewemoas Webgrab this plugin will show results in list mode. It is therefore targeted at web sites delivering list-like results. Configuration and usage of the plugin will be as follows: - searches are configured via a text configuration file, one for each 'search'. the file will specify search url and a regular expression to capture the result.
- search terms will be specified through the FARR input box
See implementation notes further down for further clarification. FeaturesIt just does what it says in the description. Planned Features- Fix icon copyright problem
- Fix launching problem
- Add proper help file
- Add a way for users to contribute / get searches
- Add logging/notification in case a configuration files is invalid
- Improve usage for news feeds
- Make original search string available as a variable
- Add many more searches
 Either make plugin asynchronious or implement some way to delay searchingAdd a description for each search to xml files and FARR searches listImplement filtering of searchesImplement auto-completion of searches with Enter key (well, maybe)Add a way to specify search options (for web sites that support it)Make parsing of searches files more robust
ScreencastScreenshots | FarrWebMetaSearch | Web Site | | MSDN |  |  | | CDDB |  |  |
and a teaser screencast. Implementation NotesFarrWebMetaSearch reads all configuration files in its searches subdirectory when it's being loaded. When the plugin alias (currently wms) is entered, it will list all configured searches. To use a search one would then enter, e.g.: wms msdn PathAppendto find MSDN entries for the PathAppend API function. Search files currently look like this (this is the cddb.conf file):
description=Microsoft Developer Network
searchUrl=http://social.msdn.microsoft.com/Search/en-GB?query=
resultPattern=<a onmousedown=\".*\" href=\".*\">(.*)</a>\r\n<br/>\r\n<div class=\"ResultDescription\">(.*)</div>\r\n<div class=\"ResultUrl\">(.*)</div>
farrCaption=$1
farrGroup=$2
farrPath=$3
The regex sub-expressions can (should, actually) be used to form the results.
|
|
|
|
« Last Edit: January 08, 2010, 05:21:52 PM by phitsc »
|
Logged
|
|
|
|
|
|
|
phitsc
|
|
« Reply #2 on: December 13, 2009, 03:45:43 PM » |
|
I've added some screen shots.
|
|
|
|
|
Logged
|
|
|
|
|
|
mouser
|
|
« Reply #3 on: December 13, 2009, 03:51:44 PM » |
|
whoa now this is looking good.
|
|
|
|
|
Logged
|
|
|
|
|
phitsc
|
|
« Reply #4 on: December 13, 2009, 04:52:18 PM » |
|
updated implementation notes and added a todo list
|
|
|
|
|
Logged
|
|
|
|
|
mouser
|
|
« Reply #5 on: December 13, 2009, 07:06:44 PM » |
|
it doesnt show results live as we type does it?
|
|
|
|
|
Logged
|
|
|
|
|
phitsc
|
|
« Reply #6 on: December 14, 2009, 02:42:54 AM » |
|
it doesnt show results live as we type does it?
It's meant to. But fetching something from the web obviously takes time. So currently the plugin is best suited to touch typists  |
|
|
|
|
Logged
|
|
|
|
|
mouser
|
|
« Reply #7 on: December 14, 2009, 02:56:18 AM » |
|
|
|
|
|
|
Logged
|
|
|
|
|
CWuestefeld
|
|
« Reply #8 on: December 15, 2009, 11:30:28 AM » |
|
Cool.
Request: put in a search file for IMDB.
|
|
|
|
|
Logged
|
|
|
|
|
phitsc
|
|
« Reply #9 on: December 15, 2009, 03:27:21 PM » |
|
I've implemented the most important features now, especially asynchronious searching. I'm going to try and add some more searches now with focus on stability. I'm going to start with IMDB then.
|
|
|
|
|
Logged
|
|
|
|
|
mouser
|
|
« Reply #10 on: December 15, 2009, 04:06:56 PM » |
|
|
|
|
|
|
Logged
|
|
|
|
|
TucknDar
|
|
« Reply #11 on: December 15, 2009, 04:14:58 PM » |
|
Really looking forward to this one, looks incredibly useful!  Amazon, play.com, eBay, yellow pages... |
|
|
|
|
Logged
|
|
|
|
|
mouser
|
|
« Reply #12 on: December 15, 2009, 05:02:16 PM » |
|
ebay and amazon, that's like the holy grail of instant search  |
|
|
|
|
Logged
|
|
|
|
|
phitsc
|
|
« Reply #13 on: December 16, 2009, 02:49:33 AM » |
|
Amazon will be next on my list. I've ordered myself a Kindle for Christmas |
|
|
|
|
Logged
|
|
|
|
|
phitsc
|
|
« Reply #14 on: December 17, 2009, 02:10:51 PM » |
|
I've changed the configuration files from xml to ini-style (see implementation notes in first post). Makes it much easier to handle the (already complex) regular expressions, as you don't have to encode < and > etc.. And then xml would be overkill for this anyway.
Capturing IMDB's output turned out to be a hard nut to crack. I'm afraid I can't offer anything satisfactory.
|
|
|
|
|
Logged
|
|
|
|
|
mouser
|
|
« Reply #15 on: December 17, 2009, 03:07:19 PM » |
|
live search of some of the dictionary website would be awesome as well, while we are building a wishlist (since imdb is already supported as live search in google plus addon for farr it's not high on my priority list) |
|
|
|
|
Logged
|
|
|
|
|
Perry Mowbray
|
|
« Reply #16 on: December 17, 2009, 07:02:09 PM » |
|
Dictonary sites would have to be my most used |
|
|
|
|
Logged
|
|
|
|
|
TucknDar
|
|
« Reply #17 on: December 18, 2009, 01:51:22 AM » |
|
Dictonary sites would have to be my most used Actually, you missed an 'i' there, it's 'Dictionary'  |
|
|
|
|
Logged
|
|
|
|
|
Perry Mowbray
|
|
« Reply #18 on: December 18, 2009, 01:59:47 AM » |
|
Dictonary sites would have to be my most used Actually, you missed an 'i' there, it's 'Dictionary' Cool: you know I staired at it for ages but I couldn't see it!! I often don't have an eye for detal... |
|
|
|
|
Logged
|
|
|
|
|
TucknDar
|
|
« Reply #19 on: December 18, 2009, 02:02:57 AM » |
|
Dictonary sites would have to be my most used Actually, you missed an 'i' there, it's 'Dictionary' Cool: you know I staired at it for ages but I couldn't see it!! I often don't have an eye for detal...  |
|
|
|
|
Logged
|
|
|
|
|
cranioscopical
|
|
« Reply #20 on: December 18, 2009, 10:35:32 AM » |
|
I staired at it for ages but I couldn't see it!!
Tread softly or someone will try to take a riser out of you  |
|
|
|
|
Logged
|
Chris
|
|
|
|
|
|
TucknDar
|
|
« Reply #22 on: December 21, 2009, 02:26:38 PM » |
|
|
|
|
|
|
Logged
|
|
|
|
|
mouser
|
|
« Reply #23 on: December 21, 2009, 02:46:55 PM » |
|
|
|
|
|
|
Logged
|
|
|
|
|
phitsc
|
|
« Reply #24 on: December 23, 2009, 08:19:15 AM » |
|
just realised FarrWebMetaSearch could be (mis)used to read news feeds. because they are xml they are actually simpler to split up with regular expressions than 'normal' web pages. here's an example:
description=Tages Anzeiger Front
searchUrl=http://www.tagesanzeiger.ch/rss.html?
resultPattern=<item>\s*<id>\d*</id>\s*<title>(.*)</title>\s*<description><!\[CDATA\[(.*)\]\]></description>\s*<category>.*</category>\s*<link>(.*)</link>\s*<guid.*</guid>\s*<pubDate>(.*)</pubDate>\s*</item>
farrCaption=$1 ($4)
farrGroup=$2
farrPath=$3
will give you this:  |
|
|
|
|
Logged
|
|
|
|
|
