My suggestion would be to have an additional column which could be displayed instead of the score column (i.e. the user would have to choose between the two). That column should be accessible for plugin writers as suggested in
this thread. For the plugin I'm working on right now (a Windows Search plugin) I would use it to show additional information (file size, time last modified, etc.).
