View download traffic grouped by site...

ATTENTION: You are viewing a page formatted for mobile devices; to view the full web page, click HERE.

Main Area and Open Discussion > General Software Discussion

(1/2) > >>

manimatters:
Hey guys, im looking for a software which can keep track of my downloaded data volume grouped by the site address. I know its kind of specific, but i think there might be utilities out there that can have the capability.
I love the Opera status bar, which shows the amount of data downloaded on a particular site while opening the page, it would be perfect if it could save that data, and compile it so that the user can see the trends in his surfing habits. Any pointers in this direction?..

steeladept:
I can't point you to anything, but it sounds like a GREAT Firefox plugin. Perhaps someone there has already made something like this? For Opera, on the other hand, I can't imagine where to start looking since they don't have a plugin architecture.

Shades:
If you have a Linux router, you could install a package like Squid that records the traffic and then a package called Sarg which creates webpages showing all sites that are opened on a daily, weekly an monthly basis, including all the files that are downloaded. Very handy indeed.

manimatters:
I can't point you to anything, but it sounds like a GREAT Firefox plugin. Perhaps someone there has already made something like this? For Opera, on the other hand, I can't imagine where to start looking since they don't have a plugin architecture.
-steeladept (April 03, 2008, 12:54 PM)
--- End quote ---
I wonder if there is a software that records your surfing habits globally(independent of browser). Ive seen network monitors tell me the address of the location from where data is being downloaded, but now I cant remember which ones had that capability. All that is needed then is to record that data and compile it.

Carol Haynes:
System Explorer (http://systemexplorer.mistergroup.org/) is free and can log all sorts of stuff on your system including system traffic.

I'm not sure how big the log files will get but I'd guess you could write a script to process the output into the sort of thing you need.

For example here is a short log created on my network connections whilst running uTorrent to download a couple of files:

List: History
Created : 04/04/2008 11:14:53

Time | Type | Value |
11:14:52 | Net | Del lairdswood:2868 SYN_SENT PID=TCP/IP "2676" |
11:14:52 | Net | New 192.168.0.151:12345 SYN_RCVD PID=TCP/IP "2676" |
11:14:51 | Net | Del lairdswood:2862 ESTABLISHED PID=TCP/IP "2676" |
11:14:51 | Net | New 192.168.0.151:2868 SYN_SENT PID=TCP/IP "2676" |
11:14:51 | Net | New 192.168.0.151:2867 ESTABLISHED PID=TCP/IP "2676" |
11:14:50 | Net | Del lairdswood:12345 FIN_WAIT1 PID=TCP/IP "2676" |
11:14:50 | Net | Del lairdswood:2860 SYN_SENT PID=TCP/IP "2676" |
11:14:50 | Net | Del lairdswood:2859 SYN_SENT PID=TCP/IP "2676" |
11:14:49 | Net | Del lairdswood:12345 FIN_WAIT2 PID=TCP/IP "2676" |
11:14:49 | Net | Del lairdswood:12345 FIN_WAIT1 PID=TCP/IP "2676" |
11:14:49 | Net | Del lairdswood:2772 FIN_WAIT1 PID=TCP/IP "2676" |
11:14:49 | Net | Del lairdswood:12345 FIN_WAIT1 PID=TCP/IP "2676" |
11:14:49 | Net | Del lairdswood:12345 FIN_WAIT2 PID=TCP/IP "2676" |
11:14:49 | Net | Del lairdswood:2769 FIN_WAIT1 PID=TCP/IP "2676" |
11:14:49 | Net | New 192.168.0.151:2862 ESTABLISHED PID=TCP/IP "2676" |
11:14:49 | Net | New 192.168.0.151:2859 SYN_SENT PID=TCP/IP "2676" |
11:14:49 | Net | New 192.168.0.151:2866 SYN_SENT PID=TCP/IP "2676" |
11:14:49 | Net | New 192.168.0.151:2861 SYN_SENT PID=TCP/IP "2676" |
11:14:49 | Net | New 192.168.0.151:2865 ESTABLISHED PID=TCP/IP "2676" |
11:14:49 | Net | New 192.168.0.151:2863 SYN_SENT PID=TCP/IP "2676" |
11:14:49 | Net | New 192.168.0.151:2864 SYN_SENT PID=TCP/IP "2676" |
11:14:49 | Net | New 192.168.0.151:2860 SYN_SENT PID=TCP/IP "2676" |
11:14:48 | Net | Del lairdswood:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:48 | Net | Del lairdswood:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:48 | Net | Del lairdswood:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:43 | Net | Del lairdswood:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:42 | Net | Del lairdswood:2809 ESTABLISHED PID=TCP/IP "2676" |
11:14:42 | Net | Del lairdswood:12345 LAST_ACK PID=TCP/IP "2676" |
11:14:42 | Net | New 192.168.0.151:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:33 | Net | New 192.168.0.151:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:31 | Net | New 192.168.0.151:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:30 | Net | New 192.168.0.151:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:25 | Net | New 192.168.0.151:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:24 | Net | New 192.168.0.151:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:21 | Net | Del lairdswood:2755 CLOSE_WAIT PID=TCP/IP "2676" |
11:14:21 | Net | Del lairdswood:2760 CLOSE_WAIT PID=TCP/IP "2676" |
11:14:21 | Net | Del lairdswood:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:20 | Net | Del lairdswood:12345 FIN_WAIT1 PID=TCP/IP "2676" |
11:14:19 | Net | New 192.168.0.151:12345 SYN_RCVD PID=TCP/IP "2676" |
11:14:14 | Net | New 192.168.0.151:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:13 | Net | Del localhost:1101 FIN_WAIT2 PID=TCP/IP "1912" |
11:14:13 | Net | Del localhost:2840 CLOSE_WAIT PID=TCP/IP "4768" |
11:14:13 | Net | Del localhost:2846 CLOSE_WAIT PID=TCP/IP "4768" |
11:14:13 | Net | Del localhost:1101 FIN_WAIT2 PID=TCP/IP "1912" |
11:14:13 | Net | Del localhost:1102 FIN_WAIT2 PID=TCP/IP "1912" |
11:14:13 | Net | Del localhost:2849 CLOSE_WAIT PID=TCP/IP "4768" |
11:14:13 | Net | Del localhost:1103 FIN_WAIT2 PID=TCP/IP "1912" |
11:14:13 | Net | Del localhost:2850 CLOSE_WAIT PID=TCP/IP "4768" |
11:14:09 | Net | New 192.168.0.151:12345 SYN_RCVD PID=TCP/IP "2676" |
11:14:08 | Net | New 192.168.0.151:12345 ESTABLISHED PID=TCP/IP "2676" |
11:14:07 | Net | Del lairdswood:2852 ESTABLISHED PID=TCP/IP "1912" |
11:14:07 | Net | Del lairdswood:2853 ESTABLISHED PID=TCP/IP "1912" |
11:14:06 | Net | Del lairdswood:2858 LAST_ACK PID=TCP/IP "3180" |
11:14:05 | Net | Del lairdswood:2855 SYN_SENT PID=TCP/IP "2676" |
11:14:05 | Net | New 192.168.0.151:2858 LAST_ACK PID=TCP/IP "3180" |
11:14:04 | Net | Del lairdswood:2842 ESTABLISHED PID=TCP/IP "1912" |
11:14:04 | Net | Del lairdswood:2847 ESTABLISHED PID=TCP/IP "1912" |
11:14:00 | Net | Del lairdswood:2857 SYN_SENT PID=TCP/IP "2676" |
11:13:57 | Net | Del lairdswood:2838 SYN_SENT PID=TCP/IP "2676" |
11:13:57 | Net | Del lairdswood:2839 SYN_SENT PID=TCP/IP "2676" |
11:13:57 | Net | Del lairdswood:2835 SYN_SENT PID=TCP/IP "2676" |
11:13:57 | Net | Del lairdswood:2837 SYN_SENT PID=TCP/IP "2676" |
11:13:57 | Net | New 192.168.0.151:2854 ESTABLISHED PID=TCP/IP "2676" |
11:13:57 | Net | New 192.168.0.151:2856 ESTABLISHED PID=TCP/IP "2676" |
11:13:57 | Net | New 192.168.0.151:2855 SYN_SENT PID=TCP/IP "2676" |
11:13:57 | Net | New 192.168.0.151:2857 SYN_SENT PID=TCP/IP "2676" |
11:13:54 | Net | Del localhost:1101 ESTABLISHED PID=TCP/IP "1912" |
11:13:54 | Net | Del localhost:2844 ESTABLISHED PID=TCP/IP "4768" |
11:13:54 | Net | Del lairdswood:2845 ESTABLISHED PID=TCP/IP "1912" |
11:13:54 | Net | New 192.168.0.151:2851 ESTABLISHED PID=TCP/IP "1912" |
11:13:54 | Net | New 192.168.0.151:2853 ESTABLISHED PID=TCP/IP "1912" |
11:13:54 | Net | New 127.0.0.1:2850 ESTABLISHED PID=TCP/IP "4768" |
11:13:54 | Net | New 127.0.0.1:1103 ESTABLISHED PID=TCP/IP "1912" |
11:13:54 | Net | New 192.168.0.151:2852 ESTABLISHED PID=TCP/IP "1912" |
11:13:54 | Net | New 127.0.0.1:2849 ESTABLISHED PID=TCP/IP "4768" |
11:13:54 | Net | New 127.0.0.1:1102 ESTABLISHED PID=TCP/IP "1912" |
11:13:54 | Net | New 127.0.0.1:1101 ESTABLISHED PID=TCP/IP "1912" |
11:13:54 | Net | New 127.0.0.1:2848 ESTABLISHED PID=TCP/IP "4768" |
11:13:53 | Net | Del localhost:2841 ESTABLISHED PID=TCP/IP "4768" |
11:13:53 | Net | Del localhost:1102 ESTABLISHED PID=TCP/IP "1912" |
11:13:53 | Net | Del lairdswood:2843 ESTABLISHED PID=TCP/IP "1912" |
11:13:53 | Net | New 192.168.0.151:2847 SYN_SENT PID=TCP/IP "1912" |
11:13:53 | Net | New 127.0.0.1:1101 ESTABLISHED PID=TCP/IP "1912" |
11:13:53 | Net | New 127.0.0.1:2846 ESTABLISHED PID=TCP/IP "4768" |
11:13:52 | Net | New 192.168.0.151:2845 ESTABLISHED PID=TCP/IP "1912" |
11:13:52 | Net | New 127.0.0.1:2844 ESTABLISHED PID=TCP/IP "4768" |
11:13:52 | Net | New 127.0.0.1:1101 ESTABLISHED PID=TCP/IP "1912" |
11:13:51 | Net | New 192.168.0.151:2843 ESTABLISHED PID=TCP/IP "1912" |
11:13:51 | Net | New 127.0.0.1:1102 ESTABLISHED PID=TCP/IP "1912" |
11:13:51 | Net | New 127.0.0.1:2841 ESTABLISHED PID=TCP/IP "4768" |
11:13:51 | Net | New 192.168.0.151:2842 ESTABLISHED PID=TCP/IP "1912" |
11:13:51 | Net | New 127.0.0.1:2840 ESTABLISHED PID=TCP/IP "4768" |
11:13:51 | Net | New 127.0.0.1:1101 ESTABLISHED PID=TCP/IP "1912" |
11:13:50 | Net | New 192.168.0.151:2836 ESTABLISHED PID=TCP/IP "2676" |
11:13:50 | Net | New 192.168.0.151:2837 SYN_SENT PID=TCP/IP "2676" |
11:13:50 | Net | New 192.168.0.151:2835 SYN_SENT PID=TCP/IP "2676" |
11:13:50 | Net | New 192.168.0.151:2839 SYN_SENT PID=TCP/IP "2676" |
11:13:50 | Net | New 192.168.0.151:2838 SYN_SENT PID=TCP/IP "2676" |
11:13:49 | Net | Del lairdswood:12345 ESTABLISHED PID=TCP/IP "2676" |
11:13:49 | Net | Del lairdswood:12345 ESTABLISHED PID=TCP/IP "2676" |
11:13:49 | Net | Del lairdswood:12345 ESTABLISHED PID=TCP/IP "2676" |
11:13:46 | Net | Del lairdswood:2700 LAST_ACK PID=TCP/IP "2676" |
11:13:46 | Net | New 192.168.0.151:2833 ESTABLISHED PID=TCP/IP "2676" |
11:13:43 | Net | Del lairdswood:2571 ESTABLISHED PID=TCP/IP "1912" |
11:13:43 | Net | Del localhost:2570 ESTABLISHED PID=TCP/IP "4768" |
11:13:43 | Net | Del localhost:1101 ESTABLISHED PID=TCP/IP "1912" |
11:13:40 | Net | Del lairdswood:2831 SYN_SENT PID=TCP/IP "2676" |
11:13:40 | Net | Del lairdswood:2830 SYN_SENT PID=TCP/IP "2676" |
11:13:40 | Net | New 192.168.0.151:12345 ESTABLISHED PID=TCP/IP "2676" |
11:13:39 | Net | Del lairdswood:12345 ESTABLISHED PID=TCP/IP "2676" |
11:13:39 | Net | New 192.168.0.151:2830 SYN_SENT PID=TCP/IP "2676" |
11:13:39 | Net | New 192.168.0.151:2831 SYN_SENT PID=TCP/IP "2676" |
11:13:37 | Net | Del lairdswood:12345 ESTABLISHED PID=TCP/IP "2676" |
11:13:37 | Net | Del lairdswood:2764 ESTABLISHED PID=TCP/IP "2676" |
11:13:33 | Net | Del lairdswood:12345 CLOSE_WAIT PID=TCP/IP "2676" |
11:13:26 | Net | New 192.168.0.151:12345 ESTABLISHED PID=TCP/IP "2676" |
11:13:20 | Net | Del lairdswood:12345 ESTABLISHED PID=TCP/IP "2676" |
11:13:19 | Net | New 192.168.0.151:12345 ESTABLISHED PID=TCP/IP "2676" |

--- End quote ---

The only problem is that it doesn't seem to show the IPs or URLs connected to though you might be able to persuade the developer to add the feature - he seems very open to ideas.

Navigation

[0] Message Index

[#] Next page

Go to full version