Messages - electronixtar [ switch to compact view ]

Pages: prev1 2 3 4 5 [6] 7 8 9 10 11 ... 29next
26
General Software Discussion / Re: Parallel proxy transfer software
« on: December 21, 2009, 12:10 AM »
The basic idea is, if the server need to send 1000 packets one by one serialized, why not send it parallelized.
Because it doesn't really matter if you have one data stream or fifty. The (ISP Controlled) connection speed (data) pipe is only as big as it is, and trying to force more through it will only cause a flood of retransmits (think turbulence) that will slow down the overall transfer speed.

I didn't mean to break the ISP pipe, but some connections are really slow, like 10KB/s compared to my total bandwidth (2M). It's better to open more channels for communication.

Third party download tools (like FreeDownloadManager) are invented for the exactly same reason. What I need is not downloading the whole file by splitting Content-Range, but to transfer packets x3 with three threads.

Just want to know if anything like this exists.

27
General Software Discussion / Re: Parallel proxy transfer software
« on: December 20, 2009, 06:12 PM »
First, at least if we're talking HTTP/FTP and not some custom protocol, the "multi" aspect is done by the client, not the server (or proxy server).

It's obvious not a conventional HTTP/FTP proxy server, it's some advanced stuff I hope someone already invented

Second, threading isn't necessary to do parallel transfers

OK, no more threading as long as you understand what I am trying to say, but threading is the only best way I can think of how to describe it :) ,

Third, if you have that tiny data amounts, doing parallel transfers is going to hurt your performance, not improve it, because of the way TCP works (starts out slow and gradually increases transfer window size).

Yes this kind of proxy is best done with UDP.

The basic idea is, if the server need to send 1000 packets one by one serialized, why not send it parallelized.

28
General Software Discussion / Parallel proxy transfer software
« on: December 20, 2009, 12:24 AM »
Hi DC,

I have a remote server as a reverse proxy/http proxy, it's kinda slow, I hope there's some kind of software to speed it up a little by doing parallel data transfer.

Does any software like this exist?

My ideal version:
1. The server prefetches 3KB of data
2. The server send to client 3KB of data, but open multithreaded transfer, with 1KB of data per thread
3. The client receives 1KBx3, and combine them to the original 3KB data

The latency is not important as long as the transfer rate is good.

29
General Software Discussion / Re: Text editor with filtering of lines
« on: November 28, 2009, 08:28 AM »
TextMate with console commands  ;D

30
General Software Discussion / Re: DNS logger & firewall for Win32
« on: November 25, 2009, 07:04 AM »
With your ISP screwing around with the DNS queries wouldn't it be better to run your own DNS server?

eg. Treewalk

It's slow and costs too much memory if you run long enough. Not worth it.
If they're tampering with the actual traffic on port 53, as opposed to just records from their own DNS servers (the impression I got), then you could probably prove it by using DNSSEC (will only work for certain TLDs though, .org is probably easiest).

Ehtyar.

DNSSec is cool, but not all of TLD have it.

Pages: prev1 2 3 4 5 [6] 7 8 9 10 11 ... 29next
Go to full version