Main Area and Open Discussion > General Software Discussion
Parallel proxy transfer software
electronixtar:
Hi DC,
I have a remote server as a reverse proxy/http proxy, it's kinda slow, I hope there's some kind of software to speed it up a little by doing parallel data transfer.
Does any software like this exist?
My ideal version:
1. The server prefetches 3KB of data
2. The server send to client 3KB of data, but open multithreaded transfer, with 1KB of data per thread
3. The client receives 1KBx3, and combine them to the original 3KB data
The latency is not important as long as the transfer rate is good.
--- End quote ---
f0dder:
Hm, I think you'll have to describe what you're trying to attempt in more detail.
First, at least if we're talking HTTP/FTP and not some custom protocol, the "multi" aspect is done by the client, not the server (or proxy server).
Second, threading isn't necessary to do parallel transfers :)
Third, if you have that tiny data amounts, doing parallel transfers is going to hurt your performance, not improve it, because of the way TCP works (starts out slow and gradually increases transfer window size).
electronixtar:
First, at least if we're talking HTTP/FTP and not some custom protocol, the "multi" aspect is done by the client, not the server (or proxy server).
--- End quote ---
It's obvious not a conventional HTTP/FTP proxy server, it's some advanced stuff I hope someone already invented
Second, threading isn't necessary to do parallel transfers
--- End quote ---
OK, no more threading as long as you understand what I am trying to say, but threading is the only best way I can think of how to describe it :) ,
Third, if you have that tiny data amounts, doing parallel transfers is going to hurt your performance, not improve it, because of the way TCP works (starts out slow and gradually increases transfer window size).
--- End quote ---
Yes this kind of proxy is best done with UDP.
The basic idea is, if the server need to send 1000 packets one by one serialized, why not send it parallelized.
Stoic Joker:
The basic idea is, if the server need to send 1000 packets one by one serialized, why not send it parallelized.
-electronixtar (December 20, 2009, 06:12 PM)
--- End quote ---
Because it doesn't really matter if you have one data stream or fifty. The (ISP Controlled) connection speed (data) pipe is only as big as it is, and trying to force more through it will only cause a flood of retransmits (think turbulence) that will slow down the overall transfer speed.
electronixtar:
The basic idea is, if the server need to send 1000 packets one by one serialized, why not send it parallelized.
-electronixtar (December 20, 2009, 06:12 PM)
--- End quote ---
Because it doesn't really matter if you have one data stream or fifty. The (ISP Controlled) connection speed (data) pipe is only as big as it is, and trying to force more through it will only cause a flood of retransmits (think turbulence) that will slow down the overall transfer speed.
-Stoic Joker (December 20, 2009, 10:35 PM)
--- End quote ---
I didn't mean to break the ISP pipe, but some connections are really slow, like 10KB/s compared to my total bandwidth (2M). It's better to open more channels for communication.
Third party download tools (like FreeDownloadManager) are invented for the exactly same reason. What I need is not downloading the whole file by splitting Content-Range, but to transfer packets x3 with three threads.
Just want to know if anything like this exists.
Navigation
[0] Message Index
[#] Next page
Go to full version