Main Area and Open Discussion > General Software Discussion

Parallel proxy transfer software

<< < (4/4)

electronixtar:
the client probably isn't a standard web browser
-f0dder (December 21, 2009, 04:19 PM)
--- End quote ---

yes there should also be a standard http proxy server on the client side for browsers.

Traditional way:


--- ---HTTP resources -> prefetch server   ->  client -> browser
Parallel transfer:


--- ---HTTP resources -> prefetch server ====> client -> local http server -> browser
The question I am asking is

Are there any software (client-server pair) has this ====> feature.

f0dder:
are there any software that can do the ====> part.-electronixtar (December 21, 2009, 05:31 PM)
--- End quote ---
Dunno - that would pretty much depend on the client in your diagram :) - and the local http server as well.

As stated before, you aren't going to find software that can perform magic and parallelize stuff without support from it's endpoints... and you provide very little information on goals and involved software, so it's hard to give any concrete recommendations.

So, what's the deal? Is this understanding correct?

1) high-speed server preFETCHes HTTP resources
2) server PUSHes those resources to "client" machine
3) "client" machine runs a http proxy, and web browser on "client" machine access that local proxy

...and you want the PUSH to be faster than it currently is, and you don't want to wait for entire FETCH to be done before you PUSH?

electronixtar:
are there any software that can do the ====> part.-electronixtar (December 21, 2009, 05:31 PM)
--- End quote ---
Dunno - that would pretty much depend on the client in your diagram :) - and the local http server as well.

As stated before, you aren't going to find software that can perform magic and parallelize stuff without support from it's endpoints... and you provide very little information on goals and involved software, so it's hard to give any concrete recommendations.

So, what's the deal? Is this understanding correct?

1) high-speed server preFETCHes HTTP resources
2) server PUSHes those resources to "client" machine
3) "client" machine runs a http proxy, and web browser on "client" machine access that local proxy

...and you want the PUSH to be faster than it currently is, and you don't want to wait for entire FETCH to be done before you PUSH?
-f0dder (December 21, 2009, 05:42 PM)
--- End quote ---

Thanks for the pentiance, man.

Push or fetch doesn't matter, I just need some client-server softwarekit to replace the traditional standard HTTP proxy, which has a special mechanism to make transfer faster. By parallelly or by magic.

I knew there's space for speed up, because I can download from that remote proxy server in high speed (by using multithreaded download tools)

f0dder:
Well, assuming you're using a browser to interface with the proxy, have you tried tweaking browser settings? For instance, disables HTTP pipelining when it can see it's dealing with a proxy server...

Apart from that, it's still hard to say much else - there's unfortunately no such thing as magic in computer software. How to speed things up depends on the rest of the software... you might be able to use a different proxy software (or not, depending on how it interfaces with the prefetching). Perhaps client actions can be anticipated and acted on, perhaps not. It also depends on whether you're going to transfer a few big files, or a lot of small ones.. there's lots and lots of parameters :)

electronixtar:
Well, assuming you're using a browser to interface with the proxy, have you tried tweaking browser settings? For instance, disables HTTP pipelining when it can see it's dealing with a proxy server...

Apart from that, it's still hard to say much else - there's unfortunately no such thing as magic in computer software. How to speed things up depends on the rest of the software... you might be able to use a different proxy software (or not, depending on how it interfaces with the prefetching). Perhaps client actions can be anticipated and acted on, perhaps not. It also depends on whether you're going to transfer a few big files, or a lot of small ones.. there's lots and lots of parameters :)
-f0dder (December 21, 2009, 06:21 PM)
--- End quote ---

tweaking solves edge problem, not the main problem. What I need is a general pupose proxy toolkit to speed things up.

Still, thanks a lot man.

If you knew any stuff like this invented in the future, please inform me  ;D

Navigation

[0] Message Index

[*] Previous page