Proxy support for testing and fuzzing stages

[harshkolhatkar]

Hey all, not sure if I missed it but wanted to know if it's possible to configure a http/s proxy for Testing and Fuzzing phases. It's needed because the token logic for APIs that I'm trying to fuzz is a bit different than a traditional token. My mitmproxy does that when it receives the request and forwards it to the target.

[nmaiti]

I also not able to run restler behind proxy. Working fine in non proxied environments. Is it not supported yet? or I am missing some configuration?
My environments have $http(s)_proxy / $HTTP(S)_PROXY all set.

Can anybody please confirm if it's workable behind proxy?

[agustinfrancesa]

Hi, I have the same issue :(

[fabpiaf]

I worked around that problem via monkey patching as I had no time to implement a sufficient solution:
adapt the HttpSock class (engine/engine/transport_layer/messaging.py) as follows (sorry, I checked out the http2-pull request):

import socks                                                                                                                                                                                                                                   
import os                                                                                                                                                                                                                                      
                                                                                                                                                                                                                                               
                                                                                                                                                                                                                                               
if util.find_spec("test_servers"):                                                                                                                                                                                                             
    from test_servers.test_socket import TestSocket                                                                                                                                                                                            
                                                                                                                                                                                                                                               
DELIM = "\r\n\r\n"                                                                                                                                                                                                                             
UTF8 = 'utf-8'                                                                                                                                                                                                                                 
                                                                                                                                                                                                                                               
class HttpSock(object):                                                                                                                                                                                                                        
    __last_request_sent_time = time.time()                                                                                                                                                                                                     
    __request_sem = threading.Semaphore()                                                                                                                                                                                                      
                                                                                                                                                                                                                                               
    def __init__(self, connection_settings):                                                                                                                                                                                                   
        proxy=os.environ.get('RESTLER_PROXY')                                                                                                                                                                                                  
        if proxy:                                                                                                                                                                                                                              
            print(f'proxy {proxy}')                                                                                                                                                                                                            
            import re                                                                                                                                                                                                                          
            pptype,username,password,addr,port=re.search('(?:([^:]+)://)?(?:([^:]+)(?::([^:]+)?)?@)?([^:]+)(?::(\d{1,5}))?', proxy, re.IGNORECASE).groups()                                                                                    
            ptypes={                                                                                                                                                                                                                           
                "http":socks.HTTP,                                                                                                                                                                                                             
                "socks4":socks.SOCKS4,                                                                                                                                                                                                         
                "socks5":socks.SOCKS5,                                                                                                                                                                                                         
            }                                                                                                                                                                                                                                  
            ptype=ptypes.get(pptype,socks.HTTP)                                                                                                                                                                                                
            port=int(port)                                                                                                                                                                                                                     
            print(f'proxy {ptype} {addr} {port}')                                                                                                                                                                                              
            socks.set_default_proxy(proxy_type=ptype, addr=addr, port=port, rdns=True, username=username, password=password)                                                                                                                   
            socket.socket = socks.socksocket
        if Settings().use_http2:                                                                                                                                                                                                               
            self._subject = Http20Sock(connection_settings)                                                                                                                                                                                    
        else:                                                                                                                                                                                                                                  
            self._subject = Http11Sock(connection_settings)

afterwards use it e.g. via:

RESTLER_PROXY=localhost:8888 restler-fuzzer/restler_bin/restler/Restler

[fabpiaf]

feel free to commit to #875