jhao104/proxy_pool

执行调度程序python proxyPool.py schedule时报错

Open

#352 opened on Sep 18, 2019

View on GitHub
 (1 comment) (0 reactions) (0 assignees)Python (4,936 forks)batch import
help wanted

Repository metrics

Stars
 (20,037 stars)
PR merge metrics
 (Avg merge 55d 18h) (20 merged PRs in 30d)

Description


*** ______ ********************* ______ *********** _ ******** *** | ___ _ ******************** | ___ \ ********* | | ******** *** | |/ / _ __ __ _ __ _ | |/ /__ * ___ | | ******** *** | /| // _ \ \ / /| | | || __// _ \ / _ \ | | ******** *** | | | | | () | > < \ || || | | () | () || | **** *** _| || ___/ //_\ __ |_| _/ _/ ___/ **** **** __ / / ***** ************************* /_ / *******************************



2019-09-19 00:28:29,082 ProxyScheduler.py[line:33] INFO start fetch proxy 2019-09-19 00:28:29,083 ProxyManager.py[line:44] INFO ProxyFetch : start 2019-09-19 00:28:29,083 ProxyManager.py[line:46] INFO ProxyFetch - freeProxy01: start 2019-09-19 00:28:29,407 ProxyManager.py[line:61] INFO ProxyFetch - freeProxy01: 218.60.8.99:3129 success 2019-09-19 00:28:29,409 ProxyManager.py[line:65] ERROR ProxyFetch - freeProxy01: error 2019-09-19 00:28:29,409 ProxyManager.py[line:66] ERROR Error 61 connecting to 127.0.0.1:8000. Connection refused. 2019-09-19 00:28:29,409 ProxyManager.py[line:46] INFO ProxyFetch - freeProxy02: start SyntaxError: Unexpected token '<' 2019-09-19 00:28:29,703 ProxyManager.py[line:46] INFO ProxyFetch - freeProxy03: start 2019-09-19 00:28:30,429 ProxyManager.py[line:61] INFO ProxyFetch - freeProxy03: 222.189.244.2:9999 success 2019-09-19 00:28:30,432 ProxyManager.py[line:65] ERROR ProxyFetch - freeProxy03: error 2019-09-19 00:28:30,432 ProxyManager.py[line:66] ERROR Error 61 connecting to 127.0.0.1:8000. Connection refused. 2019-09-19 00:28:30,432 ProxyManager.py[line:46] INFO ProxyFetch - freeProxy04: start 2019-09-19 00:28:30,667 ProxyManager.py[line:61] INFO ProxyFetch - freeProxy04: 218.60.8.99:3129 success 2019-09-19 00:28:30,668 ProxyManager.py[line:65] ERROR ProxyFetch - freeProxy04: error 2019-09-19 00:28:30,668 ProxyManager.py[line:66] ERROR Error 61 connecting to 127.0.0.1:8000. Connection refused. 2019-09-19 00:28:30,668 ProxyManager.py[line:46] INFO ProxyFetch - freeProxy05: start 2019-09-19 00:28:32,110 ProxyManager.py[line:61] INFO ProxyFetch - freeProxy05: 125.110.119.116:9000 success 2019-09-19 00:28:32,112 ProxyManager.py[line:65] ERROR ProxyFetch - freeProxy05: error 2019-09-19 00:28:32,112 ProxyManager.py[line:66] ERROR Error 61 connecting to 127.0.0.1:8000. Connection refused. 2019-09-19 00:28:32,112 ProxyManager.py[line:46] INFO ProxyFetch - freeProxy06: start HTTPSConnectionPool(host='proxy.coderbusy.com', port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x11011e198>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)) HTTPSConnectionPool(host='proxy.coderbusy.com', port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x11011e2b0>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)) HTTPSConnectionPool(host='proxy.coderbusy.com', port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x11011eba8>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)) HTTPSConnectionPool(host='proxy.coderbusy.com', port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x11011e198>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)) HTTPSConnectionPool(host='proxy.coderbusy.com', port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x11011e2b0>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)) 2019-09-19 00:28:52,190 ProxyManager.py[line:65] ERROR ProxyFetch - freeProxy06: error 2019-09-19 00:28:52,190 ProxyManager.py[line:66] ERROR can only parse strings 2019-09-19 00:28:52,190 ProxyManager.py[line:46] INFO ProxyFetch - freeProxy07: start 2019-09-19 00:28:52,554 ProxyManager.py[line:61] INFO ProxyFetch - freeProxy07: 218.91.94.43:9999 success 2019-09-19 00:28:52,555 ProxyManager.py[line:65] ERROR ProxyFetch - freeProxy07: error 2019-09-19 00:28:52,555 ProxyManager.py[line:66] ERROR Error 61 connecting to 127.0.0.1:8000. Connection refused. 2019-09-19 00:28:52,556 ProxyManager.py[line:46] INFO ProxyFetch - freeProxy08: start 2019-09-19 00:28:53,171 ProxyManager.py[line:61] INFO ProxyFetch - freeProxy08: 39.137.69.10:8080 success 2019-09-19 00:28:53,171 ProxyManager.py[line:65] ERROR ProxyFetch - freeProxy08: error 2019-09-19 00:28:53,172 ProxyManager.py[line:66] ERROR Error 61 connecting to 127.0.0.1:8000. Connection refused. 2019-09-19 00:28:53,172 ProxyManager.py[line:46] INFO ProxyFetch - freeProxy09: start 2019-09-19 00:28:53,767 ProxyManager.py[line:61] INFO ProxyFetch - freeProxy09: 180.118.247.71:9000 success 2019-09-19 00:28:53,768 ProxyManager.py[line:65] ERROR ProxyFetch - freeProxy09: error 2019-09-19 00:28:53,768 ProxyManager.py[line:66] ERROR Error 61 connecting to 127.0.0.1:8000. Connection refused. 2019-09-19 00:28:53,768 ProxyScheduler.py[line:35] INFO finish fetch proxy Traceback (most recent call last): File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/redis/connection.py", line 538, in connect sock = self._connect() File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/redis/connection.py", line 595, in _connect raise err File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/redis/connection.py", line 583, in _connect sock.connect(socket_address) ConnectionRefusedError: [Errno 61] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "proxyPool.py", line 52, in cli() File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/click/core.py", line 764, in call return self.main(*args, **kwargs) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/click/core.py", line 717, in main rv = self.invoke(ctx) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/click/core.py", line 1137, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/click/core.py", line 956, in invoke return ctx.invoke(self.callback, **ctx.params) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/click/core.py", line 555, in invoke return callback(*args, **kwargs) File "proxyPool.py", line 38, in schedule runScheduler() File "../Schedule/ProxyScheduler.py", line 48, in runScheduler rawProxyScheduler() File "../Schedule/ProxyScheduler.py", line 40, in rawProxyScheduler doRawProxyCheck() File "../Schedule/RawProxyCheck.py", line 65, in doRawProxyCheck for _proxy in pm.db.getAll(): File "../DB/DbClient.py", line 102, in getAll return self.client.getAll() File "/Users/zz/python/weapons/proxy_pool-master/DB/SsdbClient.py", line 109, in getAll item_dict = self.__conn.hgetall(self.name) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/redis/client.py", line 2717, in hgetall return self.execute_command('HGETALL', name) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/redis/client.py", line 836, in execute_command conn = self.connection or pool.get_connection(command_name, **options) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/redis/connection.py", line 1222, in get_connection connection.connect() File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/redis/connection.py", line 543, in connect raise ConnectionError(self._error_message(e)) redis.exceptions.ConnectionError: Error 61 connecting to 127.0.0.1:8000. Connection refused.

Contributor guide