Si @ d dl Z d dlmZ d dlZd dlmZ G d d Zy) N)FreeProxyExceptionc 8 e Zd ZdZd dZd Zd Zd Zd
dZd Z y) FreeProxya
FreeProxy class scrapes proxies from ,
, ,
and and checks if proxy is working.
There is possibility to filter proxies by country and acceptable timeout.
You can also randomize list of proxies from where script would get first
working proxy.
Nc | || _ || _ || _ || _ || _ || _ |rdnd| _ || _ y )Nhttpshttp)
country_idtimeoutrandomanonymelitegoogleschemaurl) selfr r
randr r
r r r s =/home/agent/.friday_env/lib/python3.12/site-packages/fp/fp.py__init__zFreeProxy.__init__ s> $
!&gF c B t j | j | }t j |j
} |j d }t dt | D cg c]E }| j || r/|| d j d|| d j G c}S # t j j $ r$}t d| j | d |d }~ww xY wc c}w # t $ r}t d |d }~ww xY w)Nz Request to z failedz//*[@id="list"]//tr r :z Failed to get list of proxies)requestsget_FreeProxy__websitelh
fromstringcontent
exceptionsRequestExceptionr xpathrangelen_FreeProxy__criteria text_content Exception)r repeatpagedoce tr_elementsis r get_proxy_listzFreeProxy.get_proxy_list s F<<v 67D-- -C M ))$9:K "1c+&6 7\4??;WX>;Z #1~a(5578+a.:K:X:X:Z9[\ \
\ ""33 F$ dnnV 4 5W=?DE
F F
\ M$%DE1 L MsC AB; (D .A
C?8D ; C< C77C<?D D
DD c N |ry| j dgk( ry| j dgk( ryy)Nzhttps://free-proxy-list.netUSzhttps://www.us-proxy.orgGBz)https://free-proxy-list.net/uk-proxy.htmlzhttps://www.sslproxies.org)r )r r' s r __websitezFreeProxy.__website- s- 0
__
&-
__
&>/r c | j sdn |d j | j v }| j sdnd|d j v }| j r | j rdnd|d j k( }ddd}| j dn.| j |j |d j k( }| j d k( rdn#|d
j j d k( }|xr |xr
|xr |xr |S ) NT r
anonymousF)yesno r r6 )r r% r
r r r r lower)r row_elementscountry_criteriaelite_criteriaanonym_criteriaswitchgoogle_criteriahttps_criterias r
__criteriazFreeProxy.__criteria7 s '+4LOReturns a working proxy that matches the specified parameters.Nzhttp://T)r' z*There are no working proxies at this time.) r- r shuffler %_FreeProxy__check_if_proxy_is_workingr r r r r r )r r'
proxy_list
working_proxy
proxy_addressproxiess r r z
FreeProxy.getE s ((0
;; NN: &
' M{{gm_$=>G
$ @ @ I
(( ! V*"&8848( ( 8: :
&&77
s B B98B9c | j d| j }|| j j d d dd }t j ||| j
d 5 }|j j j rL|j j j j d |k( r|| j cd d d S d d d y # 1 sw Y y xY w)Nz://r r r3 T)rI r
streamr )
r r splitr r r
raw
connectionsock getpeername)r rI r iprs r __check_if_proxy_is_workingz%FreeProxy.__check_if_proxy_is_workingZ s
S
+
T[[
!
'
'
,Q
/
3
\\#w T
R ,VWuu $$)9)9)>)>)J)J)LQ)OSU)U t{{+ , , , , s
#A#CC")Ng ?FFFNFzhttps://www.google.com)F)
__name__
__module__ __qualname____doc__r r- r r$ r rE r r r r s' M 0 n :*r r )r lxml.htmlhtmlr r fp.errorsr r rX r r r\ s (U Ur