Skip to content Skip to sidebar Skip to footer

Hangs On Open Url With Urllib (python3)

I try to open url with python3: import urllib.request fp = urllib.request.urlopen('http://lebed.com/') mybytes = fp.read() mystr = mybytes.decode('utf8') fp.close() print(mys

Solution 1:

I suppose the reason is that the url does not support robot visiting a site visit. You need to fake a browser visit by sending browser headers along with your request

import urllib.requesturl="http://lebed.com/"
req = urllib.request.Request(
    url, 
    data=None, 
    headers={
        'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.47 Safari/537.36'
    }
)
f = urllib.request.urlopen(req)

Tried this one on my system and it works.

Solution 2:

Agree with Arpit Solanki. Shown output for a failed request vs successful.

Failed
    GET/ HTTP/1.1
    Accept-Encoding: identity
    Host: www.lebed.com
    Connection: closeUser-Agent: Python-urllib/3.5

Success
    GET/ HTTP/1.1
    Accept-Encoding: identity
    Host: www.lebed.com
    Connection: closeUser-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.47 Safari/537.36

Post a Comment for "Hangs On Open Url With Urllib (python3)"