python 3.x - XML Parsing with ElementTree and Requests -



python 3.x - XML Parsing with ElementTree and Requests -

i trying work yahoo weather api, having few issues parsing xml api responds with. using python 3.4. here's code working with:

weather_url = 'http://weather.yahooapis.com/forecastrss?w=%s&u=%s' url = weather_url % (zip_code, units) try: rss = parse(requests.get(url, stream=true).raw).getroot() conditions = rss.find('channel/item/{%s}condition' % weather_ns) homecoming { 'current_condition': conditions.get('text'), 'current_temp': conditions.get('temp'), 'title': rss.findtext('channel/title') } except: raise

here's stack trace getting:

traceback (most recent phone call last): file "<input>", line 1, in <module> file "/home/jonathan/pycharmprojects/pyweather/pyweather/pyweather.py", line 42, in yahoo_conditions rss = parse(requests.get(url, stream=true).raw).getroot() file "/usr/lib/python3.4/xml/etree/elementtree.py", line 1187, in parse tree.parse(source, parser) file "/usr/lib/python3.4/xml/etree/elementtree.py", line 598, in parse self._root = parser._parse_whole(source) file "<string>", line none xml.etree.elementtree.parseerror: not well-formed (invalid token): line 1, column 0

the xml.etree.elementtree parse function doesn't raw object returned requests library. looking little bit deeper, raw object resolves to

>>> r = requests.get('http://weather.yahooapis.com/forecastrss?w=2502265', stream=true) >>> r.raw <requests.packages.urllib3.response.httpresponse object @ 0x7f32c24f9e48>

i referenced this solution, it's still leading same issue. why doesn't approach above work? urllib3 response object not supported elementtree.parse function? have read of docs, haven't enlightened me @ all.

the doc list here:

xml.etree.elementtree.parse doc requests.request doc urllib3.response.httpresponse doc

edit: after more experimentation, still haven't found solution problem outlined above. however, have found workaround. if utilize elementtree's fromstring method on xml content, works fine.

def fetch_xml(url): """ fetch url , parse document's xml. :param url: url xml located at. :return: root element of xml. :raises: :requests.exceptions.requestexception: requests not open url. :xml.etree.elementtree.parseerror: xml.etree.elementtree failed parse xml document. """ homecoming et.fromstring(requests.get(url).content)

i guess downside approach uses more memory. think? i'd communities opinion.

why using streaming requests download rss xml data? want maintain connection open time? weather hardly changes quickly, why not poll service every 5 minutes instead?

below finish code doing poll , parsing using beautifulsoup , requests. short , sweet.

import requests bs4 import beautifulsoup r = requests.get('http://weather.yahooapis.com/forecastrss?w=%s&u=%s' % (2459115, "c")) if r.status_code == 200: soup = beautifulsoup(r.text) print("current condition: ", soup.find("description").string) print("temperature: ", soup.find('yweather:condition')['temp']) print("title: ", soup.find("title").string) else: r.raise_for_status()

output:

current condition: yahoo! weather new york, ny temperature: 28 title: yahoo! weather - new york, ny

there lot more can beautifulsoup. first-class documentation.

xml python-3.x python-requests elementtree

Comments

Post a Comment

Popular posts from this blog

php - Android app custom user registration and login with cookie using facebook sdk -

php - Android app custom user registration and login with cookie using facebook sdk - i developing android application in users need register , log in using facebook. approximately, flow. open app first time, authenticate facebook, data, send info server create them business relationship in application, start session new business relationship in server, cookie perform later interactions. so far good. what need know wich info have send server, can able identify users when log in seccond time. because need start session in server , send cookie android app farther interactions. i'm using php server side language. i thinking getting getaccesstoken() in android facebook sdk, pass server on business relationship creation , storing in android app. but can't manage how login users on sec time utilize app. any suggestions ? in advance ! to uniquely identify user within app, should create request /me , user's id. guaranteed unique , remain con
Read more

django - Access session in user model .save() -

django - Access session in user model .save() - is possible access current session in user model .save()? pseudo code of want achieve: # users.models.py def save(self, *args, **kwargs): created = true if self.pk: created = false super(abstractuser, self).save(*args, **kwargs) # post-save if created: look_for_invite_in_session_and_register_if_found(self, session) seems wrong in architecture. shouldn't access request in models layer. work request must done in view. can this: user, created = abstractuser.objects.get_or_create(name=name) if created: look_for_invite_in_session_and_register_if_found(user, request.session) django session
Read more

php - .htaccess Multiple Rewrite Rules / Prioritizing -

php - .htaccess Multiple Rewrite Rules / Prioritizing - here current htaccess file: rewriteengine on rewritecond %{http_host} !^www\.website\.com [nc] rewritecond %{http_host} ([^.]+)\.website\.com [nc] rewriterule ^(.*)$ http://www.website.com/gotourl.php?urlid=?%1 [l] rewriterule ^(\w+)$ ./gotourl.php?urlid=$1 [nc,l] rewriterule ^(\w+)/$ ./gotourl.php?urlid=$1 [nc,l] the website in question url shortener i'm working on testing/developing , personal use. above code may not ideal i'm not familiar .htaccess , made via googling , testing. want url shortening aspect: http://website.com/1234 -> http://website.com/gotourl.php?urlid=1234 http://website.com/1234/ -> http://website.com/gotourl.php?urlid=1234 the problem cannot figure out how ignore directories. want specific directories go specific pages: http://website.com/img (or) http://website.com/img/ -> http://website.com/img.php http://website.com/img/1234 (or) http://website.com/
Read more