python - BeautifulSoup replaces single quotes with double quotes -

-

in beautifulsoup4 python if exectue following commands:

soup = beautifulsoup("<a href='http://somelink'>link</a>") print soup

the output is:

<a href="http://somelink">link</a>

beaurifulsoup replaces single quotes double quotes , don't want that. how can cancel/overwrite behaviour?

clarification:

i use urllib2 html of following page: http://www.download3000.com/ , use beautifulsoup4 extract part of html.

i have made function takes document (not html) , samples of needs catch , returns regular expression. feed function follwoing samples:

samples = [     '/showarticles-1-0-date.html',     '/showarticles-2-0-date.html',     '/showarticles-3-0-date.html' ]

given html code of http://www.download3000.com/ page , samples above, function returns following regular expressions: \w\w><li><a href="(.*?)">\w\w\w\w\w

if apply regex html code of download3000, won't find match. that's because links surrounded single quotes in html, when use beautifulsoup replaces single quotes double quotes , regular expression generated works on html modified beaurifulsoup.

that's why need force beautifulsoup not replace single quotes double quotes, generated regular expression \w\w><li><a href='(.*?)'>\w\w\w\w\w, extracting need page.

i use dump solution replacing single quotes in regex ["\'], regex catch links don't want.

this works beautifulsoup 3.2. assume happening single quotes converted &quot; parser surrounds them " on output pattern "' or '" occurs

>>> c="<a href='http://somelink'>" >>> beautifulsoup import beautifulsoup >>> import re >>> d=re.sub("'","&quot;",c) >>> e=beautifulsoup(d) >>> def qfix(x):  return re.sub("\'\"|\"'","'",x) >>> qfix((str(e))

you might able use similar "qfix" formatter in beautifulsoup 4

or might not work @ :)


Comments

Post a Comment

Popular posts from this blog

c# - must be a non-abstract type with a public parameterless constructor in redis -

-
when save object, got below error must non-abstract type public parameterless constructor in order use parameter 't' in generic type or method 'servicestack.redis.redisclient.store<t>(t) redisclass.getinstnace().store(msg); // error here redisclass.getinstnace().save(); as third party's class, can not edit how save object? could create wrapper around third party object call constructor, store wrapper? e.g. public class mywrapper { public thirdpartyobject thirdpartyinstance { get; set; } public mywrapper() { thirdpartyinstance = new thirdpartyobject("constructors"); } }
Read more

c# - ReportViewer control - axd url -

-
i've embedded microsoft.reporting.webforms.reportviewer control in aspx. site works on mysite.com. when try exmple export report, there new black window opened address mysite.com/reserved.reportviewerwebcontrol.axd... it's working fine. but.. pass axd via proxy. mean, i'd force export use url myproxy.mysite.com/reserved.reportviewerwebcontrol.axd... redirect request mysite.com/reserved.reportviewerwebcontrol.axd... i've noticed, link build within js (that inlcuded in axd): exportreport: function(format) { if (this.exporturlbase == null) return false; window.open(this.exporturlbase + encodeuricomponent(format), "_blank"); return true; }, the url axd stored in exporturlbase . how can change proxy serwer url? it possible modify exporturlbase field in javascript. report stored in placeholder somewhere on page, once found can create call _getinternalviewer() function on gain access exporturlbase. have @ following code: ...
Read more

time series - R growth rate calculation week over week on daily timeseries data -

-
i'm trying calculate w/w growth rates entirely in r. use excel, or preprocess ruby, that's not point. data.frame example date gpv type 1 2013-04-01 12900 office 2 2013-04-02 16232 office 3 2013-04-03 10035 office i want factored 'type' , need wrap date type column weeks. , calculate week on week growth. i think need ddply group week - custom function determines if date in given week or not? then, after that, use diff , find growth b/w weeks divided previous week. then i'll plot week/week growths, or use data.frame export it. this closed had same useful ideas. update: answer ggplot: all same below, use instead of plot ggplot(data.frame(week=seq(length(gr)), gr), aes(x=week,y=gr*100)) + geom_point() + geom_smooth(method='loess') + coord_cartesian(xlim = c(.95, 10.05)) + scale_x_discrete() + ggtitle('week on week growth rate, apr 1') + ylab('growth rate %') (old, correct answer using plot) w...
Read more