java - Quora search result paging issue by using selenium -



java - Quora search result paging issue by using selenium -

i using selenium login , search keywords on quora.everything working fine , have been able search keyword , result of first page.however, unable fetch next page result. have found tokens of next page on site naming min_seq on site.however, when fetched page using selenium html element contains token not nowadays in response. here code of search keyword.

string term = "protein"; string searchurl = "https://www.quora.com/search?q=%s"; string xport = system.getproperty("lmportal.xvfb.id", ":1"); final file firefoxpath = new file(system.getproperty("lmportal.deploy.firefox.path", "/home/infoobjects/firefox/firefox")); firefoxbinary firefoxbinary = new firefoxbinary(firefoxpath); firefoxbinary.setenvironmentproperty("display", xport); // start firefox driver webdriver driver = new firefoxdriver(firefoxbinary, null); driver.manage().timeouts().implicitlywait(30, timeunit.seconds); driver.get("https://www.quora.com/"); string str = driver.getpagesource(); system.out.println("str-->"+str); webelement emailelement = driver.findelement(by.name("email")); emailelement.sendkeys("<email id>"); webelement passwd = driver.findelement(by.name("password")); passwd.sendkeys("<password>"); passwd.sendkeys(keys.return); // html page after login selenium str = driver.getpagesource(); url = string.format(searchurl, term); driver.get(url); str = driver.getpagesource(); htmlcleaner cleaner = new htmlcleaner(); //next page url next_url = node.getelementsbyname("body", true)[0].getelementsbyname("script", true)[0].getattributebyname("src"); system.out.println(next_url);

in case next_url giving null.this because there no script tag within body tag cleaned html.

any suggestion helpful finding next page of search results quora

java selenium quora

Comments

Popular posts from this blog

model view controller - MVC Rails Planning -

ruby on rails - Devise Logout Error in RoR -

html - Submenu setup with jquery and effect 'fold' -