java - Quora search result paging issue by using selenium -
java - Quora search result paging issue by using selenium -
i using selenium login , search keywords on quora.everything working fine , have been able search keyword , result of first page.however, unable fetch next page result. have found tokens of next page on site naming min_seq on site.however, when fetched page using selenium html element contains token not nowadays in response. here code of search keyword.
string term = "protein"; string searchurl = "https://www.quora.com/search?q=%s"; string xport = system.getproperty("lmportal.xvfb.id", ":1"); final file firefoxpath = new file(system.getproperty("lmportal.deploy.firefox.path", "/home/infoobjects/firefox/firefox")); firefoxbinary firefoxbinary = new firefoxbinary(firefoxpath); firefoxbinary.setenvironmentproperty("display", xport); // start firefox driver webdriver driver = new firefoxdriver(firefoxbinary, null); driver.manage().timeouts().implicitlywait(30, timeunit.seconds); driver.get("https://www.quora.com/"); string str = driver.getpagesource(); system.out.println("str-->"+str); webelement emailelement = driver.findelement(by.name("email")); emailelement.sendkeys("<email id>"); webelement passwd = driver.findelement(by.name("password")); passwd.sendkeys("<password>"); passwd.sendkeys(keys.return); // html page after login selenium str = driver.getpagesource(); url = string.format(searchurl, term); driver.get(url); str = driver.getpagesource(); htmlcleaner cleaner = new htmlcleaner(); //next page url next_url = node.getelementsbyname("body", true)[0].getelementsbyname("script", true)[0].getattributebyname("src"); system.out.println(next_url); in case next_url giving null.this because there no script tag within body tag cleaned html.
any suggestion helpful finding next page of search results quora
java selenium quora
Comments
Post a Comment