amazon s3 - java.lang.NullPointerException when reading s3 with Hadoop (Scalding) -



amazon s3 - java.lang.NullPointerException when reading s3 with Hadoop (Scalding) -

getting unusual npe when trying read s3 scalding / hadoop. paths 100% correct.

asking question because it's surprisingly hard google , everytime error forget how solved it. posting on so can google myself.

caused by: java.lang.nullpointerexception @ org.apache.hadoop.fs.s3native.natives3filesystem.liststatus(natives3filesystem.java:479) @ org.apache.hadoop.fs.globber.liststatus(globber.java:69) @ org.apache.hadoop.fs.globber.glob(globber.java:217) @ org.apache.hadoop.fs.filesystem.globstatus(filesystem.java:1623) @ com.twitter.scalding.filesource.pathisgood(filesource.scala:57) @ com.twitter.scalding.filesource$$anonfun$hdfsreadpathsaregood$1.apply(filesource.scala:89) @ com.twitter.scalding.filesource$$anonfun$hdfsreadpathsaregood$1.apply(filesource.scala:89) @ scala.collection.linearseqoptimized$class.forall(linearseqoptimized.scala:70) @ scala.collection.immutable.list.forall(list.scala:84) @ com.twitter.scalding.filesource.hdfsreadpathsaregood(filesource.scala:89) @ com.twitter.scalding.filesource.validatetaps(filesource.scala:101) @ com.twitter.scalding.job$$anonfun$validatesources$1.apply(job.scala:158) @ com.twitter.scalding.job$$anonfun$validatesources$1.apply(job.scala:153) @ scala.collection.iterator$class.foreach(iterator.scala:727) @ scala.collection.abstractiterator.foreach(iterator.scala:1157) @ scala.collection.iterablelike$class.foreach(iterablelike.scala:72) @ scala.collection.abstractiterable.foreach(iterable.scala:54) @ com.twitter.scalding.job.validatesources(job.scala:153) @ com.twitter.scalding.job.buildflow(job.scala:91) @ com.twitter.scalding.job.run(job.scala:126) @ com.twitter.scalding.tool.start$1(tool.scala:109) @ com.twitter.scalding.tool.run(tool.scala:125) @ com.twitter.scalding.tool.run(tool.scala:72) @ org.apache.hadoop.util.toolrunner.run(toolrunner.java:70) @ com.twitter.scalding.tool$.main(tool.scala:133)

this error seen doing glob searches. jets3 has tuned, guess max-keys or timeout options.

hadoop amazon-s3 nullpointerexception scalding

Comments

Post a Comment

Popular posts from this blog

model view controller - MVC Rails Planning -

model view controller - MVC Rails Planning - i'm starting rails , i'm building app stores films info, user can watch film , give grade on web application. i have coded cinema model, controller , views. now, have 2 questions: should need create model , controller grading? in case, should create or should wait , create first users model , controller? yes, on model , controller grades. that'd feasible way maintain track of who's graded what. it's create first, i'd start users, since grades depend on both films , users. ruby-on-rails model-view-controller
Read more

ruby on rails - Devise Logout Error in RoR -

ruby on rails - Devise Logout Error in RoR - while using devise in ror, encountering unusual error when trying log out url different root url. displays me : actioncontroller::invalidauthenticitytoken in devise::sessionscontroller#destroy" for illustration if rooting path after log in '/structure', , seek log out '/general' error, while logging out '/structure' fine. any help highly appreciated. ruby-on-rails ruby devise
Read more

html - Submenu setup with jquery and effect 'fold' -

html - Submenu setup with jquery and effect 'fold' - i want open submenu jquery effect fold, problem if user "hover effect" fast menu remain open, how can avoid this, jquery code is: $('ul.mainmenu li').hover( function() { $(this).children('ul').show('fold', 570); }, function() { $(this).children('ul').hide('fold', 500); } ); my jsfiddle link is: http://jsfiddle.net/9wkbf/ updated fiddle the reason behind problem is, first event $(this).children('ul').show('fold', 570); queued , until completes, sec animation not start. the next snippet can workaround $('ul.mainmenu > li').hover( function() { $(this).children('ul').show('fold', 570); }, function() { $('ul:not(.mainmenu)').hide('fold', 500); } ); *important note : work current scenario. jquery html css
Read more