Uploaded image for project: 'Spring XD'
  1. Spring XD
  2. XD-3150

the 'filepollhdfs' job fails on second submission

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Priority: Critical
    • Resolution: Complete
    • Affects Version/s: 1.1.2, 1.2 RC1
    • Fix Version/s: 1.1.3, 1.2 GA
    • Component/s: Batch
    • Labels:
      None

      Description

      Definitions:

      >job create pollHdfs --definition "filepollhdfs --names=name,age" --deploy true

      >stream create csvStream --definition "file --mode=ref --dir=/Users/trisberg/Test/files --pattern=*.csv > queue:job:pollHdfs" --deploy

      Here is the exception:

      org.springframework.data.hadoop.store.StoreException: Error while flushing stream; nested exception is java.nio.channels.ClosedChannelException
      	at org.springframework.xd.batch.item.hadoop.HdfsTextItemWriter.update(HdfsTextItemWriter.java:135)
      	at org.springframework.batch.item.support.CompositeItemStream.update(CompositeItemStream.java:74)
      	at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:250)
      	at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:198)
      	at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:148)
      	at org.springframework.batch.core.job.flow.JobFlowExecutor.executeStep(JobFlowExecutor.java:64)
      	at org.springframework.batch.core.job.flow.support.state.StepState.handle(StepState.java:67)
      	at org.springframework.batch.core.job.flow.support.SimpleFlow.resume(SimpleFlow.java:165)
      	at org.springframework.batch.core.job.flow.support.SimpleFlow.start(SimpleFlow.java:144)
      	at org.springframework.batch.core.job.flow.FlowJob.doExecute(FlowJob.java:134)
      	at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:304)
      	at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:135)
      	at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50)
      	at org.springframework.batch.core.launch.support.SimpleJobLauncher.run(SimpleJobLauncher.java:128)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
      	at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190)
      	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
      	at org.springframework.batch.core.configuration.annotation.SimpleBatchConfiguration$PassthruAdvice.invoke(SimpleBatchConfiguration.java:127)
      	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
      	at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:207)
      	at com.sun.proxy.$Proxy54.run(Unknown Source)
      	at org.springframework.batch.integration.launch.JobLaunching
      

        Attachments

          Activity

            People

            Assignee:
            jvalkeal Janne Valkealahti
            Reporter:
            thomas.risberg Thomas Risberg
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: