Uploaded image for project: 'Spring for Apache Hadoop'
  1. Spring for Apache Hadoop
  2. SHDP-31

Need to add dependency to jackson to run wordcount batch example

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Complete
    • Affects Version/s: None
    • Fix Version/s: 0.9.0
    • Component/s: MR
    • Labels:
      None

      Description

      After the pruning of dependencies for spring-hadoop, I now need to add a dependency on jackson to get wordcount to pass. Seems like it should be a required dependnecy as iti s being called from the hadoop code.

      12/02/02 14:46:04 INFO support.SimpleJobLauncher: No TaskExecutor has been set, defaulting to synchronous executor.
      12/02/02 14:46:04 INFO support.SimpleJobLauncher: Job: [FlowJob: [name=job1]] launched with the following parameters: [{}]
      12/02/02 14:46:04 INFO job.SimpleStepHandler: Executing step: [import]
      12/02/02 14:46:05 INFO job.SimpleStepHandler: Executing step: [wordcount]
      12/02/02 14:46:05 ERROR step.AbstractStep: Encountered an error executing the step
      java.lang.NoClassDefFoundError: org/codehaus/jackson/map/JsonMappingException
      at org.apache.hadoop.mapreduce.Job$1.run(Job.java:478)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
      at org.apache.hadoop.mapreduce.Job.connect(Job.java:476)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:464)
      at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:495)
      at org.springframework.data.hadoop.mapreduce.JobTasklet.execute(JobTasklet.java:50)

        Attachments

          Activity

            People

            Assignee:
            costin Costin Leau
            Reporter:
            mark.pollack Mark Pollack
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: