Uploaded image for project: 'Spring XD'
  1. Spring XD
  2. XD-2595 Test recent Hadoop distro changes
  3. XD-2688

Fix mapreduce job submission on Cloudera CDH5

    XMLWordPrintable

    Details

    • Type: Technical task
    • Status: Done
    • Priority: Blocker
    • Resolution: Complete
    • Affects Version/s: None
    • Fix Version/s: 1.1 GA
    • Component/s: Hadoop
    • Labels:
      None

      Description

      Submitting jobs that submit YARN MR tasks on Cloudera 5.3.0

      • job fails when submitting the YARN app

      java.lang.NoClassDefFoundError: com/google/common/io/LimitInputStream

      • this is from Guava and that class was removed starting with v. 15.0
      • I can get around this by including guava-14.0.1.jar in lib/cdh5 (not sure if this breaks something else)

        Attachments

          Activity

            People

            Assignee:
            thomas.risberg Thomas Risberg
            Reporter:
            thomas.risberg Thomas Risberg
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: