Uploaded image for project: 'Spring XD'
  1. Spring XD
  2. XD-3258

Add jars for Avro and Snappy compression to Sqoop job submission

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Priority: Minor
    • Resolution: Complete
    • Affects Version/s: None
    • Fix Version/s: 1.2.1, 2.x
    • Component/s: None
    • Labels:
      None

      Description

      We need to have some jars as part of the Sqoop job submission to YARN:

      for Avro we need:
      avro-1.7.6.jar
      avro-mapred-1.7.6.jar

      for Snappy we need:
      snappy-java-1.0.5.jar (note: the 1.1.0.1 version from xd/lib doesn't work)
      commons-compress-1.4.1.jar

      We can either have these included using the --libjars option or automatically include them.

        Attachments

          Activity

            People

            Assignee:
            thomas.risberg Thomas Risberg
            Reporter:
            thomas.risberg Thomas Risberg
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: