Uploaded image for project: 'Spring XD'
  1. Spring XD
  2. XD-1745

Support for hadoop name node HA configuration

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Done
    • Priority: Major
    • Resolution: Complete
    • Affects Version/s: None
    • Fix Version/s: 1.0 RC1
    • Component/s: Hadoop
    • Labels:
      None
    • Story Points:
      5
    • Rank (Obsolete):
      321
    • Sprint:
      Sprint 30, Sprint 31

      Description

      Hadoop supports namenode HA with two name nodes running, one being active and other in standby. If the active name node fails the standby name node has all the data readily available and can start serving requests. In this configuration name node url is no longer a host:port url but a logical name that translates to any active name node at runtime.

      This is to ensure spring xd stream can handle a name node failure, for instance when writing a hdfs sink, seamlessly

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              jvalkeal Janne Valkealahti
              Reporter:
              glingappa Girish Lingappa
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: