Uploaded image for project: 'Spring XD'
  1. Spring XD
  2. XD-1338

Deployment manifest to support partitioning a stream

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Priority: Major
    • Resolution: Complete
    • Affects Version/s: None
    • Fix Version/s: M7
    • Component/s: Runtime
    • Labels:

      Description

      We need a methodology for providing partitioning hints.

      A current proposal uses message headers to provide:

      • partition_key – the item to partition on
      • destination_region – what to target

      In the proposal the developer used "partition_key" to route the stream message to the node where data was stored in process. This was done so downstream stream operations could work on the data with out suffering any network IO.

      The "destination_region" was used to target the type of data the downstream streams were going to use in their stream processing.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              grussell Gary Russell
              Reporter:
              cblack Charlie Black
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: