Uploaded image for project: 'Spring XD'
  1. Spring XD
  2. XD-3022

Kafka Message Bus ignores consumer concurrency when computing partition count

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Priority: Major
    • Resolution: Complete
    • Affects Version/s: 1.1.2, 1.2 M1
    • Fix Version/s: 1.2 RC1
    • Component/s: Runtime
    • Labels:
      None

      Description

      This is a combination of two issues:

      • the internal property `next.module.concurrency` is computed from `concurrency` when it should be computed from `consumer.concurrency`
      • even if `next.module.concurrency` is set, the KafkaMessageBus rejects it, since it's not set in SUPPORTED_CONSUMER_PROPERTIES

      As a result, the value used in partition calculation is always 1.

      A workaround exists, by setting the `module.[moduleName].producer.minPartitionCount` property to the expected total value.

        Attachments

          Activity

            People

            Assignee:
            mbogoevici Marius Bogoevici
            Reporter:
            mbogoevici Marius Bogoevici
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: