Release Notes - Spring XD - Version M4 - HTML format

Epic

  • [XD-232] - A HATEOAS designed REST API using Spring HATEOAS library.
  • [XD-238] - Deploying Custom Code
  • [XD-468] - Providing support for using different Hadoop distributions, including Pivotal HD
  • [XD-836] - Harden the requirements for the DSL and refactor accordingly.

Bug

  • [XD-299] - Creating a tap with same name as existing streams results in infinite loop
  • [XD-446] - Investigate stream lifecycle issues with redis store
  • [XD-625] - Revert XD-624 When SI 3.0.M3 is Available
  • [XD-628] - Streams created without a '|' (substreams) are being typed by the parser as a Job
  • [XD-629] - Problem with tapping on a module using a named sink channel
  • [XD-641] - Problem with tapping and > (source channels)
  • [XD-835] - REST - Listing of FieldValueCounter not working
  • [XD-848] - ICLA website is missing Spring XD project option
  • [XD-871] - No errors in Shell when creating stream with HTTP Source + already used port
  • [XD-877] - Taps do not work when JMX is enabled
  • [XD-891] - Provide a way to access currently deployed modules
  • [XD-920] - MQTT source module does not cleanly undeploy
  • [XD-958] - Build failure on Ubuntu
  • [XD-1018] - JobDeployer hides root exceptions on failure

Improvement

  • [XD-516] - Admin should fail immediately if Rabbit is not running
  • [XD-638] - Unclear error message using hadoop fs shell commands without configuring a URL
  • [XD-956] - Refactor DSL parser according to latest syntax proposals
  • [XD-1019] - Add Spring Retry to Rabbit Message Bus
  • [XD-1038] - Source that produces JSON String as byte[] with --outputType application/json should produce JSON string

Story

  • [XD-15] - Deploy against Amazon EMR
  • [XD-53] - Design and document desired high level DSL for configuring data processing in XD
  • [XD-163] - Enable grouping of modules for co-located deployment
  • [XD-189] - Investigate running XD on Cloud Foundry
  • [XD-214] - Create documentation on the general DSL syntax
  • [XD-246] - MessageChannelItemWriter
  • [XD-265] - Retrieve description of all registered modules
  • [XD-267] - Job as a Source
  • [XD-282] - The HDFS Sink should support writing POJOs to HDFS using Avro Serialization
  • [XD-316] - Create a common exception framework for XD
  • [XD-324] - Retrieve description of a single module
  • [XD-325] - Add command to get listing of a module
  • [XD-326] - Add command to get listing of all modules
  • [XD-351] - Support daily query resolution in redis aggregate counter
  • [XD-440] - More DSL work: using and policing & for job step lists
  • [XD-441] - More DSL work: checking behaviour for non-deployable streams
  • [XD-442] - More DSL work: Documentation updates for new format
  • [XD-445] - Add support to set the read timeout for http request
  • [XD-450] - Retrieve description of all registered modules by type
  • [XD-501] - Stream Plugin cleanup
  • [XD-505] - Fix XD modules parameters with "-" to use camel case
  • [XD-513] - Add CI job in bamboo to run XD integration tests
  • [XD-514] - Create proper test coverage for Controllers
  • [XD-529] - Review existing Reactor syslog codec implementation
  • [XD-531] - Check for high CPU usage with syslog-tcp-reactor module
  • [XD-532] - Adapt SpringOne 2012 UI code from keynote demo of election results to use XD
  • [XD-543] - Handle Pagination in Spring XD Shell
  • [XD-578] - Can't access HDFS using webhdfs protocol
  • [XD-651] - End point to retrieve a list of all XD artifacts of all kinds
  • [XD-672] - Ugly error messages in shell when not connected
  • [XD-679] - Update settings file and reformat existing codebase.
  • [XD-681] - DSL Parser should check for invalid stream parameters
  • [XD-687] - provide user friendly messages when dealing with invalid gemfire sink
  • [XD-689] - Support serialization/deserialization of Message payloads across JVMs across all transports.
  • [XD-701] - Refactor Message conversion in ChannelRegistrySupport
  • [XD-719] - Refactor the file source module to have lib/config directories
  • [XD-735] - Job Repo in container needs access to Admin's HSQLDB
  • [XD-753] - JDBC property settings need to be made externally configurable
  • [XD-785] - Enable profile selection from module options
  • [XD-792] - Update twittersearch to use Spring Integration support
  • [XD-796] - Create separate commands for "--all" shell commands
  • [XD-798] - Add support for ( ) grouping in Parser
  • [XD-808] - Update to spring-data-hadoop 1.0.1.RELEASE
  • [XD-811] - Add REST endpoint for launching Job
  • [XD-813] - Destroying XD job should remove job's entries at batch job repositories/batch job locator
  • [XD-815] - Updgrade to use spring-batch-admin 1.3.0 M1 when available
  • [XD-816] - Support for composed streams
  • [XD-821] - Change url to access UI from browser
  • [XD-825] - Create object-to-json transformer processor
  • [XD-828] - rename Bridge to Binding and add direction
  • [XD-829] - Upgrade hsqldb version on XD batch admin to the latest
  • [XD-830] - Expose Job parameters for JobExecutions
  • [XD-837] - Tipsy tooltip hovers are not responsive after jobs list is refreshed from server
  • [XD-839] - Close parent contexts when shutting down
  • [XD-842] - Add back classifier = 'dist' to distZip build target
  • [XD-843] - Initial XD on CloudFoundry support
  • [XD-845] - Remove support for the leading : on items that have a declared namespace
  • [XD-846] - Remove deprecated tap syntax from the parser.
  • [XD-847] - Revise the available hadoopDistro options
  • [XD-851] - Refactor DSL for Taps and Jobs Usage
  • [XD-852] - DSL needs to have wildcard support for taps
  • [XD-853] - Add definition of serialVersionUID to Twitter classes
  • [XD-854] - Update doc about modules and spring
  • [XD-855] - Change metrics assertions in integration tests to use smart Thread.sleep
  • [XD-857] - Refactor FileModuleRegistry as "ResourceModuleRegistry"
  • [XD-858] - Upgrade to Spring Data Redis 1.1.0.RELEASE
  • [XD-859] - Support for listing of modules in the REST API
  • [XD-861] - Type Conversion across modules
  • [XD-862] - First class JSON Path support
  • [XD-863] - Serialization of Spring Batch Context Objects
  • [XD-864] - Move BatchJobExecutionsByJobName to BatchJobsController from BatchJobExecutionsController
  • [XD-865] - Add a test suite to the admin-ui
  • [XD-866] - Remove remaining Thread.sleeps from the job tests
  • [XD-867] - Support the ability for a user to create composite modules that can accept parameters
  • [XD-868] - Create microbenchmark performance test of reactor syslog adapter vs standard syslog adapter
  • [XD-869] - Colocate Modules using labels.
  • [XD-870] - Support for listing of modules in the Shell
  • [XD-873] - File Source - Provide option to pass on File object
  • [XD-875] - Handle AdminServer shutdown cleanly
  • [XD-880] - Update Java Version to 7
  • [XD-881] - Introduce wire.js into the XD admin UI
  • [XD-882] - Disable the JMX setting in SingleNodeMainIntegrationTests.testConfiguration
  • [XD-886] - Fix package tangle between org.springframework.xd.dirt.plugins.job and org.springframework.xd.dirt.job
  • [XD-887] - Package modules with their support jars
  • [XD-888] - Remove org. in hsqldb dependency
  • [XD-889] - Change default admin port from 8080
  • [XD-890] - Run JavaScript tests (Jasmine) as part of the build process
  • [XD-896] - Add --inputType and --outputType module parameters
  • [XD-899] - xd-container should start even if xd-admin is not running
  • [XD-900] - Move SpEL PropertyAccessors to Module Parent Context
  • [XD-901] - Wrong Jetty Util on classpath for WebHdfs
  • [XD-902] - Properly close Redis/Rabbit connection factories in tests
  • [XD-905] - Container start/stop publish events are not getting processed
  • [XD-906] - Add aggregate counter monthly resolution query support
  • [XD-907] - Add aggregate counter year resolution query support
  • [XD-908] - Add aggregate counter query by number of points
  • [XD-909] - Support additional aggregate counter query options
  • [XD-910] - Add a Processor for Restful webservices
  • [XD-911] - Reduce Sonar Critical Errors
  • [XD-913] - The XD build breaks with Gradle 1.8
  • [XD-915] - Convert modules to be CP-aware
  • [XD-916] - File source should be able to produce file contents or file reference
  • [XD-919] - Remove json parameter from twittersearch source
  • [XD-922] - Handle SingleNodeServer's stop() method cleanly
  • [XD-924] - Split integration.x in dedicated XD projects where appropriate
  • [XD-926] - Update Core Spring Dependency to 4.0.0.M3
  • [XD-927] - ModuleType Refactor
  • [XD-934] - Support JSON to Object
  • [XD-935] - Implement Kryo serialization for Tuple
  • [XD-937] - Inject ModuleDefinitionRepository into ModulesController
  • [XD-939] - Make Runtime modules listing by ContainerId pageable
  • [XD-940] - Splunk Pulls in an Old SI Jar into STS
  • [XD-941] - Convert remaining modules to be CP-aware
  • [XD-942] - Change repo links in build.gradle repo.spring.io
  • [XD-945] - Spike for writing to HDFS
  • [XD-946] - Spike for EC2 deployments
  • [XD-948] - Spike for job that imports data from CSV file to HDFS
  • [XD-949] - Spike for job that exports HDFS CSV data to JDBC
  • [XD-950] - Spike for advanced Job Orchestration features
  • [XD-955] - Update Jobs documentation to include "job launch" command
  • [XD-957] - Update SI Dependency to 4.0.0.BUILD-SNAPSHOT
  • [XD-961] - Accessing xd-admin URLs in the browser return XML and not JSON
  • [XD-962] - fix gradle clean test
  • [XD-966] - User requests that XD team members are issued EC2 accounts
  • [XD-969] - Add functionality to provision EC2 instance and mount EBS
  • [XD-970] - Install XD admin instance on EC2
  • [XD-976] - Bootstrap Project for XD AWS Installer
  • [XD-977] - Add functionality to download XD distribution zip to each EC2 instance as specified by user
  • [XD-978] - Installer needs to launch a single node XD instance
  • [XD-984] - Create OOTB batch job for import and processing multiple files to JDBC
  • [XD-985] - Create OOTB 'file to HDFS' batch import job that is launched by a stream.
  • [XD-987] - Create OOTB batch job for export and processing multiple files from HDFS to MongoDB
  • [XD-988] - Create OOTB batch job for export and processing multiple files from HDFS to JDBC
  • [XD-995] - Refactor tests with FileSink|FileSource to use eventually() matcher
  • [XD-998] - Add documentation for gemfire cache-listener source
  • [XD-999] - Return the step execution information in the current job execution controller
  • [XD-1000] - User should be able to view the list of all the job definitions
  • [XD-1001] - User should be able to view the list of all Deployed Jobs
  • [XD-1003] - UI: User should be able to launch a job from Deployed jobs page
  • [XD-1008] - Jobs list REST endpoint should include deployed/undeployed status
  • [XD-1013] - Add additional REST endpoint that return the XML definition of a job
  • [XD-1014] - Command to show the XML of the job definition
  • [XD-1015] - Create a reusable responsive UI layout to render the XD PagedResoures in tabular view
  • [XD-1023] - Refactor job deploy to go through XDController.deploy(name)
  • [XD-1024] - Kryo Redis Serializer
  • [XD-1025] - UI: Implement Job Deploy/Undeploy from the Job Definitions page
  • [XD-1028] - UI - Do not hard-code server url
  • [XD-1029] - Migrate to SI Redis Queue and Topic Adapters
  • [XD-1030] - Refactoring to JdbcMessagePayloadTransformer to extends from AbstractPayloadTransformer not JsonToObjectTransformer
  • [XD-1031] - UI - Launch a job with parameters
  • [XD-1033] - Add a tcp-client source module
  • [XD-1035] - Attempt to compose a module with same name+type as existing should fail
  • [XD-1036] - Support composed module deletion
  • [XD-1041] - Upgrade to Spring for Apache Hadoop 1.0.2.RELEASE and Pivotal HD 1.1
  • [XD-1046] - Consider a shared project for POJOs that are shareable betweed model and REST layer
  • [XD-1049] - Create documentation for composed modules

Edit/Copy Release Notes

The text area below allows the project release notes to be edited and copied to another document.