Uploaded image for project: 'Spring for Apache Hadoop'
  1. Spring for Apache Hadoop
  2. SHDP-1

Generic support for POJO domain objects through Spring Serializer abstraction

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: DI
    • Labels:

      Description

      There is, of course, a Serializer abstraction in Hadoop as well, but it will not be as convenient to configure for Spring users. A user should be able to simply declare a pair of converters, e.g.

      	<bean id="conversionService" class="org.springframework.hadoop.convert.HadoopConversionServiceFactoryBean">
      		<property name="converters">
      			<set>
      				<bean class="org.springframework.hadoop.convert.SerializerWritableToObjectConverter">
      					<constructor-arg value="com.foo.Foo" />
      				</bean>
      				<bean class="org.springframework.hadoop.convert.ObjectToSerializerWritableConverter">
      					<constructor-arg value="com.foo.Foo" />
      					<constructor-arg ref="serializer" />
      					<constructor-arg ref="deserializer" />
      				</bean>
      			</set>
      		</property>
      	</bean>
      

      and then declare a Mapper or Reducer with input of type Foo. Hadoop can then use SerializerWritable as its internal type for sending data to remote workers, but Spring Hadoop unpacks that and deserializes it.

        Attachments

          Activity

            People

            Assignee:
            david_syer Dave Syer
            Reporter:
            david_syer Dave Syer
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Dates

              Created:
              Updated: