Details
-
Type:
Improvement
-
Status: Closed
-
Priority:
Minor
-
Resolution: Complete
-
Affects Version/s: None
-
Component/s: File Support
-
Labels:
-
Pull Request URL:
Description
When using an iterating splitter, the sequence size header is 0 because it cannot be known ahead of time.
Now that we have (optional) start and end of file markers, it should be possible to add a line count to the EOF marker.
Then, if parallel downstream processing of lines is performed, some downstream process will be able to determine (by counting) whether all lines have been processed.