In Sparkflows, we can use the Count processor to get row count at any stage. It can be attached to a processor where count is to be derived and it would print the row count.
To use the ‘Count’ Processor, do the following:
-
Select a Variable Name to hold row count details. This variable would be available in downstream processors.
-
Select True or False in the ‘Printcount’ field. If selected as true then row count would be printed in the output.
For more details, refer here: