We humans consume food, process it, and then eliminate waste – all in batches. Imagine attempting this in real-time; the results would be rather unpleasant.

As software engineers embrace the concept of a ‘full stack’ developer, it’s time for data engineers to consider a similar notion.