Introducing Iterators for Batch Processing in Your Pipeline

We're excited to introduce a new component type: Iterators. Iterators are designed to process each data element individually within an array or list. This functionality is crucial for efficiently handling data in batches within your pipeline.

Iterator ( [ 🌽 , 🐮 , 🐓 ] , cook) =>  [ 🍿 , 🥩 , 🍗 ]

Enhance Your Workflows with Iterators

Imagine you're summarizing a webpage with extensive content. With an iterator, you can process the substantial content of a webpage, breaking it down into manageable chunks segmented by tokens. This enables you to efficiently generate concise summaries for each section of the page.

👉 Try out the pipeline Website Summarizer with Iterator.