Skip to content

WIP: Pass FileIO in ScanTaskGroup#15461

Draft
nastra wants to merge 5 commits intoapache:mainfrom
nastra:remote-planning-file-io-in-tasks
Draft

WIP: Pass FileIO in ScanTaskGroup#15461
nastra wants to merge 5 commits intoapache:mainfrom
nastra:remote-planning-file-io-in-tasks

Conversation

@nastra
Copy link
Contributor

@nastra nastra commented Feb 27, 2026

No description provided.

@nastra nastra marked this pull request as draft February 27, 2026 09:54
@nastra nastra force-pushed the remote-planning-file-io-in-tasks branch 3 times, most recently from b6c4c10 to cb1a99f Compare February 27, 2026 12:12
Comment on lines +235 to +236
toTaskGroupIterable(
groupingKey, groupingKeyTasks, splitSize, lookback, weightFunc, fileIO));
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TG would a split in executor, i wonder if we should send it at FileIO per split ? but i can see how it can simplify, thinking of it more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants