Skip to content

perf/sharding chunk transform#3729

Draft
d-v-b wants to merge 11 commits intozarr-developers:mainfrom
d-v-b:perf/sharding-chunk-transform
Draft

perf/sharding chunk transform#3729
d-v-b wants to merge 11 commits intozarr-developers:mainfrom
d-v-b:perf/sharding-chunk-transform

Conversation

@d-v-b
Copy link
Contributor

@d-v-b d-v-b commented Feb 27, 2026

  • connects the ChunkTransform to sharding

part of #3720
depends on #3727

d-v-b and others added 5 commits February 25, 2026 18:33
Introduces CodecChain, a frozen dataclass that chains array-array,
array-bytes, and bytes-bytes codecs with synchronous encode/decode
methods. Pure compute only -- no IO, no threading, no batching.

Also adds sync roundtrip tests for individual codecs (blosc, gzip,
zstd, crc32c, bytes, transpose, vlen) and CodecChain integration tests.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@github-actions github-actions bot added the needs release notes Automatically applied to PRs which haven't added release notes label Feb 27, 2026
@d-v-b d-v-b force-pushed the perf/sharding-chunk-transform branch from 4632322 to 4bdded0 Compare February 28, 2026 14:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

needs release notes Automatically applied to PRs which haven't added release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant