Skip to content
Merged
Changes from 12 commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
a541d88
Set default kvikio backend in cudf-polars to EASY_THREADPOOL
Matt711 Aug 17, 2026
75b924b
docs
Matt711 Aug 17, 2026
344e83d
fix interation with libcudfs setting of kvikio thread pool
Matt711 Aug 17, 2026
ee3bf0a
hack
Matt711 Aug 17, 2026
6506813
dont init cuda ctx too early
Matt711 Aug 19, 2026
a500d76
Merge branch 'main' into fea/polars/default-kvikio-backend
Matt711 Aug 19, 2026
c65ee6f
merge conflict
Matt711 Aug 24, 2026
9fe9511
make set_up_kvikio take nthreads arg
Matt711 Aug 24, 2026
625c6ba
make set_up_kvikio not public
Matt711 Aug 25, 2026
e292c46
merge conflict
Matt711 Aug 25, 2026
5a13e3b
Set the default kvikio task size in cudf-polars to 16MiB
Matt711 Aug 26, 2026
0c54976
merge conflict
Matt711 Aug 27, 2026
27a96bc
Default cudf-polars to the kvikio MULTI_POLL backend
Matt711 Aug 27, 2026
7d10f1c
address reviews
Matt711 Aug 27, 2026
fffc983
merge conflict
Matt711 Sep 2, 2026
e84f229
reset the settings in tests
Matt711 Sep 2, 2026
39b7a50
property gettters and move imports
Matt711 Sep 2, 2026
5c89960
split out muti-poll settings
Matt711 Sep 2, 2026
b815e09
set kvikio backend in nthreads default test
Matt711 Sep 2, 2026
50f8618
Merge branch 'release/26.10' into fea/polars/kvikio-task-size
pentschev Sep 9, 2026
34acd02
Merge branch 'release/26.10' into fea/polars/kvikio-task-size
pentschev Sep 10, 2026
b1e316b
Fix MULTI_POLL reactor configuration lifecycle
pentschev Sep 10, 2026
647e73b
Merge branch 'release/26.10' into fea/polars/kvikio-task-size
Matt711 Sep 10, 2026
4071275
Add missing coverage
pentschev Sep 10, 2026
719981e
Merge remote-tracking branch 'Matt711/fea/polars/kvikio-task-size' in…
pentschev Sep 10, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion python/cudf_polars/cudf_polars/utils/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -227,7 +227,7 @@ def resolve_kvikio_nthreads(executor_options: dict[str, Any]) -> int:


def configure_kvikio(nthreads: int) -> None:
"""Set the remote I/O backend to ``EASY_THREADPOOL`` with ``nthreads`` threads."""
"""Configure kvikio for cudf-polars I/O."""
# HACK: libcudf calls set_up_kvikio() on the first IO op and that resets the thread
# pool (default is 4 if KVIKIO_NTHREADS is unset), undoing anything we set via
# kvikio.defaults. We call it here with our nthreads so later when it's called in
Expand All @@ -238,6 +238,7 @@ def configure_kvikio(nthreads: int) -> None:
{
"num_threads": nthreads,
"remote_io_backend": kvikio.RemoteIOBackend.EASY_THREADPOOL,
"task_size": 16 * 1024 * 1024,
}
)

Expand Down
Loading