Retrieves or sets the minimum number of shuffle partitions after coalescing
Retrieves or sets the minimum number of shuffle partitions after coalescing
spark_coalesce_min_num_partitions(sc, num_partitions = NULL)
sc |
A |
num_partitions |
Minimum number of shuffle partitions after coalescing.
Defaults to |
Other Spark runtime configuration:
spark_adaptive_query_execution()
,
spark_advisory_shuffle_partition_size()
,
spark_auto_broadcast_join_threshold()
,
spark_coalesce_initial_num_partitions()
,
spark_coalesce_shuffle_partitions()
,
spark_session_config()
Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.