Retrieves or sets whether coalescing contiguous shuffle partitions is enabled
Retrieves or sets whether coalescing contiguous shuffle partitions is enabled
spark_coalesce_shuffle_partitions(sc, enable = NULL)
sc |
A |
enable |
Whether to enable coalescing of contiguous shuffle partitions.
Defaults to |
Other Spark runtime configuration:
spark_adaptive_query_execution()
,
spark_advisory_shuffle_partition_size()
,
spark_auto_broadcast_join_threshold()
,
spark_coalesce_initial_num_partitions()
,
spark_coalesce_min_num_partitions()
,
spark_session_config()
Please choose more modern alternatives, such as Google Chrome or Mozilla Firefox.