Package org.apache.spark.util

Class SparkThreadUtils

Object

org.apache.spark.util.SparkThreadUtils

public class SparkThreadUtils
extends Object

Constructor Summary

Constructors

Constructor	Description
SparkThreadUtils()

Method Summary

Modifier and Type	Method	Description
static <T> T	awaitResult(scala.concurrent.Awaitable<T> awaitable, scala.concurrent.duration.Duration atMost)	Preferred alternative to Await.result().
static <T> T	awaitResultNoSparkExceptionConversion(scala.concurrent.Awaitable<T> awaitable, scala.concurrent.duration.Duration atMost)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SparkThreadUtils

public SparkThreadUtils()

Method Details

awaitResult

public static <T> T awaitResult(scala.concurrent.Awaitable<T> awaitable,
 scala.concurrent.duration.Duration atMost)
                         throws SparkException

Preferred alternative to Await.result().

This method wraps and re-throws any exceptions thrown by the underlying Await call, ensuring that this thread's stack trace appears in logs.

In addition, it calls Awaitable.result directly to avoid using ForkJoinPool's BlockingContext. Codes running in the user's thread may be in a thread of Scala ForkJoinPool. As concurrent executions in ForkJoinPool may see some ThreadLocal value unexpectedly, this method basically prevents ForkJoinPool from running other tasks in the current waiting thread. In general, we should use this method because many places in Spark use ThreadLocal and it's hard to debug when ThreadLocals leak to other tasks.

Parameters:

awaitable - (undocumented)

atMost - (undocumented)

Returns:

(undocumented)

Throws:

SparkException

awaitResultNoSparkExceptionConversion

public static <T> T awaitResultNoSparkExceptionConversion(scala.concurrent.Awaitable<T> awaitable,
 scala.concurrent.duration.Duration atMost)