Exam Associate-Developer-Apache-Spark-3.5 Topic 1 Question 130 Discussion
Actual exam question for Databricks's Associate-Developer-Apache-Spark-3.5 exam
Question #: 130
Topic #: 1
Question #: 130
Topic #: 1
A Spark engineer is troubleshooting a Spark application that has been encountering out-of-memory errors during execution. By reviewing the Spark driver logs, the engineer notices multiple "GC overhead limit exceeded" messages.
Which action should the engineer take to resolve this issue?
Which action should the engineer take to resolve this issue?
Suggested Answer: C Vote an answer
Comprehensive and Detailed Explanation From Exact Extract:
The message"GC overhead limit exceeded"typically indicates that the JVM is spending too much time in garbage collection with little memory recovery. This suggests that the driver or executor is under-provisioned in memory.
The most effective remedy is to increase the driver memory using:
--driver-memory 4g
This is confirmed in Spark's official troubleshooting documentation:
"If you see a lot ofGC overhead limit exceedederrors in the driver logs, it's a sign that the driver is running out of memory."
-Spark Tuning Guide
Why others are incorrect:
Amay help but does not directly address the driver memory shortage.
Bis not a valid action; GC cannot be disabled.
Dincreases memory usage, worsening the problem.
The message"GC overhead limit exceeded"typically indicates that the JVM is spending too much time in garbage collection with little memory recovery. This suggests that the driver or executor is under-provisioned in memory.
The most effective remedy is to increase the driver memory using:
--driver-memory 4g
This is confirmed in Spark's official troubleshooting documentation:
"If you see a lot ofGC overhead limit exceedederrors in the driver logs, it's a sign that the driver is running out of memory."
-Spark Tuning Guide
Why others are incorrect:
Amay help but does not directly address the driver memory shortage.
Bis not a valid action; GC cannot be disabled.
Dincreases memory usage, worsening the problem.
by Page at Oct 01, 2026, 07:26 AM
0
0
0
10
Comments
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
Report Comment
Commenting
You can sign-up / login (it's free).