| Stage Id ▾ | Pool Name | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write | Failure Reason |
|---|---|---|---|---|---|---|---|---|---|---|
| 20 | default | DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 org.apache.spark.sql.Dataset.takeAsList(Dataset.scala:2927) com.adb.hdh.spark.job.impl.DataFrameCommonJob.take(DataFrameCommonJob.java:145) com.adb.hdh.spark.job.impl.ExecDataJob.exec(ExecDataJob.java:39) com.adb.hdh.spark.jobs.SparkJobRunnerService.runJob(SparkJobRunnerService.java:142) com.adb.hdh.spark.jobs.AbstractJobThread.run(AbstractJobThread.java:47) java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) java.base/java.util.concurrent.FutureTask.run(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) java.base/java.lang.Thread.run(Unknown Source) | 2025/11/03 07:22:12 | 45 ms |
0/1
(1 failed)
| 661.0 KiB | Job aborted due to stage failure: Task 0 in stage 20.0 failed 1 times, most recent failure: Lost task 0.0 in stage 20.0 (TID 44, 926ab5ff208a, executor driver): org.apache.spark.SparkException: Failed to execute user defined function(UDFRegistration$$Lambda$1415/0x00007fb9bbb79040: (struct<COL_78E288B2_7753_442C_B16A_E52F4C57C5CF:string,COL_4584417F_CE48_42EF_8E60_88E860F0CAB7:string,COL_BD1FBF2C_C36D_491D_AFB1_B342D040D62C:string,COL_9195E6E1_98EE_4D9B_B713_80A990F20E9F:string,COL_26ABE631_4CA5_4C98_9C8A_D974C21257D9:string,COL_AFB4434B_0574_4367_A593_DC9A5CD29825:string,COL_3EFD2E5B_CBA3_4894_AC4A_D1DE405D734D:string>) => int)Job aborted due to stage failure: Task 0 in stage 20.0 failed 1 times, most recent failure: Lost task 0.0 in stage 20.0 (TID 44, 926ab5ff208a, executor driver): org.apache.spark.SparkException: Failed to execute user defined function(UDFRegistration$$Lambda$1415/0x00007fb9bbb79040: (struct<COL_78E288B2_7753_442C_B16A_E52F4C57C5CF:string,COL_4584417F_CE48_42EF_8E60_88E860F0CAB7:string,COL_BD1FBF2C_C36D_491D_AFB1_B342D040D62C:string,COL_9195E6E1_98EE_4D9B_B713_80A990F20E9F:string,COL_26ABE631_4CA5_4C98_9C8A_D974C21257D9:string,COL_AFB4434B_0574_4367_A593_DC9A5CD29825:string,COL_3EFD2E5B_CBA3_4894_AC4A_D1DE405D734D:string>) => int) at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage3.processNext(Unknown Source) at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43) at org.apache.spark.sql.execution.WholeStageCodegenExec$$anon$1.hasNext(WholeStageCodegenExec.scala:729) at org.apache.spark.sql.execution.SparkPlan.$anonfun$getByteArrayRdd$1(SparkPlan.scala:345) at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsInternal$2(RDD.scala:872) at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsInternal$2$adapted(RDD.scala:872) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:349) at org.apache.spark.rdd.RDD.iterator(RDD.scala:313) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:463) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:466) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.lang.ClassCastException: class java.lang.String cannot be cast to class java.lang.Number (java.lang.String and java.lang.Number are in module java.base of loader 'bootstrap') at com.adb.hdh.spark.job.udf.ScalaToJavaConverter.getIntegerList(ScalaToJavaConverter.java:126) at com.adb.hdh.spark.job.udf.IntUdf.lambda$create$5f2c0fdc$1(IntUdf.java:29) at org.apache.spark.sql.UDFRegistration.$anonfun$register$283(UDFRegistration.scala:747) ... 17 more Driver stacktrace: |
