Details for Job 4

Event Timeline
DAG Visualization

Failed Stages (1)

Stage Id  ▾ Pool Name Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write Failure Reason
4 default
PersistFrame parquet at PersistJob.java:35 +details
2025/11/03 07:16:18 0.6 s
0/7 (6 failed) (1 killed: Stage cancelled)
3.5 MiBJob aborted due to stage failure: Task 4 in stage 4.0 failed 1 times, most recent failure: Lost task 4.0 in stage 4.0 (TID 8, 926ab5ff208a, executor driver): org.apache.spark.SparkException: Failed to execute user defined function(UDFRegistration$$Lambda$4511/0x00007fb93bd71040: (string, struct<COL_78E288B2_7753_442C_B16A_E52F4C57C5CF:string,COL_4584417F_CE48_42EF_8E60_88E860F0CAB7:string,COL_BD1FBF2C_C36D_491D_AFB1_B342D040D62C:string,COL_9195E6E1_98EE_4D9B_B713_80A990F20E9F:string,COL_26ABE631_4CA5_4C98_9C8A_D974C21257D9:string,COL_AFB4434B_0574_4367_A593_DC9A5CD29825:string,COL_3EFD2E5B_CBA3_4894_AC4A_D1DE405D734D:string>) => double) +details