Stages for All Jobs

Fair Scheduler Pools (1)

Pool Name Minimum Share Pool Weight Active Stages Running Tasks Scheduling Mode
default 1 1 0 0 FAIR

Completed Stages (292)

Stage Id  ▾ Pool Name Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write
447 default
VisualizeFile takeAsList at DataFrameCommonJob.java:145 +details
2025/11/19 10:49:05 48 ms
1/1
2.4 KiB
446 default
AnalyseSchema json at FileReader.java:93 +details
2025/11/19 10:48:19 0.1 s
1/1
2.4 KiB
445 default
DataFrameExportJob_exec_file save at DataFrameCsvWriter.java:13 +details
2025/11/17 10:03:10 0.4 s
1/1
6.6 MiB2.3 MiB
443 default
DataFrameExportJob_exec_file save at DataFrameCsvWriter.java:13 +details
2025/11/17 10:03:08 1 s
1/1
541.9 KiB2.3 MiB
442 default
DataFrameExportJob_exec_file parquet at DataFrameCommonJob.java:484 +details
2025/11/17 10:03:08 11 ms
1/1
441 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/11/17 10:02:32 5 ms
1/1
59.0 B
439 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/11/17 10:02:31 24 ms
1/1
541.9 KiB
438 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/11/17 10:02:31 0.7 s
1/1
511.9 KiB59.0 B
437 default
DataFrameCommonJob_dataExec parquet at DataFrameCommonJob.java:484 +details
2025/11/17 10:02:31 7 ms
1/1
436 default
DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:484 +details
2025/11/17 10:02:31 11 ms
1/1
435 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/11/17 10:02:00 4 ms
1/1
59.0 B
433 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/11/17 10:01:59 24 ms
1/1
541.9 KiB
432 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/11/17 10:01:59 0.7 s
1/1
511.9 KiB59.0 B
431 default
DataFrameCommonJob_dataExec parquet at DataFrameCommonJob.java:484 +details
2025/11/17 10:01:59 10 ms
1/1
430 default
DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:484 +details
2025/11/17 10:01:59 9 ms
1/1
429 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/11/17 10:01:40 5 ms
1/1
59.0 B
427 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/11/17 10:01:39 23 ms
1/1
541.9 KiB
426 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/11/17 10:01:39 0.9 s
1/1
511.9 KiB59.0 B
425 default
DataFrameCommonJob_dataExec parquet at DataFrameCommonJob.java:484 +details
2025/11/17 10:01:39 7 ms
1/1
424 default
DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:484 +details
2025/11/17 10:01:38 7 ms
1/1
423 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/11/17 10:00:42 6 ms
1/1
59.0 B
421 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/11/17 10:00:42 44 ms
1/1
541.9 KiB
420 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/11/17 10:00:42 12 ms
1/1
44.4 KiB59.0 B
419 default
DataFrameCommonJob_dataExec parquet at DataFrameCommonJob.java:484 +details
2025/11/17 10:00:42 7 ms
1/1
418 default
DataFrameCommonJob_dataExecSummary parquet at DataFrameCommonJob.java:484 +details
2025/11/17 10:00:42 10 ms
1/1
417 default
DataFrameCommonJob_checkParquetJsonOrBinaryOncreation parquet at DataFrameCommonJob.java:484 +details
2025/11/17 09:59:51 27 ms
1/1
416 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:26 26 ms
4/4
1994.0 B
411 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:26 10 ms
1/1
160.0 B
406 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:26 2 s
8/8
113.2 MiB
402 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:26 0.9 s
8/8
113.2 MiB
398 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:25 18 ms
2/2
1143.0 B
393 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:25 13 ms
1/1
84.0 B
388 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:25 0.9 s
4/4
60.3 MiB
384 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:25 1 s
4/4
60.3 MiB
380 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:24 0.8 s
1/1
15.1 MiB
376 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:24 0.9 s
1/1
15.1 MiB
372 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:23 3 s
13/13
188.4 MiB2.1 KiB
368 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:23 2 s
13/13
188.4 MiB1227.0 B
364 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:20 0.5 s
13/13
3.2 MiB150.4 KiB
362 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:20 0.6 s
13/13
3.2 MiB150.4 KiB
360 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:20 0.5 s
13/13
3.2 MiB19.8 KiB
358 default
broadcast exchange (runId 69832abd-e8e4-4e45-b2a0-aa8a1a21a811) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:20 0.2 s
13/13
1011.3 KiB
356 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:19 0.7 s
13/13
3.2 MiB25.0 KiB
354 default
broadcast exchange (runId 0bbb00a9-9625-4ea7-b5f4-0f5242ab7383) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:19 0.3 s
13/13
1011.3 KiB
352 default
broadcast exchange (runId 783b5fe1-d6e3-4da3-b4ba-0e4e8a1d0ede) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:19 0.2 s
13/13
1011.3 KiB
350 default
broadcast exchange (runId ae56f49a-b485-4147-9600-23f15cc743b5) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:19 0.2 s
13/13
1011.3 KiB
348 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:19 97 ms
8/8
570.0 KiB
346 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:18 54 ms
4/4
307.6 KiB
344 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:18 20 ms
1/1
77.0 KiB
342 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:17 0.9 s
7/7
280.0 KiB1011.3 KiB
341 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:17 0.9 s
7/7
280.0 KiB1011.3 KiB
340 default
broadcast exchange (runId f392c52e-a96d-4fb3-b6a6-f8543067b735) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:17 0.3 s
10/10
1999.4 KiB
339 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:17 6 s
15/15
119.3 MiB188.4 MiB
338 default
broadcast exchange (runId eb010f27-b487-47fc-b30b-6c877baf4366) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:17 0.4 s
13/13
2.4 MiB
336 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:17 1 s
7/7
280.0 KiB1011.3 KiB
335 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:17 3 s
12/12
3.3 MiB3.2 MiB
334 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:16 1 s
7/7
280.0 KiB1011.3 KiB
333 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:16 1 s
7/7
280.0 KiB954.6 KiB
332 default
broadcast exchange (runId de81fed7-b80c-44c8-9d5a-d1d94a96f281) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:16 0.5 s
12/12
1756.2 KiB
331 default
broadcast exchange (runId 412ce78a-3ad1-4fa5-bf4f-cc42007afd77) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:16 0.6 s
10/10
1999.4 KiB
330 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:16 7 s
15/15
119.3 MiB188.4 MiB
329 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:16 4 s
12/12
3.3 MiB3.2 MiB
328 default
broadcast exchange (runId ad086a54-e057-48a4-8e26-12896fe20fcd) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:16 0.5 s
10/10
1999.4 KiB
327 default
broadcast exchange (runId 94972f68-c664-4d55-9f69-186806dbb984) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:16 0.7 s
10/10
1999.4 KiB
326 default
broadcast exchange (runId 91aa4c28-09c4-4740-b4b4-9abb10e807c9) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:16 0.3 s
12/12
1756.2 KiB
325 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:16 7 s
15/15
119.3 MiB188.4 MiB
324 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:16 7 s
15/15
119.3 MiB188.4 MiB
323 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:16 3 s
12/12
3.3 MiB3.2 MiB
322 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:16 3 s
12/12
3.3 MiB3.2 MiB
321 default
broadcast exchange (runId 6a1d91a6-51d1-4b45-b8f3-05a07897554f) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:16 0.2 s
12/12
1756.2 KiB
320 default
broadcast exchange (runId e6c90701-c211-466a-9205-4e2e7b0984a0) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:16 0.2 s
12/12
1756.2 KiB
319 default
broadcast exchange (runId 107193a2-892d-4f8e-8d4e-d73c438e9047) $anonfun$withThreadLocalCaptured$1 at <unknown>:0 +details
2025/11/07 08:59:15 0.2 s
12/12
1756.2 KiB
318 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:15 1 s
12/12
3.3 MiB2.4 MiB
317 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:15 24 ms
1/1
316 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:15 8 ms
1/1
315 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:15 19 ms
1/1
314 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:15 7 ms
1/1
313 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:15 10 ms
1/1
312 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 14 ms
1/1
311 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 41 ms
1/1
310 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 7 ms
1/1
309 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 45 ms
1/1
308 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 13 ms
1/1
307 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 8 ms
1/1
306 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 60 ms
1/1
305 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 29 ms
1/1
304 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 28 ms
1/1
303 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 8 ms
1/1
302 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 6 ms
1/1
301 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 10 ms
1/1
300 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 7 ms
1/1
299 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 6 ms
1/1
298 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 9 ms
1/1
297 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 9 ms
1/1
296 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 18 ms
1/1
295 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:14 31 ms
1/1
294 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:04 25 ms
6/6
269.3 KiB
293 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:04 28 ms
4/4
186.6 KiB
292 default
DataFrameCommonJob_dataExecOnCreation takeAsList at DataFrameCommonJob.java:145 +details
2025/11/07 08:59:04 82 ms
1/1
49.7 KiB
291 default
DataFrameCommonJob_dataExecOnCreation parquet at CommonJob.java:47 +details
2025/11/07 08:59:04 8 ms
1/1

Skipped Stages (150)

Stage Id  ▾ Pool Name Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write
444 default
save at DataFrameCsvWriter.java:13 +details
Unknown Unknown
0/1
440 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/1
434 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/1
428 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/1
422 default
count at ColumnStatJob.java:47 +details
Unknown Unknown
0/1
415 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
414 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
413 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
412 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
410 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
409 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
408 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
407 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
405 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
404 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
403 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
401 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
400 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
399 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
397 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
396 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
395 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
394 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
392 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
391 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
390 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
389 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
387 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
386 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
385 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
383 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
382 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
381 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
379 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
378 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
377 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
375 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
374 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
373 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
371 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
370 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
369 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
367 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
366 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
365 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
363 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
361 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
359 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
357 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
355 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
353 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
351 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
349 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
347 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
345 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
343 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
337 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
289 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
288 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
287 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
285 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
284 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
283 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
281 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/15
280 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
279 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
277 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
275 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/12
263 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
262 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
260 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
257 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/2
255 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/2
251 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/2
249 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/2
243 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/2
241 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/2
239 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/2
236 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/2
234 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/2
232 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
231 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/9
227 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/9
225 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/20
224 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/9
220 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/9
217 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/9
208 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
207 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
205 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
204 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
202 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
201 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
199 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
196 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
195 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
193 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/13
192 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
190 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7
188 default
takeAsList at DataFrameCommonJob.java:145 +details
Unknown Unknown
0/7

Failed Stages (6)

Stage Id  ▾ Pool Name Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write Failure Reason
40 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/11/03 07:27:17 58 s
0/1 (1 killed: Stage cancelled)
661.0 KiBJob 38 cancelled part of cancelled job group 01cde694-cea8-4964-9a78-e2d503eca37e
38 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/11/03 07:27:17 58 s
0/7 (7 killed: Stage cancelled)
2.7 MiBJob 36 cancelled part of cancelled job group 108478e9-2ee3-48a1-b148-8b5468663cb8
20 default
DataFrameCommonJob_dataExec takeAsList at DataFrameCommonJob.java:145 +details
2025/11/03 07:22:12 45 ms
0/1 (1 failed)
661.0 KiBJob aborted due to stage failure: Task 0 in stage 20.0 failed 1 times, most recent failure: Lost task 0.0 in stage 20.0 (TID 44, 926ab5ff208a, executor driver): org.apache.spark.SparkException: Failed to execute user defined function(UDFRegistration$$Lambda$1415/0x00007fb9bbb79040: (struct&lt;COL_78E288B2_7753_442C_B16A_E52F4C57C5CF:string,COL_4584417F_CE48_42EF_8E60_88E860F0CAB7:string,COL_BD1FBF2C_C36D_491D_AFB1_B342D040D62C:string,COL_9195E6E1_98EE_4D9B_B713_80A990F20E9F:string,COL_26ABE631_4CA5_4C98_9C8A_D974C21257D9:string,COL_AFB4434B_0574_4367_A593_DC9A5CD29825:string,COL_3EFD2E5B_CBA3_4894_AC4A_D1DE405D734D:string&gt;) =&gt; int) +details
12 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/11/03 07:22:06 0.1 s
0/7 (7 failed)
2.7 MiBJob aborted due to stage failure: Task 3 in stage 12.0 failed 1 times, most recent failure: Lost task 3.0 in stage 12.0 (TID 27, 926ab5ff208a, executor driver): org.apache.spark.SparkException: Failed to execute user defined function(UDFRegistration$$Lambda$4506/0x00007fb93bd57040: (struct&lt;COL_78E288B2_7753_442C_B16A_E52F4C57C5CF:string,COL_4584417F_CE48_42EF_8E60_88E860F0CAB7:string,COL_BD1FBF2C_C36D_491D_AFB1_B342D040D62C:string,COL_9195E6E1_98EE_4D9B_B713_80A990F20E9F:string,COL_26ABE631_4CA5_4C98_9C8A_D974C21257D9:string,COL_AFB4434B_0574_4367_A593_DC9A5CD29825:string,COL_3EFD2E5B_CBA3_4894_AC4A_D1DE405D734D:string&gt;) =&gt; int) +details
8 default
DataFrameCommonJob_dataExecSummary count at ColumnStatJob.java:47 +details
2025/11/03 07:16:29 0.2 s
0/7 (7 failed)
2.7 MiBJob aborted due to stage failure: Task 6 in stage 8.0 failed 1 times, most recent failure: Lost task 6.0 in stage 8.0 (TID 20, 926ab5ff208a, executor driver): org.apache.spark.SparkException: Failed to execute user defined function(UDFRegistration$$Lambda$4511/0x00007fb93bd71040: (string, struct&lt;COL_78E288B2_7753_442C_B16A_E52F4C57C5CF:string,COL_4584417F_CE48_42EF_8E60_88E860F0CAB7:string,COL_BD1FBF2C_C36D_491D_AFB1_B342D040D62C:string,COL_9195E6E1_98EE_4D9B_B713_80A990F20E9F:string,COL_26ABE631_4CA5_4C98_9C8A_D974C21257D9:string,COL_AFB4434B_0574_4367_A593_DC9A5CD29825:string,COL_3EFD2E5B_CBA3_4894_AC4A_D1DE405D734D:string&gt;) =&gt; double) +details
4 default
PersistFrame parquet at PersistJob.java:35 +details
2025/11/03 07:16:18 0.6 s
0/7 (6 failed) (1 killed: Stage cancelled)
3.5 MiBJob aborted due to stage failure: Task 4 in stage 4.0 failed 1 times, most recent failure: Lost task 4.0 in stage 4.0 (TID 8, 926ab5ff208a, executor driver): org.apache.spark.SparkException: Failed to execute user defined function(UDFRegistration$$Lambda$4511/0x00007fb93bd71040: (string, struct&lt;COL_78E288B2_7753_442C_B16A_E52F4C57C5CF:string,COL_4584417F_CE48_42EF_8E60_88E860F0CAB7:string,COL_BD1FBF2C_C36D_491D_AFB1_B342D040D62C:string,COL_9195E6E1_98EE_4D9B_B713_80A990F20E9F:string,COL_26ABE631_4CA5_4C98_9C8A_D974C21257D9:string,COL_AFB4434B_0574_4367_A593_DC9A5CD29825:string,COL_3EFD2E5B_CBA3_4894_AC4A_D1DE405D734D:string&gt;) =&gt; double) +details