3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 63 (Attempt 0)
Total Time Across All Tasks:
8 s
Locality Level Summary:
Process local: 12
Input Size / Records:
1291.9 KiB / 45556
Shuffle Write Size / Records:
1144.5 KiB / 14814
Associated Job Ids:
45
DAG Visualization
digraph G { subgraph clusterstage_63 { label="Stage 63"; subgraph cluster353 { label="Scan parquet "; 116 [labelType="html" label="FileScanRDD [116]<br>takeAsList at DataFrameCommonJob.java:145"]; 119 [labelType="html" label="MapPartitionsRDD [119]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster331 { label="WholeStageCodegen (1)"; 120 [labelType="html" label="MapPartitionsRDD [120]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster328 { label="Generate"; 123 [labelType="html" label="MapPartitionsRDD [123]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster321 { label="WholeStageCodegen (2)"; 126 [labelType="html" label="MapPartitionsRDD [126]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster318 { label="Generate"; 129 [labelType="html" label="MapPartitionsRDD [129]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster314 { label="WholeStageCodegen (3)"; 132 [labelType="html" label="MapPartitionsRDD [132]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster313 { label="ShuffleQueryStage"; 134 [labelType="html" label="MapPartitionsRDD [134]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 116->119; 119->120; 120->123; 123->126; 126->129; 129->132; 132->134; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
