3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 65 (Attempt 0)
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 12
Input Size / Records:
1291.9 KiB / 45556
Shuffle Write Size / Records:
1144.5 KiB / 14814
Associated Job Ids:
47
DAG Visualization
digraph G { subgraph clusterstage_65 { label="Stage 65"; subgraph cluster352 { label="Scan parquet "; 115 [labelType="html" label="FileScanRDD [115]<br>takeAsList at DataFrameCommonJob.java:145"]; 118 [labelType="html" label="MapPartitionsRDD [118]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster330 { label="WholeStageCodegen (1)"; 121 [labelType="html" label="MapPartitionsRDD [121]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster329 { label="Generate"; 125 [labelType="html" label="MapPartitionsRDD [125]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster320 { label="WholeStageCodegen (2)"; 128 [labelType="html" label="MapPartitionsRDD [128]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster319 { label="Generate"; 131 [labelType="html" label="MapPartitionsRDD [131]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster309 { label="WholeStageCodegen (3)"; 136 [labelType="html" label="MapPartitionsRDD [136]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster308 { label="ShuffleQueryStage"; 137 [labelType="html" label="MapPartitionsRDD [137]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 115->118; 118->121; 121->125; 125->128; 128->131; 131->136; 136->137; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
