3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 64 (Attempt 0)
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 12
Input Size / Records:
1291.9 KiB / 45556
Shuffle Write Size / Records:
1144.5 KiB / 14814
Associated Job Ids:
46
DAG Visualization
digraph G { subgraph clusterstage_64 { label="Stage 64"; subgraph cluster355 { label="Scan parquet "; 114 [labelType="html" label="FileScanRDD [114]<br>takeAsList at DataFrameCommonJob.java:145"]; 117 [labelType="html" label="MapPartitionsRDD [117]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster347 { label="WholeStageCodegen (1)"; 122 [labelType="html" label="MapPartitionsRDD [122]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster346 { label="Generate"; 124 [labelType="html" label="MapPartitionsRDD [124]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster342 { label="WholeStageCodegen (2)"; 127 [labelType="html" label="MapPartitionsRDD [127]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster341 { label="Generate"; 130 [labelType="html" label="MapPartitionsRDD [130]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster337 { label="WholeStageCodegen (3)"; 133 [labelType="html" label="MapPartitionsRDD [133]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster336 { label="ShuffleQueryStage"; 135 [labelType="html" label="MapPartitionsRDD [135]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 114->117; 117->122; 122->124; 124->127; 127->130; 130->133; 133->135; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
