3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 322 (Attempt 0)
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 12
Input Size / Records:
3.3 MiB / 45556
Shuffle Write Size / Records:
3.2 MiB / 14814
Associated Job Ids:
229
DAG Visualization
digraph G { subgraph clusterstage_322 { label="Stage 322"; subgraph cluster1923 { label="Scan parquet "; 744 [labelType="html" label="FileScanRDD [744]<br>takeAsList at DataFrameCommonJob.java:145"]; 747 [labelType="html" label="MapPartitionsRDD [747]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1919 { label="WholeStageCodegen (2)"; 750 [labelType="html" label="MapPartitionsRDD [750]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1918 { label="Generate"; 751 [labelType="html" label="MapPartitionsRDD [751]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1913 { label="WholeStageCodegen (3)"; 752 [labelType="html" label="MapPartitionsRDD [752]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1912 { label="Generate"; 753 [labelType="html" label="MapPartitionsRDD [753]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1907 { label="WholeStageCodegen (4)"; 759 [labelType="html" label="MapPartitionsRDD [759]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1905 { label="ShuffleQueryStage"; 761 [labelType="html" label="MapPartitionsRDD [761]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 744->747; 747->750; 750->751; 751->752; 752->753; 753->759; 759->761; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
