3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 323 (Attempt 0)
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 12
Input Size / Records:
3.3 MiB / 45556
Shuffle Write Size / Records:
3.2 MiB / 14814
Associated Job Ids:
230
DAG Visualization
digraph G { subgraph clusterstage_323 { label="Stage 323"; subgraph cluster1951 { label="Scan parquet "; 754 [labelType="html" label="FileScanRDD [754]<br>takeAsList at DataFrameCommonJob.java:145"]; 755 [labelType="html" label="MapPartitionsRDD [755]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1947 { label="WholeStageCodegen (2)"; 756 [labelType="html" label="MapPartitionsRDD [756]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1946 { label="Generate"; 757 [labelType="html" label="MapPartitionsRDD [757]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1942 { label="WholeStageCodegen (3)"; 758 [labelType="html" label="MapPartitionsRDD [758]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1941 { label="Generate"; 760 [labelType="html" label="MapPartitionsRDD [760]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1925 { label="WholeStageCodegen (4)"; 762 [labelType="html" label="MapPartitionsRDD [762]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1924 { label="ShuffleQueryStage"; 763 [labelType="html" label="MapPartitionsRDD [763]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 754->755; 755->756; 756->757; 757->758; 758->760; 760->762; 762->763; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
