3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 335 (Attempt 0)
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 12
Input Size / Records:
3.3 MiB / 45556
Shuffle Write Size / Records:
3.2 MiB / 14814
Associated Job Ids:
242
DAG Visualization
digraph G { subgraph clusterstage_335 { label="Stage 335"; subgraph cluster2077 { label="Scan parquet "; 810 [labelType="html" label="FileScanRDD [810]<br>takeAsList at DataFrameCommonJob.java:145"]; 811 [labelType="html" label="MapPartitionsRDD [811]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2069 { label="WholeStageCodegen (2)"; 812 [labelType="html" label="MapPartitionsRDD [812]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2068 { label="Generate"; 813 [labelType="html" label="MapPartitionsRDD [813]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2064 { label="WholeStageCodegen (3)"; 816 [labelType="html" label="MapPartitionsRDD [816]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2063 { label="Generate"; 817 [labelType="html" label="MapPartitionsRDD [817]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2044 { label="WholeStageCodegen (4)"; 819 [labelType="html" label="MapPartitionsRDD [819]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2043 { label="ShuffleQueryStage"; 822 [labelType="html" label="MapPartitionsRDD [822]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 810->811; 811->812; 812->813; 813->816; 816->817; 817->819; 819->822; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
