3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 329 (Attempt 0)
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 12
Input Size / Records:
3.3 MiB / 45556
Shuffle Write Size / Records:
3.2 MiB / 14814
Associated Job Ids:
236
DAG Visualization
digraph G { subgraph clusterstage_329 { label="Stage 329"; subgraph cluster2003 { label="Scan parquet "; 776 [labelType="html" label="FileScanRDD [776]<br>takeAsList at DataFrameCommonJob.java:145"]; 777 [labelType="html" label="MapPartitionsRDD [777]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1996 { label="WholeStageCodegen (2)"; 778 [labelType="html" label="MapPartitionsRDD [778]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1995 { label="Generate"; 779 [labelType="html" label="MapPartitionsRDD [779]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1986 { label="WholeStageCodegen (3)"; 780 [labelType="html" label="MapPartitionsRDD [780]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1985 { label="Generate"; 781 [labelType="html" label="MapPartitionsRDD [781]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1969 { label="WholeStageCodegen (4)"; 790 [labelType="html" label="MapPartitionsRDD [790]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1964 { label="ShuffleQueryStage"; 791 [labelType="html" label="MapPartitionsRDD [791]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 776->777; 777->778; 778->779; 779->780; 780->781; 781->790; 790->791; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
