3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 133 (Attempt 0)
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 12
Input Size / Records:
1291.9 KiB / 45556
Shuffle Write Size / Records:
1144.5 KiB / 14814
Associated Job Ids:
109
DAG Visualization
digraph G { subgraph clusterstage_133 { label="Stage 133"; subgraph cluster960 { label="Scan parquet "; 395 [labelType="html" label="FileScanRDD [395]<br>takeAsList at DataFrameCommonJob.java:145"]; 396 [labelType="html" label="MapPartitionsRDD [396]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster950 { label="WholeStageCodegen (1)"; 401 [labelType="html" label="MapPartitionsRDD [401]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster947 { label="Generate"; 403 [labelType="html" label="MapPartitionsRDD [403]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster926 { label="WholeStageCodegen (2)"; 408 [labelType="html" label="MapPartitionsRDD [408]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster924 { label="Generate"; 411 [labelType="html" label="MapPartitionsRDD [411]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster915 { label="WholeStageCodegen (3)"; 414 [labelType="html" label="MapPartitionsRDD [414]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster914 { label="ShuffleQueryStage"; 417 [labelType="html" label="MapPartitionsRDD [417]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 395->396; 396->401; 401->403; 403->408; 408->411; 411->414; 414->417; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time