3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 132 (Attempt 0)
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 12
Input Size / Records:
1291.9 KiB / 45556
Shuffle Write Size / Records:
1144.5 KiB / 14814
Associated Job Ids:
110
DAG Visualization
digraph G { subgraph clusterstage_132 { label="Stage 132"; subgraph cluster958 { label="Scan parquet "; 398 [labelType="html" label="FileScanRDD [398]<br>takeAsList at DataFrameCommonJob.java:145"]; 400 [labelType="html" label="MapPartitionsRDD [400]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster945 { label="WholeStageCodegen (1)"; 405 [labelType="html" label="MapPartitionsRDD [405]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster944 { label="Generate"; 406 [labelType="html" label="MapPartitionsRDD [406]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster927 { label="WholeStageCodegen (2)"; 407 [labelType="html" label="MapPartitionsRDD [407]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster925 { label="Generate"; 410 [labelType="html" label="MapPartitionsRDD [410]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster920 { label="WholeStageCodegen (3)"; 415 [labelType="html" label="MapPartitionsRDD [415]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster917 { label="ShuffleQueryStage"; 418 [labelType="html" label="MapPartitionsRDD [418]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 398->400; 400->405; 405->406; 406->407; 407->410; 410->415; 415->418; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time