3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 4 (Attempt 0)
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 7
Input Size / Records:
3.5 MiB / 24576
Associated Job Ids:
4
DAG Visualization
digraph G { subgraph clusterstage_4 { label="Stage 4"; subgraph cluster56 { label="Scan parquet "; 21 [labelType="html" label="FileScanRDD [21]<br>parquet at PersistJob.java:35"]; 22 [labelType="html" label="MapPartitionsRDD [22]<br>parquet at PersistJob.java:35"]; } subgraph cluster52 { label="WholeStageCodegen (2)"; 23 [labelType="html" label="MapPartitionsRDD [23]<br>parquet at PersistJob.java:35"]; } subgraph cluster49 { label="BroadcastNestedLoopJoin"; 24 [labelType="html" label="MapPartitionsRDD [24]<br>parquet at PersistJob.java:35"]; 25 [labelType="html" label="MapPartitionsRDD [25]<br>parquet at PersistJob.java:35"]; } subgraph cluster46 { label="WholeStageCodegen (3)"; 26 [labelType="html" label="MapPartitionsRDD [26]<br>parquet at PersistJob.java:35"]; } } 21->22; 22->23; 23->24; 24->25; 25->26; }
Event Timeline
Enable zooming
Tasks: 7. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time