3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 271 (Attempt 0)
Total Time Across All Tasks:
12 s
Locality Level Summary:
Process local: 12
Input Size / Records:
3.3 MiB / 45556
Shuffle Write Size / Records:
3.2 MiB / 14814
Associated Job Ids:
189
DAG Visualization
digraph G { subgraph clusterstage_271 { label="Stage 271"; subgraph cluster1648 { label="Scan parquet "; 643 [labelType="html" label="FileScanRDD [643]<br>takeAsList at DataFrameCommonJob.java:145"]; 644 [labelType="html" label="MapPartitionsRDD [644]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1644 { label="WholeStageCodegen (2)"; 645 [labelType="html" label="MapPartitionsRDD [645]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1643 { label="Generate"; 646 [labelType="html" label="MapPartitionsRDD [646]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1639 { label="WholeStageCodegen (3)"; 647 [labelType="html" label="MapPartitionsRDD [647]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1638 { label="Generate"; 648 [labelType="html" label="MapPartitionsRDD [648]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1628 { label="WholeStageCodegen (4)"; 649 [labelType="html" label="MapPartitionsRDD [649]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1626 { label="ShuffleQueryStage"; 650 [labelType="html" label="MapPartitionsRDD [650]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 643->644; 644->645; 645->646; 646->647; 647->648; 648->649; 649->650; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
