3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 203 (Attempt 0)
Total Time Across All Tasks:
9 s
Locality Level Summary:
Process local: 12
Input Size / Records:
3.3 MiB / 45556
Shuffle Write Size / Records:
3.2 MiB / 14814
Associated Job Ids:
126
DAG Visualization
digraph G { subgraph clusterstage_203 { label="Stage 203"; subgraph cluster1042 { label="Scan parquet "; 362 [labelType="html" label="FileScanRDD [362]<br>takeAsList at DataFrameCommonJob.java:145"]; 363 [labelType="html" label="MapPartitionsRDD [363]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1038 { label="WholeStageCodegen (2)"; 364 [labelType="html" label="MapPartitionsRDD [364]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1037 { label="Generate"; 365 [labelType="html" label="MapPartitionsRDD [365]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1033 { label="WholeStageCodegen (3)"; 366 [labelType="html" label="MapPartitionsRDD [366]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1032 { label="Generate"; 367 [labelType="html" label="MapPartitionsRDD [367]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1022 { label="WholeStageCodegen (4)"; 368 [labelType="html" label="MapPartitionsRDD [368]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1020 { label="ShuffleQueryStage"; 369 [labelType="html" label="MapPartitionsRDD [369]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 362->363; 363->364; 364->365; 365->366; 366->367; 367->368; 368->369; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
