3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 318 (Attempt 0)
Total Time Across All Tasks:
11 s
Locality Level Summary:
Process local: 12
Input Size / Records:
3.3 MiB / 45556
Shuffle Write Size / Records:
2.4 MiB / 10637
Associated Job Ids:
225
DAG Visualization
digraph G { subgraph clusterstage_318 { label="Stage 318"; subgraph cluster1896 { label="Scan parquet "; 728 [labelType="html" label="FileScanRDD [728]<br>takeAsList at DataFrameCommonJob.java:145"]; 729 [labelType="html" label="MapPartitionsRDD [729]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1892 { label="WholeStageCodegen (1)"; 730 [labelType="html" label="MapPartitionsRDD [730]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1891 { label="Generate"; 731 [labelType="html" label="MapPartitionsRDD [731]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1887 { label="WholeStageCodegen (2)"; 732 [labelType="html" label="MapPartitionsRDD [732]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1886 { label="Generate"; 733 [labelType="html" label="MapPartitionsRDD [733]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1881 { label="WholeStageCodegen (3)"; 734 [labelType="html" label="MapPartitionsRDD [734]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1880 { label="ShuffleQueryStage"; 735 [labelType="html" label="MapPartitionsRDD [735]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 728->729; 729->730; 730->731; 731->732; 732->733; 733->734; 734->735; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
