3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 131 (Attempt 0)
Total Time Across All Tasks:
6 s
Locality Level Summary:
Process local: 12
Input Size / Records:
1291.9 KiB / 45556
Shuffle Write Size / Records:
1144.5 KiB / 14814
Associated Job Ids:
108
DAG Visualization
digraph G { subgraph clusterstage_131 { label="Stage 131"; subgraph cluster961 { label="Scan parquet "; 397 [labelType="html" label="FileScanRDD [397]<br>takeAsList at DataFrameCommonJob.java:145"]; 399 [labelType="html" label="MapPartitionsRDD [399]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster949 { label="WholeStageCodegen (1)"; 402 [labelType="html" label="MapPartitionsRDD [402]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster946 { label="Generate"; 404 [labelType="html" label="MapPartitionsRDD [404]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster940 { label="WholeStageCodegen (2)"; 409 [labelType="html" label="MapPartitionsRDD [409]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster939 { label="Generate"; 412 [labelType="html" label="MapPartitionsRDD [412]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster935 { label="WholeStageCodegen (3)"; 413 [labelType="html" label="MapPartitionsRDD [413]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster934 { label="ShuffleQueryStage"; 416 [labelType="html" label="MapPartitionsRDD [416]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 397->399; 399->402; 402->404; 404->409; 409->412; 412->413; 413->416; }
Event Timeline
Enable zooming
Tasks: 12. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
