3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 443 (Attempt 0)
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 1
Input Size / Records:
541.9 KiB / 29954
Shuffle Write Size / Records:
2.3 MiB / 509382
Associated Job Ids:
294
DAG Visualization
digraph G { subgraph clusterstage_443 { label="Stage 443"; 986 [labelType="html" label="SQLExecutionRDD [986]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster2687 { label="Scan parquet "; 980 [labelType="html" label="FileScanRDD [980]<br>toJavaRDD at AbsExportExecutor.java:55"]; 981 [labelType="html" label="MapPartitionsRDD [981]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2683 { label="WholeStageCodegen (1)"; 982 [labelType="html" label="MapPartitionsRDD [982]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2682 { label="Generate"; 983 [labelType="html" label="MapPartitionsRDD [983]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2678 { label="WholeStageCodegen (2)"; 984 [labelType="html" label="MapPartitionsRDD [984]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2677 { label="DeserializeToObject"; 985 [labelType="html" label="MapPartitionsRDD [985]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2688 { label="mapPartitions"; 987 [labelType="html" label="MapPartitionsRDD [987]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2689 { label="map"; 988 [labelType="html" label="MapPartitionsRDD [988]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster2697 { label="WholeStageCodegen (1)"; 993 [labelType="html" label="MapPartitionsRDD [993]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster2696 { label="ShuffleQueryStage"; 994 [labelType="html" label="MapPartitionsRDD [994]<br>save at DataFrameCsvWriter.java:13"]; } } 980->981; 981->982; 982->983; 983->984; 984->985; 985->986; 986->987; 987->988; 988->993; 993->994; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
