3.0.3
DC2
application UI
Jobs
Stages
Storage
Environment
Executors
SQL
Details for Stage 372 (Attempt 0)
Total Time Across All Tasks:
10 s
Locality Level Summary:
Any: 13
Shuffle Read Size / Records:
188.4 MiB / 23757575
Shuffle Write Size / Records:
2.1 KiB / 27
Associated Job Ids:
261
DAG Visualization
digraph G { subgraph clusterstage_372 { label="Stage 372"; subgraph cluster2311 { label="CustomShuffleReader"; 877 [labelType="html" label="ShuffledRowRDD [877]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2308 { label="WholeStageCodegen (10)"; 878 [labelType="html" label="MapPartitionsRDD [878]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2315 { label="CustomShuffleReader"; 879 [labelType="html" label="ShuffledRowRDD [879]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2312 { label="WholeStageCodegen (11)"; 880 [labelType="html" label="MapPartitionsRDD [880]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2307 { label="SortMergeJoin"; 881 [labelType="html" label="ZippedPartitionsRDD2 [881]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2299 { label="WholeStageCodegen (12)"; 882 [labelType="html" label="MapPartitionsRDD [882]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2298 { label="ShuffleQueryStage"; 883 [labelType="html" label="MapPartitionsRDD [883]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 877->878; 879->880; 878->881; 880->881; 881->882; 882->883; }
857,877
771,879
Event Timeline
Enable zooming
Tasks: 13. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time