4.0.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 53 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Node local: 1
Output Size / Records:
32.2 KiB / 3
Shuffle Read Size / Records:
943.0 B / 6
Associated Job Ids:
26
DAG Visualization
digraph G { id="graph_53"; subgraph graph_stage_53 { id="graph_stage_53"; isCluster="true"; label="Stage 53"; subgraph cluster_297 { id="cluster_297"; isCluster="true"; label="AQEShuffleRead"; 110 [id="node_110" labelType="html" label="ShuffledRowRDD [110] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_294 { id="cluster_294"; isCluster="true"; label="WholeStageCodegen (4)"; 111 [id="node_111" labelType="html" label="MapPartitionsRDD [111] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_302 { id="cluster_302"; isCluster="true"; label="AQEShuffleRead"; 112 [id="node_112" labelType="html" label="ShuffledRowRDD [112] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_299 { id="cluster_299"; isCluster="true"; label="WholeStageCodegen (5)"; 113 [id="node_113" labelType="html" label="MapPartitionsRDD [113] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_289 { id="cluster_289"; isCluster="true"; label="WholeStageCodegen (6)"; 114 [id="node_114" labelType="html" label="ZippedPartitionsRDD2 [114] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 115 [id="node_115" labelType="html" label="MapPartitionsRDD [115] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_288 { id="cluster_288"; isCluster="true"; label="WriteFiles"; 116 [id="node_116" labelType="html" label="MapPartitionsRDD [116] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } } 110->111; 112->113; 111->114; 113->114; 114->115; 115->116; }
109,110
98,112
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time