4.0.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-wrkload-determination
application UI
Details for Stage 16 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Node local: 1
Shuffle Read Size / Records:
1863.0 B / 12
Shuffle Write Size / Records:
1334.0 B / 6
Associated Job Ids:
9
DAG Visualization
digraph G { id="graph_16"; subgraph graph_stage_16 { id="graph_stage_16"; isCluster="true"; label="Stage 16"; subgraph cluster_102 { id="cluster_102"; isCluster="true"; label="AQEShuffleRead"; 39 [id="node_39" labelType="html" label="ShuffledRowRDD [39] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_99 { id="cluster_99"; isCluster="true"; label="WholeStageCodegen (1)"; 40 [id="node_40" labelType="html" label="MapPartitionsRDD [40] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_107 { id="cluster_107"; isCluster="true"; label="AQEShuffleRead"; 41 [id="node_41" labelType="html" label="ShuffledRowRDD [41] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_104 { id="cluster_104"; isCluster="true"; label="WholeStageCodegen (2)"; 42 [id="node_42" labelType="html" label="MapPartitionsRDD [42] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_95 { id="cluster_95"; isCluster="true"; label="WholeStageCodegen (3)"; 43 [id="node_43" labelType="html" label="ZippedPartitionsRDD2 [43] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 44 [id="node_44" labelType="html" label="MapPartitionsRDD [44] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_94 { id="cluster_94"; isCluster="true"; label="Exchange"; 45 [id="node_45" labelType="html" label="MapPartitionsRDD [45] [Unordered]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } } 39->40; 41->42; 40->43; 42->43; 43->44; 44->45; }
38,39
34,41
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time