| Stage Id ▾ | Pool Name | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write |
|---|---|---|---|---|---|---|---|---|---|
| 46 | default | RePersistFrame csv at DataFrameCommonJob.java:326 org.apache.spark.sql.DataFrameReader.csv(DataFrameReader.scala:726) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvFile(DataFrameCommonJob.java:326) com.adb.hdh.spark.job.impl.DataFrameCommonJob.readCsvAndGetDataSet(DataFrameCommonJob.java:195) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadCsv(DataFrameStructuredLoaderJob.java:268) com.adb.hdh.spark.job.impl.DataFrameStructuredLoaderJob.loadUet(DataFrameStructuredLoaderJob.java:69) com.adb.hdh.spark.job.impl.CommonJob.getDataFrame(CommonJob.java:27) com.adb.hdh.spark.job.impl.PersistJob.exec(PersistJob.java:19) com.adb.hdh.spark.jobs.SparkJobRunnerService.runJob(SparkJobRunnerService.java:111) com.adb.hdh.spark.jobs.AbstractJobThread.run(AbstractJobThread.java:47) java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) java.base/java.util.concurrent.FutureTask.run(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) java.base/java.lang.Thread.run(Unknown Source) | 2025/11/06 09:47:37 | 38 ms |
1/1
| 68.0 KiB |
