Spark调参过程中
保持每个task的 input + shuffle read 量在300-500M左右比较合适
The Spark UI is documented here: https://spark.apache.org/docs/3.0.1/web-ui.html文章来源：https://www.toymoban.com/news/detail-738753.html
The relevant paragraph reads:文章来源地址https://www.toymoban.com/news/detail-738753.html
- Input: Bytes read from storage in this stage
- Output: Bytes written in storage in this stage
- Shuffle read: Total shuffle bytes and records read, includes both data read locally and data read from remote executors
- Shuffle write: Bytes and records written to disk in order to be read by a shuffle in a future stage
到了这里，关于【Spark】What is the difference between Input and Shuffle Read的文章就介绍完了。如果您还想了解更多内容，请在右上角搜索TOY模板网以前的文章或继续浏览下面的相关文章，希望大家以后多多支持TOY模板网！
