解决:ERROR: Cannot set priority of datanode process 10603

这篇具有很好参考价值的文章主要介绍了解决:ERROR: Cannot set priority of datanode process 10603。希望对大家有所帮助。如果存在错误或未考虑完全的地方,请大家不吝赐教,您也可以点击"举报违法"按钮提交疑问。

WARNING: Use of this script to start HDFS daemons is deprecated.
WARNING: Attempting to execute replacement "hdfs --daemon start" instead.
ERROR: Cannot set priority of datanode process 10603

场景:启动datanode出现如上错误

查看日志:

JSVC_HOME is not set or set incorrectly. jsvc is required to run secure
or privileged daemons. Please download and install jsvc from 
http://archive.apache.org/dist/commons/daemon/binaries/ 
and set JSVC_HOME to the directory containing the jsvc binary.
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 63373
max locked memory       (kbytes, -l) unlimited
max memory size         (kbytes, -m) unlimited
open files                      (-n) 65536
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited

修改文件配置:

vi hadoop-env.sh 
#export HDFS_DATANODE_SECURE_USER=root

成功启动
官网解释:
Secure DataNode
Because the DataNode data transfer protocol does not use the Hadoop RPC framework, DataNodes must authenticate themselves using privileged ports which are specified by dfs.datanode.address and dfs.datanode.http.address. This authentication is based on the assumption that the attacker won’t be able to get root privileges on DataNode hosts.

When you execute the hdfs datanode command as root, the server process binds privileged ports at first, then drops privilege and runs as the user account specified by HDFS_DATANODE_SECURE_USER. This startup process uses the jsvc program installed to JSVC_HOME. You must specify HDFS_DATANODE_SECURE_USER and JSVC_HOME as environment variables on start up (in hadoop-env.sh).

As of version 2.6.0, SASL can be used to authenticate the data transfer protocol. In this configuration, it is no longer required for secured clusters to start the DataNode as root using jsvc and bind to privileged ports. To enable SASL on data transfer protocol, set dfs.data.transfer.protection in hdfs-site.xml. A SASL enabled DataNode can be started in secure mode in following two ways: 1. Set a non-privileged port for dfs.datanode.address. 1. Set dfs.http.policy to HTTPS_ONLY or set dfs.datanode.http.address to a privileged port and make sure the HDFS_DATANODE_SECURE_USER and JSVC_HOME environment variables are specified properly as environment variables on start up (in hadoop-env.sh).

In order to migrate an existing cluster that used root authentication to start using SASL instead, first ensure that version 2.6.0 or later has been deployed to all cluster nodes as well as any external applications that need to connect to the cluster. Only versions 2.6.0 and later of the HDFS client can connect to a DataNode that uses SASL for authentication of data transfer protocol, so it is vital that all callers have the correct version before migrating. After version 2.6.0 or later has been deployed everywhere, update configuration of any external applications to enable SASL. If an HDFS client is enabled for SASL, then it can connect successfully to a DataNode running with either root authentication or SASL authentication. Changing configuration for all clients guarantees that subsequent configuration changes on DataNodes will not disrupt the applications. Finally, each individual DataNode can be migrated by changing its configuration and restarting. It is acceptable to have a mix of some DataNodes running with root authentication and some DataNodes running with SASL authentication temporarily during this migration period, because an HDFS client enabled for SASL can connect to both.文章来源地址https://www.toymoban.com/news/detail-715929.html

到了这里,关于解决:ERROR: Cannot set priority of datanode process 10603的文章就介绍完了。如果您还想了解更多内容,请在右上角搜索TOY模板网以前的文章或继续浏览下面的相关文章,希望大家以后多多支持TOY模板网!

本文来自互联网用户投稿,该文观点仅代表作者本人,不代表本站立场。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如若转载,请注明出处: 如若内容造成侵权/违法违规/事实不符,请点击违法举报进行投诉反馈,一经查实,立即删除!

领支付宝红包 赞助服务器费用

相关文章

  • 启动Hadoop集群,出现Cannot set priority of nodemanager(resourcemanager) process xxx问题

    (不感兴趣可以跳过背景介绍) 配置 在安装hive的过程中,初始化数据库成功后(mysql),输入 命令: ./bin/hive 启动hive时出错(忘记截图了)。后发现原因是hive3.x仅支持JDK 1.8,并不支持openJDK 11,尽管hadoop3.3.x是支持JDK 1.8和openJDK 11的。当降低JDK版本后启动集群,便出现启动

    2024年02月01日
    浏览(37)
  • Hadoop在启动yarn时报错:Cannot set priority of resourcemanager process xxxxx

    着急看解决方法的请直接奔文末。 今天刚开始弄Hadoop,启动完namenode和hadoop之后,开始启动yarn,结果直接报错了: Cannot set priority of resourcemanager process 93826 翻译过来就是说:无法设置resourcemanager进程的优先级(大概)。 然后就开始百度,stackOverflow上有说是没有设置ssh免密登

    2023年04月12日
    浏览(27)
  • Cannot set properties of null (setting ‘onclick‘)问题解决方案

    个人学习过程中遇到“Uncaught TypeError: Cannot set properties of null (setting ‘onclick’)”问题,分享下 html代码: 运行结果: 问题原因:getElementById方法无法找到所写的id名(空格也被认为是id名的一部分了) 修改前代码: 修改后: 运行成功!

    2024年02月16日
    浏览(40)
  • 【JS】如何解决Cannot set properties of undefined

    TypeError: Cannot set properties of undefined 类型错误:无法设置未定义的属性 问题解析 当前的是当前对象或者数组是undefined,但是却用来引用属性或者索引 比如下面两种情况 或者是当前的value值不是我们显式声明的undefined,而是运算之后得到undefined,之后我们再去用它 解决方案 问

    2024年02月16日
    浏览(55)
  • Uncaught TypeError: Cannot set properties of null (setting ‘innerText‘)解决方法

    昨天用js写了一个随机抽奖系统出现了Uncaught TypeError: Cannot set properties of null (setting \\\'innerText\\\') 这个报错意思是无法读取nll属性的\\\'innerText\\\',即找不到你想要将所写的HTML代码插入地方 原因: 浏览器加载页面是从上往下,会将HTML文档解析为一个DOM树,当执行到js代码块中的innet

    2024年02月16日
    浏览(34)
  • Uncaught TypeError TypeError: Cannot set properties of null (setting ‘onclick‘)的解决办法

    我下面用代码示例一下。 这个代码你读一下,好像可以实现我们想要的效果,实现点击相关的div盒子实现其背景颜色变颜色的效果,但是一运行下来,在调试控制台里就会出现Uncaught TypeError TypeError: Cannot set properties of null (setting \\\'onclick\\\')这样的报错------未捕获的类型错误: 无

    2024年02月02日
    浏览(29)
  • JS常见报错解决办法:Uncaught TypeError: Cannot set properties of null (setting ‘innerHTML‘)

    Uncaught TypeError: Cannot set properties of null (setting ‘innerHTML’)意思是, 未捕获类型错误:无法设置空属性(设置“innerHTML”), 也就是说**.innerHTM**前的对象内容是空或null。 1、举个例子,我需要用js渲染HTML网页的数据。 报错: Uncaught TypeError: Cannot set properties of null (setting ‘in

    2024年02月16日
    浏览(34)
  • 【Vite】Vite切换版本(Vite+vue3)报错 [vite] Internal server error: Cannot set property ‘id‘ of undefined

    Vue3+vite的项目,在全局安装新的Vite版本后,一直报下图错误。 报错信息 通过很多方式没有解决,最后发现是Vite版本的问题,因为Vue是从脚手架中引入的 查看package.json和package.lock.json区别 修改 将 package.json 中vite的版本号固定后,安装( npm install )发现仍有问题 最终解决 查

    2024年02月16日
    浏览(37)
  • centos7开机报错bash:cannot set terminal process group (-1):Inappropriate ioctl for device的解决过程

    前几日服务器突然无法正常连接,一直没时间处理,今日进入机房查看发现服务器已重启,停在了启动过程中,报错如图: 大致的意思是检查文件系统时到某个文件出错了,异常的文件是 /dev/mapper/vg_hljtnits-lv_home 报错信息如下: bash:cannot set terminal process group (-1):Inappropriate

    2024年02月10日
    浏览(79)
  • vue 启动项目报错:TypeError: Cannot set property ‘parent‘ of undefined异常解决

    场景:从git上面拉下来一个项目 npm i 下载完依赖以后 npm run serve 去运行项目的时候 报错TypeError: Cannot set property ‘parent’ of undefined 如图所示 原因:首先排查发现判断得出是less解析失败导致 但是经过长时间的查询解决方案发现是因为vue版本在下载包的过程中由2.6.10升级为2

    2024年02月12日
    浏览(42)

觉得文章有用就打赏一下文章作者

支付宝扫一扫打赏

博客赞助

微信扫一扫打赏

请作者喝杯咖啡吧~博客赞助

支付宝扫一扫领取红包,优惠每天领

二维码1

领取红包

二维码2

领红包