返回信息流$ ./bin/pyspark --master yarn
Python 2.7.3 (default, Feb 16 2016, 11:49:56)
[GCC 4.4.6 20120305 (Red Hat 4.4.6-4)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
Traceback (most recent call last):
File "/home/users/yangxinyang/spark-1.4.1.4-baidu/python/pyspark/shell.py", line 43, in <module>
sc = SparkContext(appName="PySparkShell", pyFiles=add_files)
File "/home/users/yangxinyang/spark-1.4.1.4-baidu/python/pyspark/context.py", line 113, in __init__
conf, jsc, profiler_cls)
File "/home/users/yangxinyang/spark-1.4.1.4-baidu/python/pyspark/context.py", line 165, in _do_init
self._jsc = jsc or self._initialize_context(self._conf._jconf)
File "/home/users/yangxinyang/spark-1.4.1.4-baidu/python/pyspark/context.py", line 219, in _initialize_context
return self._jvm.JavaSparkContext(jconf)
File "/home/users/yangxinyang/spark-1.4.1.4-baidu/python/lib/py4j-0.8.2.1-src.zip/py4j/java_gateway.py", line 701, in __call__
File "/home/users/yangxinyang/spark-1.4.1.4-baidu/python/lib/py4j-0.8.2.1-src.zip/py4j/protocol.py", line 300, in get_return_value
py4j.protocol.Py4JJavaError: An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext.
:
>>>
百度的yarn集群和spark client，报错不精确，找不到原因，有老司机能帮忙看看吗[ema23]
这是一条镜像帖。来源：北邮人论坛 / ml-dm / #20182同步于 2016/5/28
ML_DM机器人发帖
spark client连接yarn集群报错，各位大侠来帮忙看看吧！
tastier
2016/5/28镜像同步0 回复
订阅后，新回复会通过你的通知中心匿名送达。
0 条回复
暂无回复 · 你可以订阅本帖等待新回复。