Unable to run Elly on Mapr Yarn cluster

[SavageReader]

When trying to start the Julia cluster manager on a MapR Yarn cluster I get the following error:
ERROR: Elly.HadoopRpcException(2,"DIGEST-MD5: digest response format
violation. Mismatched URI: default/; expecting: null/default")
in recv_rpc_message at /home/inikolae/.julia/v0.4/Elly/src/rpc.jl:256
in sasl_auth at /home/inikolae/.julia/v0.4/Elly/src/sasl.jl:156
in conditional_sasl_auth at /home/inikolae/.julia/v0.4/Elly/src/sasl.jl:105
in connect at /home/inikolae/.julia/v0.4/Elly/src/rpc.jl:193
in send_rpc_message at /home/inikolae/.julia/v0.4/Elly/src/rpc.jl:228
in call_method at /home/inikolae/.julia/v0.4/Elly/src/rpc.jl:279
[inlined code] from
/home/inikolae/.julia/v0.4/Elly/src/api_yarn_appmaster.jl:60
in register at /home/inikolae/.julia/v0.4/Elly/src/api_yarn_appmaster.jl:103
in submit at /home/inikolae/.julia/v0.4/Elly/src/api_yarn_appmaster.jl:91
in call at /home/inikolae/.julia/v0.4/Elly/src/cluster_manager.jl:28

The cluster functions well otherwise and the cluster manager is given the right address and port numbers.

[tanmaykm]

Possibly a difference in authentication protocol that's not handled. I don't have a MapR installation readily available. Will set one up locally to check this out. Thanks for raising the issue.

[tanmaykm]

I can confirm this to be happening on a local setup of mapr sandbox.

Changing the digest-uri to "null/default" as expected by mapr avoids this problem. But I'm not sure why mapr is expecting this particular value.

Elly constructs the digest-uri as protocol/serverid. This seems correct as per rfc2831.

Is there any way we can know how the mapr server constructs this field?

[SavageReader]

Thanks for looking into it. I guess two possible ways would be to check the MapR source code (I don't know how much work that would be) or to create a bug report at MapR, since you say that you followed the protocol RFC.

[rvelfre]

Hello guys,

I'm currently having the same kind of error when I try to execute a Spark application from a remote machine to a MapR cluster (the remote is not part of the cluster).

I would like to change the digest MD5 URI value but I can't find where it is set up...

Could you please help me :)

Thanks !

[tanmaykm]

@HERVEKIRK it is in the digmd5_respond method in file sasl.jl here

Elly.jl/src/sasl.jl

Line 69 in 726d723

digesturi = protocol * "/" * serverid