DataStoreNotAvailableException on MDSAL data read

asked 2015-12-10 17:24:45 -0700

satyavrat gravatar image

I am working on 3 node cluster setup on Lithium SR1 release. During MDSAL read transaction getting DataStoreNotavailableException "Could not find a leader for shard member-2-shard-default-operational”.

Below is the exception log :

org.opendaylight.controller:type=DistributedConfigDatastore,Category=Shards,name=member-1-shard-default-config

karaf.log.10:2015-11-24 00:59:32,680 | WARN | t-dispatcher-155 | 183 - org.opendaylight.controller.sal-akka-raft - 1.2.0.Lithium | AbstractLeader | member-1-shard-default-config (Leader) : handleAppendEntriesReply delayed beyond election timeout, appendEntriesReply : AppendEntriesReply [success=true, logLastIndex=11912, logLastTerm=3, followerId=member-2-shard-default-config, payloadVersion=3], timeSinceLastActivity : 13941, lastApplied : 11912, commitIndex : 11912

karaf.log.10:2015-11-24 00:59:32,680 | WARN | t-dispatcher-155 | 183 - org.opendaylight.controller.sal-akka-raft - 1.2.0.Lithium | AbstractLeader | member-1-shard-default-config (Leader) : handleAppendEntriesReply delayed beyond election timeout, appendEntriesReply : AppendEntriesReply [success=true, logLastIndex=11912, logLastTerm=3, followerId=member-2-shard-default-config, payloadVersion=3], timeSinceLastActivity : 13941, lastApplied : 11912, commitIndex : 11912

karaf.log.5:2015-11-25 18:39:05,175 | WARN | t-dispatcher-201 | 183 - org.opendaylight.controller.sal-akka-raft - 1.2.0.Lithium | Leader | member-1-shard-default-config: At least 1 followers need to be active, Switching member-1-shard-default-config from Leader to IsolatedLeader

karaf.log.5:2015-11-25 18:39:05,175 | WARN | t-dispatcher-201 | 183 - org.opendaylight.controller.sal-akka-raft - 1.2.0.Lithium | Leader | member-1-shard-default-config: At least 1 followers need to be active, Switching member-1-shard-default-config from Leader to IsolatedLeader

karaf.log.8:2015-11-24 20:00:28,883 | WARN | t-dispatcher-147 | 183 - org.opendaylight.controller.sal-akka-raft - 1.2.0.Lithium | AbstractLeader | member-1-shard-default-config (Leader) : handleAppendEntriesReply delayed beyond election timeout, appendEntriesReply : AppendEntriesReply [success=true, logLastIndex=11913, logLastTerm=14, followerId=member-2-shard-default-config, payloadVersion=3], timeSinceLastActivity : 11784, lastApplied : 11913, commitIndex : 11913

karaf.log.8:2015-11-24 20:00:28,883 | WARN | t-dispatcher-147 | 183 - org.opendaylight.controller.sal-akka-raft - 1.2.0.Lithium | AbstractLeader | member-1-shard-default-config (Leader) : handleAppendEntriesReply delayed beyond election timeout, appendEntriesReply : AppendEntriesReply [success=true, logLastIndex=11913, logLastTerm=14, followerId=member-2-shard-default-config, payloadVersion=3], timeSinceLastActivity : 11784, lastApplied : 11913, commitIndex : 11913

security.log:org.apache.cxf.interceptor.security.AuthenticationException: Authentication failed for user admin : com.google.common.util.concurrent.UncheckedExecutionException: ReadFailedException{message=Error reading data for path /(urn:fujitsu:params:xml:ns:yang:security:management?revision=2015-08-10)usermgmt/user/user[{(urn:fujitsu:params:xml:ns:yang:security:management?revision=2015-08-10)name=admin}], errorList=[RpcError [message=Error reading data for path /(urn:fujitsu:params:xml:ns:yang:security:management?revision=2015-08-10)usermgmt/user/user[{(urn:fujitsu:params:xml:ns:yang:security:management?revision=2015-08-10)name=admin}], severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info=null, cause=org.opendaylight.controller.md.sal.common.api.data.DataStoreUnavailableException: Could not find a leader for shard member-1-shard-default-config. This typically happens when the system is coming up or recovering and a leader is being elected. Try again later.]]}

security.log:Caused by: ReadFailedException{message=Error reading data for path /(urn:fujitsu:params:xml:ns:yang:security:management?revision=2015-08-10)usermgmt/user/user[{(urn:fujitsu:params:xml:ns:yang:security:management?revision=2015-08-10)name=admin}], errorList=[RpcError [message=Error reading data for path /(urn:fujitsu:params:xml:ns:yang:security:management?revision=2015-08-10)usermgmt/user/user[{(urn:fujitsu:params:xml:ns:yang:security:management?revision=2015-08-10)name=admin}], severity=ERROR, errorType=APPLICATION, tag=operation-failed, applicationTag=null, info ... (more)

edit retag flag offensive close merge delete