updatesmarklogicmlcpdata-ingestion

MarkLogic Cluster - Add data in 1st host & update in 2nd host throws error


MarkLogic setup is as follows

Data confniguration - 1 master forest on each host - 1 replica for each host on different host

We have MarkLogic cluster (3 hosts) with failover) deployed on Azure VMs

We are using MarkLogic ContentPump (MLCP) to ingest data into MarkLogic

This is what we have implemented

Now we got batch of xmls to update back to MarkLogic

With failover implementation, due to some reason 1st host is not available, so when i tried to ingest data thru 2nd host, i started getting error that record was ingested in different host, so update can't happen from here.

So i would like to know the best practices to be followed for ingestion process


Solution

  • To enable the system to reliably failover, you will also need to setup replicas for the Security, App Services & any other system database you may be using as part of your architecture.

    The reason you are unable to connect to the other hosts is that the Security database is on host 1, so you are unable to authenticate. Once that is configured for failover, you should no longer run into those issues.

    The documentation covers that setup here:

    https://docs.marklogic.com/guide/cluster/config-both-failover#id_57935