performanceloggingmarklogicmlcp

MarkLogic Content Pump (MLCP) - Performance - Logging details

So we are using MLCP to ingest XML data (in Zip file) into MarkLogic.

It is working as expected.

When i looked at output on screen, i see something weird.

For 1st 25%, it is taking 7 minutes and for rest 1 minute, Is it real or it is something to do with logging it on later stage? BTW, after 0% - 25%, it take sometime for output available on screen.

I am missing anything while mlcp execution? OR it takes more time in beginning and then it executes faster?

enter image description here

Solution

  • I prefer following settings while using mlcp:

    1. Disable Locking or locking = off
    2. Disable Journaling or journaling = off
    3. Adjust max_split_size and thread_count in mlcp options. I used 1000 and 12 respectively for optimal performance in my setup.

    Hope this gives you some pointers.