Help get this topic noticed by sharing it on Twitter, Facebook, or email.

DBAmp and DataLoader

The DBAmp Replicate command runs pretty slow for us especially on large objects like Contacts, Accounts, and Opportunities. I was wondering if I can use the SF DataLoader to do the initial extract and then use the DBAmp Refresh commands to pick up any subsequent changes of the object. I plan to execute concurrent SF DataLoader connections and batch each one by a time frame like year (ie where CreatedDate > 2014-12-31T23:59:59.999Z and CreatedDate <= 2015-12-31T23:59:59.999Z). This way I can extract all the records in a shorter amount of time. Just wonder if anyone has tried this and if it was successful.

Thanks!
Mike
1 person likes
this idea
+1
Reply
  • 1. What version of DBAmp are you using ?

    2. Can you give us some idea of the performance you are seeing (i.e. this many rows took this long) ?

    3. There are many performance enhancing options for SF_Replicate that you can use instead of resorting to the data loader. Once I get the answers to #1 and #2 above, I can make a recommendation.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited kidding, amused, unsure, silly indifferent, undecided, unconcerned sad, anxious, confused, frustrated

  • Bill,
    1) 3.1.0
    2) I am currently executing executing
    SF_ReplicateLarge 'SALESFORCE', 'Contact', 100000
    and it has been 3 days 5hrs and it's still not finished. There are 16,758,040 rows. I've tried SF_Replicate before and it ran for a few days then failed. I forget wait the error msg was.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited kidding, amused, unsure, silly indifferent, undecided, unconcerned sad, anxious, confused, frustrated

  • I would recommend upgrading to the latest release and using the pkchunk option.

    The pkchunk option replaces sf_replicateLarge and performs parallel queries.

    You can find the upgrade instructions at http://www.forceamp.com/upgrade.htm Do not skip any of the steps.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited kidding, amused, unsure, silly indifferent, undecided, unconcerned sad, anxious, confused, frustrated

  • I upgraded and ran the following command and received the following error:

    exec SF_Replicate 'SALESFORCE', 'Contact', 'pkchunk, batchsize(50000)';

    --- Starting SF_Replicate for Contact V3.2.1
    14:40:27: Drop Contact_Previous if it exists.
    14:40:27: Create Contact_Previous with new structure.
    14:40:28: Run the DBAmp.exe program.
    14:40:28: DBAmp Bulk Operations. V3.2.1 (c) Copyright 2006-2016 forceAmp.com LLC
    14:40:28: Populating local table batchsize(50000) , Contact_Previous / ServerName .
    14:40:43: Error: Unable to open SQL Server Source with SQLNCLI.
    14:40:43: Connection string is SERVER=Contact_Previous;DATABASE=ServerName;Trusted_Connection=Yes;Packet Size=4096
    Source: Microsoft SQL Server Native Client 11.0
    Description: Login timeout expired
    Source: Microsoft SQL Server Native Client 11.0
    Description: A network-related or instance-specific error has occurred while establishing a connection to SQL Server. Server is not found or not accessible. Check if instance name is correct and if SQL Server is configured to allow remote connections. For
    more information see SQL Server Books Online.
    Source: Microsoft SQL Server Native Client 11.0
    Description: Named Pipes Provider: Could not open a connection to SQL Server [53].
    Source: Microsoft SQL Server Native Client 11.0
    Description: Invalid connection string attribute
    14:40:43: Error: DBAmp.exe was unsuccessful.
    14:40:43: Error: Command string is C:\"Program Files"\DBAmp\DBAmp.exe Export:pkchunk, batchsize(50000) "Contact_Previous" "ServerName" "salesforce backups" "SALESFORCE"
    --- Ending SF_Replicate. Operation FAILED.
    Msg 50000, Level 16, State 1, Procedure SF_Replicate, Line 286
    --- Ending SF_Replicate. Operation FAILED.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited kidding, amused, unsure, silly indifferent, undecided, unconcerned sad, anxious, confused, frustrated

  • Your SQL instance appears to be configured to not accept the client connection:

    "Server is not found or not accessible. Check if instance name is correct and if SQL Server is configured to allow remote connections. "

    Ask you SQL dba to configure to accept remote connections over named pipes.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited kidding, amused, unsure, silly indifferent, undecided, unconcerned sad, anxious, confused, frustrated

  • The error is caused by a bug. There is a space just before the word "batchsize" that is causing the problem.

    Remove the space between the comma and the word 'Batchsize'.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. happy, confident, thankful, excited kidding, amused, unsure, silly indifferent, undecided, unconcerned sad, anxious, confused, frustrated