Monitor Bulk Data Load Jobs - DBAmp (SF_Bulkops)

Should DBAmp jobs running in Parallel mode appear in the "Monitor Bulk Data Load Jobs" area of SalesForce?

I could have sworn they use to appear, but last week (after the SalesForce upgrade), when we went to check on a few jobs, they did not appear. After opening a ticket with SalesForce, they recommended we contact you.

We have a process that runs daily, and only sends in Serial Mode when there is over 20K rows to be processed. We did have one of those, and the Serial Job did show up in the Monitor Bulk Data Load Jobs area.
1 person has
this question
+1
Reply
  • Yes, all jobs should appear.

    The message output of the initial parallel sf_bulkops should show a job id and batch id. Can you confirm that you are seeing those items ?
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. kidding, amused, unsure, silly indifferent, undecided, unconcerned happy, confident, thankful, excited sad, anxious, confused, frustrated

  • No, I don't see it:

    Command Executed:
    exec SF_Bulkops 'Upsert','SALESFORCE','Account_OwnerExtract_UPSERT','Member_ID__c'

    Output (ignore the warnings and error):
    Warnings: --->
    W (1): --- Starting SF_BulkOps for Account_OwnerExtract_UPSERT
    W (2): 06:08:03: Run the DBAmp.exe program.
    W (3): 06:08:03: DBAmp Bulk Operations. V2.13.6 (c) Copyright 2006-2011 forceAmp.com LLC
    W (4): 06:08:03: Upserting Salesforce using Account_OwnerExtract_UPSERT (PHXSVOPDB70\DBAMP / salesforce_backups) .
    W (5): 06:08:05: Warning: Column 'PersonHomePhone' ignored because it does not exist in the Account object.
    W (6): 06:08:05: Warning: Column 'PersonOtherPhone' ignored because it does not exist in the Account object.
    W (7): 06:08:05: Warning: Column 'WorkPhone__pc' ignored because it does not exist in the Account object.
    W (8): 06:09:50: 2282 rows read from SQL Table.
    W (9): 06:09:50: 2 rows failed. See Error column of row for more information.
    W (10): 06:09:50: 2280 rows succesfully processed.
    W (11): 06:09:50: Errors occurred. See Error column of row for more information.
    W (12): 06:09:50: Error: DBAmp.exe was unsuccessful.
    W (13): 06:09:50: Error: Command string is D:\"Program Files"\DBAmp\DBAmp.exe upsert Account_OwnerExtract_UPSERT "PHXSVOPDB70\DBAMP" "salesforce_backups" "SALESFORCE" "Member_ID__c"
    W (14): --- Ending SF_BulkOps. Operation FAILED.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. kidding, amused, unsure, silly indifferent, undecided, unconcerned happy, confident, thankful, excited sad, anxious, confused, frustrated

  • This sf_bulkops did use the bulkapi switch so no job was created.

    The rows were sent directly to salesforce and from the messages it looks like all but 2 were processed. Check the Error column of the table to find out why the 2 rows failed.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. kidding, amused, unsure, silly indifferent, undecided, unconcerned happy, confident, thankful, excited sad, anxious, confused, frustrated

  • Ahh, that explains it, before we were running everything in Serial Mode, but then had the problem of trying to get the status back when everything was finished, and ran into problems because in Serial mode they process in order of submission, and other manual jobs would cause our automated ones to wait.

    So based on you experience, if we add the bulkapi switch back (without serial), how long do those submitted records take to process? For example in Serial mode we found our "average" was about 50-100 rows per second. If running in Parallel mode, is it any faster?
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. kidding, amused, unsure, silly indifferent, undecided, unconcerned happy, confident, thankful, excited sad, anxious, confused, frustrated

  • So far, I have not seen a pattern in response time. I think it depends on how backed up the sf job queues are at any particular point.
  • (some HTML allowed)
    How does this make you feel?
    Add Image
    I'm

    e.g. kidding, amused, unsure, silly indifferent, undecided, unconcerned happy, confident, thankful, excited sad, anxious, confused, frustrated