Large Salesforce data flows hitting bulk api limits
I've recently been working on some rather large Salesforce imports and have been running into bulk api limits that I'm not sure what to do about. Aside from a few lookups and lot of data, it's a pretty typical import but after multiple hours of processing it always fails with the error:
NextRow failed: ApiBatchItem Limit exceeded
I know that salesforce allows up to 15,000 batches with 10,000 records each so I can't imagine why I'd be hitting that limit with an upload of only 25,000 records. Any idea why this is happening or how I can go about fixing it?