Integration issue- the last line is split across two files (chunk 1 and chunk 2)

Options
CommunityMember111275
CommunityMember111275 Member, ALL USERS, Partner, Certified Model Builder Posts: 5 New Contributor
in Extensibility

Hi Team,

while calling through API for export for integration, if the file size is large, it is divided into chunks of 10MB each (e.g. if the file size is 890 MB, it will be divided into 89 chunks). As a result, we are getting incomplete record on the last row of every chunk and the rest of the records are being stored in the next chunk due to the size limitation of 10 MB. Please suggest some ways to get rid off this issue so that each chuck contains complete rows (even if the size of the chunks will be slightly less than 10 MB) and the partial row in chunk1 can get shifted to chunk2 as a complete row.

Tagged:

Categories