What is maximum file size of CSV that can be read into CPI-PI

[manemahesh]

Hi Folks,

What will be the maximum csv file size that can be read and processed in CPI-PI.

Regards

Mahesh Mane

[HoHi-cbs]

Hi Maresh,

the limitation depends significantly what operations you want to perform on the uploaded data (e.g. mapping to XML or JSON; split into multiple messages). Could you share some more details about the scenario?

Regards, Holger

[HoHi-cbs]

Hi Mahesh,

150 to 200mb should be possible to process with standard memory settings of CPI.

Regards, Holger

[manemahesh]

Hi Holger Himmelmann,

I have a requirement to read csv files from Amazon S3 bucket and convert these csv into json since target system accepts data in JSON format.

Max file that will be sent on S3 bucket is 140 MB but not all fields in this csv file will be used in my integration scenario.

Only out of 176 columns(fields) in csv we will use only 5 fields that are needed for our integration with target sytesm.

Please help.

Regards

Mahesh