Data Integration

Pranav

Hi all,

I need to import data from files provided by business. Since the files contain duplicates and i have to import all records so i am using numbered list for the import.

But moving forward, I need to import single unique keys and ignore the duplicates but retain their values. I am finding difficulty in accomplishing this 

The above image shows the source data imported to numbered lists. 
Point to note here - Long Description are texts and have length more than 100 hence concatenation is not working if used as code for non numbered lists.

The desired output is as below

Is there any work around to accomplish this.


Many Thanks!

Pranav

Thanks for the timely reply Jared.

But the issue still persists.
Let me give you the complete picture. Say I imported all records to a non numbered list. I now have around 1 million records.
Now for these there are 5 properties - Country, Channel, SubSector, Benefit Segment, & Long Description.
The Long Description is a text formatted property with character length over 100 and if i try to concatenate it by taking say 'x' or 'y' number of characters by using Left/Right functions so that for code length < 60 then all unique keys are not getting imported.

Some keys still getting left out due to redundancy.

In the above screenshot I have 32 records with same properties viz., Country, channel Subsector, Ben Seg & Long Desc for all these 32 are same but their code(from list) are different.
Now if i try to create a new key by concatenation it is affecting other records and I am unable to use FINDITEM correctly and hance my values are not getting summed up.

Can you please share me alternatives to create smart keys.

Thanks in advance 

Pranav

Thanks for the detailed solution.
My issue is solved!! 😀