Data Integration

Options
Pranav
Pranav Member, ALL USERS Posts: 3 Occasional Contributor

Hi all,

I need to import data from files provided by business. Since the files contain duplicates and i have to import all records so i am using numbered list for the import.

But moving forward, I need to import single unique keys and ignore the duplicates but retain their values. I am finding difficulty in accomplishing this 

Pranav_0-1626569175874.png

The above image shows the source data imported to numbered lists. 
Point to note here - Long Description are texts and have length more than 100 hence concatenation is not working if used as code for non numbered lists.

The desired output is as below

Pranav_1-1626569303979.png

Is there any work around to accomplish this.


Many Thanks!

Tagged:

Comments

  • Pranav
    Pranav Member, ALL USERS Posts: 3 Occasional Contributor

    Thanks for the timely reply Jared.

    But the issue still persists.
    Let me give you the complete picture. Say I imported all records to a non numbered list. I now have around 1 million records.
    Now for these there are 5 properties - Country, Channel, SubSector, Benefit Segment, & Long Description.
    The Long Description is a text formatted property with character length over 100 and if i try to concatenate it by taking say 'x' or 'y' number of characters by using Left/Right functions so that for code length < 60 then all unique keys are not getting imported.

    Some keys still getting left out due to redundancy.

    Pranav_0-1626574085710.png

    In the above screenshot I have 32 records with same properties viz., Country, channel Subsector, Ben Seg & Long Desc for all these 32 are same but their code(from list) are different.
    Now if i try to create a new key by concatenation it is affecting other records and I am unable to use FINDITEM correctly and hance my values are not getting summed up.

    Can you please share me alternatives to create smart keys.

    Thanks in advance 




  • Pranav
    Pranav Member, ALL USERS Posts: 3 Occasional Contributor
    Thanks for the detailed solution.
    My issue is solved!! 😀