KAPOW

Welcome to the Kapow forum. Here you can get help, use your skills to help others and enjoy hanging out in the company of other Kapow Robot Developers.


Duplicate records

Share

E^E_2016

Posts : 10
Points : 408
Join date : 2016-08-29

Duplicate records

Post by E^E_2016 on Mon Nov 07, 2016 2:26 pm

Hello,

Please help me advice how can I configure robot in Kapow to eliminate duplicate records from crawled pages if they are the same URL links with same contents. Assuming these crawled items is stored in database.

Appreciate your help.

Thanks.
avatar
Shyam Kumar
Ranks

Posts : 76
Points : 1682
Join date : 2013-07-05
Location : Kerala, India

Re: Duplicate records

Post by Shyam Kumar on Thu Nov 10, 2016 7:47 pm

Hi,

For avoiding duplicates you need to configure your database type.

Just change the data base types you are used in the design studio,

what are the fields you need to give a unique, you can give as part of database key.


Thank you.


Regards,

Shyam kumar

    Current date/time is Fri Sep 22, 2017 2:23 am