KAPOW

Welcome to the Kapow forum. Here you can get help, use your skills to help others and enjoy hanging out in the company of other Kapow Robot Developers.


How to handle Facebook Crawling

Share

fabrizio.orlando

Posts : 2
Points : 1339
Join date : 2014-03-24

How to handle Facebook Crawling

Post by fabrizio.orlando on Tue Mar 10, 2015 10:25 pm

Hi All,

I was trying to crawl the following (Lottomatica Public Page) public page using Kapow Studio Designer 9.2.9, but I faced the following problems:
1) The page was not rendered properly on the Navigator window, please see below


in addition, even though I could see the posts, I was in trouble handling the "paging as you scroll" mechanism. I faced the same issue on Twitter and YouTube.

Could you help me in some way?

Regards,
Fabrizio
avatar
Shyam Kumar
Ranks

Posts : 82
Points : 1746
Join date : 2013-07-05
Location : Kerala, India

Re: How to handle Facebook Crawling

Post by Shyam Kumar on Tue Mar 10, 2015 11:23 pm

Hi Fabrizio,


Its the issue of java enabled websites. You can upgrade the version 9.2.9 to 9.3. In Latest version when you are starting with a robot you can choose an options like "classic" and "webkit". Or you can migrate the robot. In the webkit version supporting java enabled websites. I tried the above mentioned url and its working properly.




Thank you.

Regards,

Shyamkumar

fabrizio.orlando

Posts : 2
Points : 1339
Join date : 2014-03-24

Could you please point me in the right direction on handling the "paging as you scroll" mechanism?

Post by fabrizio.orlando on Tue Mar 10, 2015 11:32 pm

Thanks for your answer, unfortunately I cannot upgrade to 9.3, since I've used the Oracle embedded version of Kapow, aka Web Acquisition Toolkit.

Anyway, could you please help me with the "paging as you scroll" mechanism since it is useful on several other web sources, e.g, Twitter, LinkedIn, YouTube, etc.?

Thanks,
Fabrzio
avatar
Shyam Kumar
Ranks

Posts : 82
Points : 1746
Join date : 2013-07-05
Location : Kerala, India

Re: How to handle Facebook Crawling

Post by Shyam Kumar on Wed Mar 11, 2015 9:46 pm

Hi Fabrizio,

I tried the same url with scroll option. Its working properly.

the loaded window is,



Please check with your scroll actin steps configuration or browser using in kapow.

Thank you.

Shyamkumar

    Current date/time is Sun Nov 19, 2017 6:21 am