Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / New
Stats: 3,161,447 members, 7,846,862 topics. Date: Saturday, 01 June 2024 at 04:37 AM

Please Who Here Is Good With Web Scraping (octoparse) ? - Programming - Nairaland

Nairaland Forum / Science/Technology / Programming / Please Who Here Is Good With Web Scraping (octoparse) ? (211 Views)

In Need Of Someone Who Is Good With Excel / The Future Of Web Scraping / Jumia Black Friday Web Scraping Program (2) (3) (4)

(1) (Reply) (Go Down)

Please Who Here Is Good With Web Scraping (octoparse) ? by 99thEnemy(m): 1:02pm On Apr 18
I have been trying to scrape data off a dynamic web page the relies on AJAX to load modals.

The links are structured hierarchically.

Abeg who is good with it?
Re: Please Who Here Is Good With Web Scraping (octoparse) ? by VinCheckr: 1:23pm On Apr 18
I am him
Re: Please Who Here Is Good With Web Scraping (octoparse) ? by Acheems: 1:42pm On Apr 18
99thEnemy:
I have been trying to scrape data off a dynamic web page the relies on AJAX to load modals.

The links are structured hierarchically.

Abeg who is good with it?
Hi, I'm proficient in this kind of task using Selenium. How can I contact you? Here is my email: acheems01@gmail.com
Re: Please Who Here Is Good With Web Scraping (octoparse) ? by 99thEnemy(m): 1:46pm On Apr 18
Acheems:

Hi, I'm proficient in this kind of task using Selenium. How can I contact you? Here is my email: acheems01@gmail.com

I just need someone to describe to me how to fix an issue I stumble upon in octoparse.

I want to setup workflow to loop through a hierarchical data in octoparse but I am not getting the results as expected.

the modals load dynamically using AJAX.

VinCheckr:
I am him

You got the idea?
Re: Please Who Here Is Good With Web Scraping (octoparse) ? by 99thEnemy(m): 2:09pm On Apr 18
Acheems:

Hi, I'm proficient in this kind of task using Selenium. How can I contact you? Here is my email: acheems01@gmail.com

Check your mail
Re: Please Who Here Is Good With Web Scraping (octoparse) ? by 100millionGoal: 9:07pm On Apr 24
Whatever automator you're using just make it scroll infinitely below.

Puppeteer offers this with their infinite scroll package

(1) (Reply)

What Is Prestashop Marketplace Membership Plan Feature? / What Are The Strategic Benefits Of Restaurant Mobile App Development In 2020? / Having An Online Solution:the Best Investment You Can Ever Make

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10)

Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 20
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.