Questions tagged [web-scraping]

0 votes
1 replies
Parser BS4 write to file
I'm study python and have a task. I have to write the scraping results to file, but there are some errors. Each string in the result file as "No...
asked 1 month ago
0 votes
1 replies
Is it possible filling online forms using a program on my computer?
The following picture shows the page of my broker. It's stock market broker. As you can see in the picture there are 4 fields for 2 different sto...
0 votes
1 replies
WebScraping: Get nested element in HTML Table
Hi I am new to webscraping and got stuck on getting nested html element tag in a table, here is the html code I get from the url http://www.geona...
asked 1 month ago
2 votes
1 replies
How can I trigger an automatic click to an alert btn ok to continue loading the target url?
I'm using cheerio to scrap a web eCommerce pages, but the problem the page is blocking in an alert question if I click OK manually it pass well ,...
asked 1 month ago
1 votes
0 replies
Using the resultant request as a variable in my javascript function
So, i'm using the NPM 'request' library to webscrape the 'URL x'. The '' content inside this 'URL x' is a single line with a youtube video link....
asked 1 month ago
1 votes
1 replies
python error: urlopen error [Errno 11001] getaddrinfo failed
We are using proxy. I am able to open http://www.google.com and www.bing.com with the codes below. But, I am getting error "urlopen error [Errn...
asked 1 month ago
2 votes
2 replies
How to scrape multiple webpages without overwriting the results?
New to scraping and trying to scrape multiple webpages from Transfermarkt without overwriting the previous one. Know that this question has been...
1 votes
1 replies
Not able to scrape specific information off BSE website using bs4
I'm trying to scrape the previous close and open stock price from this website. Here's an image as a reference to where the information to scrape...
asked 1 month ago
0 votes
2 replies
NodeJS - Read HTML Head Tags
I want to scrape a HTML page in my nodejs application and form a list of head tags. For example: <!DOCTYPE html> <html lang="en"> &l...
asked 1 month ago
0 votes
0 replies
Having problem executing javascript of website DOM
I am using python with selenium driver to get the HTML codefrom a webpage after executes its javascript. This code only appears when I open the d...
0 votes
1 replies
Can't figure out how to get BS4 to retrieve youtube view count on /videos page
I am trying to navigate to a page using BS4, lets use /history for an example. I want to gather the viewcount for all the videos that are current...
2 votes
1 replies
how to insert a value in a html space box by vba
I am trying to insert a specific value at 3 differents space boxes. However, I did not find a example that works with the site which I am using....
0 votes
0 replies
Is there a way to pull data from site based on some inputs?
Apologies for asking very naively but I am very new to VBA and have not used it much. I am working on analyzing MF data in India and need to pull...
asked 1 month ago
1 votes
1 replies
I can't make a loop over multiples pages in Beautifulsoup
I'm trying to scrape data estate in this link: https://www.pap.fr/annonce/ventes-maisons- I was able to scrape the data but only from the first...
1 votes
3 replies
I can't display html code - Beautifulsoup
(I'm a beginner in the web scraping) I want to scrap this link: https://www.seloger.com/list.htm?tri=initial&idtypebien=1,2&pxMax=300000...
1 votes
1 replies
VBA: Access element inside a div loaded with angularjs, when ID and Classname changes randomly
I am a beginner in VBA and I make an application that fills the data coming from a xls page to a website that uses angularjs. the website contain...
asked 1 month ago
0 votes
0 replies
How can I enable a disabled element after selecting a dropdown?
I'm trying to automate some downloads, but I've run into some issues with disabled elements not enabling after selecting a value in the element p...
0 votes
2 replies
Scrap data from individual pages [closed]
I'm studying on machine learning but I don't have data on my hand yet. To gather the data, I need to get inside each page one-by-one. I don't wan...
0 votes
2 replies
Python web scraping how to loop all pages/next page
Can someone help me how to loop the next page have tried all the solutions on here but cant seem to get it to work. import pandas as pd pd.optio...
asked 1 month ago
0 votes
3 replies
I need to display the third <li> in BeautifulSoup
I am trying to scrape a page Web, the problem that I can't scrape the third item, I managed to display the first item with this code : repo = so...
0 votes
0 replies
Get web elements with VBA from child tab with IE for an email list manager automation changes
I am fully automating changes for several members of mail groups in an internal company site called groupkeeper.mycompany.com (a tool for creatin...
asked 1 month ago
0 votes
0 replies
Unable to pass payload when they are like html elements
I've written a script in python using post request to fetch certain content from a webpage but I can hardly understand how to pass payload parame...
asked 1 month ago
0 votes
1 replies
Scraping a value of a website using VBA where the classname is duplicated
Ok This question has a 2 parts to it. I need to scrape the value R1200 from the website into Excel using VBA. I have tried various methods and...
asked 1 month ago
0 votes
0 replies
How to get from URLs in RData to a scraping in RSelenium? (password-protected website)
I have a few URLs from a scraping of a newspaper. This URLs are in RData format. I am trying to scrape news from http://politiken.dk/arkiv/ It is...
asked 1 month ago
1 votes
1 replies
How to post a form to aspx site using python
I am trying to do a search query using python on this site https://www.ahpra.gov.au/Registration/Registers-of-Practitioners.aspx?m=Search but am...