Questions tagged [beautifulsoup]
Beautiful Soup is a Python package for parsing HTML/XML. The latest version of this package is version 4, imported as bs4.
23,909
questions
-3
votes
0answers
33 views
I have a working program that just stops whenever it wants
I'm trying to make an anime downloader for the website 4anime.to, the code works fine and all throws no error but just stops randomly while downloading a video. I looked at the task manager to check ...
-1
votes
0answers
18 views
Beautiful Soup scraping Twitter
In order to get the tweet comments i'm trying to use beautifulsoup.
Getting a 400 response on all the links however, even the login page. i used this link for ref Getting 200 response but not logging ...
0
votes
1answer
28 views
List out of range when using BeautifulSoup find_all() in an infinite loop
I get list out of range when scraping web data
I need to get web data real time
while (switch01 == True):
#check something
page01 = requests.get('https://tw.stock.yahoo.com/q/q?s='+fourname01)...
-3
votes
1answer
21 views
Parsing amazon (Python)
hello i'm trying to parse amazon but my code didn't working
soup=bs(driver.page_source,'html.parser')
driver.get('https://www.amazon.com/gp/newreleases/wireless/18007875011/ref=zg_bs_tab_t_bsnr')
...
-3
votes
0answers
15 views
Using BeautifulSoup , need to extract first table by adding additional field from div block to all the below values upto next div block [closed]
Using Beautiful soup how would i extract the first table from the source : https://docs.snowflake.com/en/release-notes/requirements.html adding a field variation to every output. That variation field ...
0
votes
0answers
24 views
How to find href inside a tag in beautiful soup?
I have an HTML page source. I am trying to find the first tag whose class="title" in tag ais-InfiniteHits-item.
I am using beautiful soup. I first used:
mydivs = soup.findAll("li", ...
0
votes
0answers
10 views
How to get the complete URL by making a google search with BS4 and Requests
So, I was making a program that will search google and fetch all the results for a given keyword. I wanted to get all the URLs and print them out to the screen, and I decided to use BS4 for this and ...
1
vote
1answer
35 views
DuckDuckGo results scraping
I had a problem running my code, and found a perfect solution for this on StackOverflow. But, when I make necessary changes and run it, I get no output.
Code:
from bs4 import BeautifulSoup
import ...
-1
votes
0answers
22 views
Stuck while doing web scarping from youtube
I am creating a discord bot for my server in python and i added some music functionality and it will take the name of song put that song as a query in you-tube search for ex i have to search for a ...
0
votes
2answers
38 views
How to scrape all links from infinite scroll on google-play website
I'm trying to scrape the links in of playstore with infinite scrolling. With Selenium and BeautifulSoup, I am able to fetch only the links on the first page. How to proceed ahead to get a complete ...
google-play
0
votes
0answers
22 views
Beautiful Soup Not Working As Intended On Imgur Gallery Pages
I have a problem with beautiful soup where I can't parse through some webpages appropriately, imgur galleries specifically. Because I can't get the correct soup variable, I am unable to work with any ...
1
vote
1answer
21 views
How to scrape nested text between tags using BeautifulSoup?
I found a website using the following HTML structure somewhere:
...
<td>
<span>some span text</span>
some td text
</td>
...
I'm interested in retrieving the "some td ...
-1
votes
0answers
15 views
In my request module doesnt work proxies? [closed]
Here is my code:
proxy_choices = ['MY PROXY']
proxy = random.choice(proxy_choices)
proxies = {'http': 'http://%s' % proxy, 'https': 'http://%s' % proxy}
print("PROXY USED:" + proxy)
...
0
votes
1answer
29 views
How do I find and display certain text from a string?
I want to make an application that can tell you the Steam AppID when you insert the name of the game as input, but I do not know how to display the name of the game selected and the AppID properly to ...
1
vote
1answer
22 views
Webscraping bs4 - sorting resaults from different URLs into table
I have written the script below to scrape a website.
I have left out the URL, if you need this write to me and i will supply it to you.
The current output is kinda messy but it does the job.
Im very ...
欧美日韩国产在线一区二区_午夜短视频在线观看_亚洲国产欧美日本视频_亚洲精品高清视频在线观看