Targeting the third list item with beautiful soup

See also questions close to this topic

• Will model.predict update a GRU layer states correctly?

  This is my first question, suggestions are appreciated!

  Background

  I built a model similar to this one.

  I am using model.predict(inputs) to make predictions and I built my custom functions and process to make it learn. It seems to work and when it predicts all seems good.

  Some days ago, I watched this video: https://youtu.be/8HyCNIVRbSU?t=284 (It starts in the part that generated my question) And I copied the image that caught my attention: It says that each input is inserted sequentially on each cell, and each cell will provide more information to the next in that order.

  I began to wonder if my implementation is correct and I will give you all the details that might be useful.

  Details

  1. I am using stateful=True for both GRU layers.
  2. The input at model.predict(inputs) is defined like inputs = [np.array(arr).reshape(1, 1, 6), np.array(arr2).reshape(1, 1, 4)].
  3. I have a csv with the values of the first part of the input, but for the other values, I create them on the fly. That is why I used model.predict. Because of this, if there is another way to be able to send both the static and "dynamic data", I would be happy to do it.
  4. The only way that I am interacting with the model after loading it is by asking to predict the values, and by updating its weights (and resetting states when I input a new sequence).

  Now, with all this information, the question would be:

  • Is model.predict updating all the cell states correctly and using thr GRU layer to its full capacity?
  • Or is it just sending the data to the first cell always?
• Any Python string method would remove punctuation from a string?

  Python method to remove punctuation in a string such that the string "A HAPPY, Happy Year2021 Holidays!!!" will become "A HAPPY Happy Year2021 Holidays"
• JavaScript / Python is messing up my web request (by manipulating my strings without permission)

  I'm trying to make a web request work (for over 12 hours yet) with requests library for Python. The problem is that I have to send some JSON data by a POST request. The data which should be send looks like this:

  let container = {
  data: "{\"rtId\":663528,\"parmtrs\":\"{\\\"firstVisit\\\":false,\\\"requestId\\\":\\\"05e07b82df46499dab3f9f4ba4d932c6\\\",\\\"rememberUserId\\\":\\\"\\\",\\\"lang\\\":\\\"en#US\\\"}\"}"
  }
  

  (This is JavaScript)

  But as soon as I evaluate container.data it becomes like:

  {"rtId":663528,"parmtrs":"{\\"firstVisit\\":false, .......
  

  And this results in an invalid request (because there should be three dashes \\ in the post body and not just \) - I have to encrypt JSON-String for the post body but if there are more dashes than expected the string becomes invalid.

  Neither Python nor JavaScript works with that, both escaping the strings even when I use something like String.raw (JavaScript) or r"" in Python.

  This is both a problem with Python & JavaScript.

  I need some good ideas how to get strings that are looking like the first example with three dashes in Python (I also tried to send encoded body string like:

  %7B%22rtId%22%3A668%2C%
  

  but this results in a 403 response code (everything ends up in a 403 response code so far. I validated everything for hours: 100% valid & exact cookies and headers) so the problem could only be because of wrong formatted body data within the post request.

  I'm at my wits end.
• How do fb ads projects collect data?

  this is more a general question, but does anyone know, how websites like http://dropispy.com/ collect fb ads data and allow you to query FB ads data in time (week/month/year ago)?

  An obvious answer would be - with FB Ads api, but with it, you have to query FB pages and can not query back in time.
• How to scroll up and down and interact with web elements in a dynamic web page using Selenium Webdriver?

  automation experts!

  For quite a while I have been experiencing a specific issue related to web elements interaction within a web page. Precisely, I am not able to capture specific web page elements from a data table. None of Copy web element functions actually work - I have tried with Xpath, full Xpath, tag name, class name, id or partial (link) text after Right-click--> Inspecting the target page. Sadly, I am experiencing the following error once I execute the script:

  raise exception_class(message, screen, stacktrace) selenium.common.exceptions.InvalidSelectorException: Message: invalid selector: An invalid or illegal selector was specified

  It would seem that even though I try with Selenium webdriver or BeautifulSoup4/requests, none of the methods work. With BS4 I attempt the following:

  resp = requests.get("https://business.google.com/local/business/")
  soup = BeautifulSoup(resp.text, 'html.parser')
  l = soup.find("ol", {"class": "olName"})
  
  for el in l.find_all("li"):
      print(el.text)
  

  In addition to the ol class there are multiple nested li lines that represent a table row from within the web page. Each value aria-label value behind it must be extracted.

  Would be looking forward to any suggestions on how to proceed from now on, I seem to be banging my head against the wall here...
• Error in (function (..., row.names = NULL, check.rows = FALSE, check.names = TRUE, : arguments imply differing number of rows: 17, 3

  I am trying to convert a table from a website into a table I could read in R.

  url <- "https://www.pro-football-reference.com/teams/cle/2020.htm#all_games"

  pfr_raw <- url %>%
       read_html() %>%
       html_table() %>%
       as.data.frame()
  

  But when I do this it throws this error -> `Error in (function (..., row.names = NULL, check.rows = FALSE, check.names = TRUE, : arguments imply differing number of rows: 17, 3'

  The thing is if I use the link but 2019 instead of 2020 it works. How do I fix this issue? Thank You
• requesting different paragraphs of the body part of different articles with bs4

  I need the body part of different articles on a page. They've been written in a section tag including several p tags for each paragraph. like:

  <section class="...">
   <div>...</div>
   <figure>...</figure>
   <p id='...' class='...'></p>
   <p id='...' class='...'></p>
   <p id='...' class='...'></p>
  </section>
  
  <section class="...">
   <div>...</div>
   <figure>...</figure>
   <p id='...' class='...'></p>
   <p id='...' class='...'></p>
   <p id='...' class='...'></p>
  </section>
  

  If I use code below :

  import requests
  import re
  from bs4 import BeautifulSoup
  
  r = requests.get('url')
  
  all_bodies = soup.find_all('section')
  for i in range(len(all_bodies)):
      print(all_bodies[i])
  

  It returns the complete content of section and if I add p tag to find_all it returns each p tag as an element of the list, but I want whole p tags of a section in one list element.
• Beautifulsoup JSON Remove text

  Can anyone explain how I scrape this data with beautifulsoup? Because of the ''Description'' tag, I can't find the elements.

  I want to delete the text from Description till start of the brand element.

  Using PYTHON.

  Thanks!

  
  {
      "@context": "http://schema.org/",
      "@type": "Product",
      "name": "",
      "description": "<div class="textblock"><p><style>
      .infobox {
      padding: 10px;
  margin: 5px;
      background-color: #fffb98;
      border-radius: 10px;
      }
  </style>
      <div class="textblock">
      <h2>PlayStation 5</h2>
      <div class="infobox">
  <h3>Informatie over pre-orders</h3>
   <p><strong>Het is niet mogelijk om via onze webshop een pre-order te plaatsen.</strong></p>
      <p>Heb jij reeds een pre-order geplaatst op de PlayStation 5? Dan neemt de winkel waar jij dit deed <strong>vanaf 17 september zo spoedig mogelijk telefonisch contact met je op</strong> om de status van je pre-order te bespreken. Wij nemen in <strong>chronologische volgorde</strong> contact op met al onze PS5 pre-order klanten geplaatst tot en met 16 september 2020. Naargelang de datum waarop jij je pre-order plaatste kan het <strong>tot 10 dagen</strong> duren alvorens je winkel telefonisch contact met je opneemt.</p>
      <p>Had jij vóór 17 september 2020 nog geen pre-order geplaatst op de PlayStation 5? Ga dan langs in jouw Game Mania store om een pre-order te plaatsen en kom chronologisch op de PS5 wachtlijst te staan. Bij het plaatsen van een nieuwe pre-order is een aanbetaling van € 50 verplicht.</p>
      </div>
      <p><strong>Welkom in een nieuwe wereld van realistisch gamen</strong></p>
      <p>Ontdek een diepere game-ervaring op PS5™ met ondersteuning voor haptische feedback, adaptieve triggers en 3D-audiotechnologie.<br>
      <br>
      <strong>Voel meer met haptische feedback</strong></p>
      <p>Geniet van haptische feedback via de draadloze DualSense™-controller in geselecteerde PS5-games en ervaar de effecten en impact van je acties in de game met je zintuigen.</p>
      <p><strong>Voel de weerstand met adaptieve triggers</strong></p>
      <p>Maak gebruik van meeslepende adaptieve triggers met dynamische weerstandsniveaus die de fysieke impact van in-game activiteiten in geselecteerde PS5-games simuleren.</p>
      <p><strong>Kijk met geluid dankzij 3D-audio</strong></p>
      <p>Duik in muzikale panorama's waar het voelt alsof het geluid uit elke richting komt. Met Tempest 3D AudioTech in ondersteunde games komt je omgeving echt tot leven via je hoofdtelefoon of de luidsprekers van je tv.</p>
      </div>
  </p></div>",
      "brand": {
          "@type": "Thing",
          "name": "Game Mania"
      },
      "aggregateRating": {
          "@type": "AggregateRating",
          "ratingValue": "4",
          "ratingCount": "5187"
      },
      "offers": {
          "@type": "Offer",
          "priceCurrency": "EUR",
          "price": "499",
          "availability" : "OutOfStock"
      }
  }