How do you run Chrome while selenium headless script is executing on mac?

See also questions close to this topic

• Create new Pandas columns using the value from previous row

  I need to create two new Pandas columns using the logic and value from the previous row.

  I have the following data:

  Day Vol    Price    Income   Outgoing
  1   499     75      
  2   3233    90      
  3   1812    70      
  4   2407    97      
  5   3474    82      
  6   1057    53      
  7   2031    68      
  8   304     78      
  9   1339    62      
  10  2847    57      
  11  3767    93      
  12  1096    83      
  13  3899    88      
  14  4090    63      
  15  3249    52      
  16  1478    52      
  17  4926    75      
  18  1209    52      
  19  1982    90      
  20  4499    93  
  

  My challenge is to come up with a logic where both the Income and Outgoing columns (which are currently empty), should have the values of (Vol * Price).

  But, the Income column should carry this value when, the previous day's "Price" value is lower than present. The Outgoing column should carry this value when, the previous day's "Price" value is higher than present. The rest of the Income and Outgoing columns, should just have NaN's. If the Price is unchanged, then that day's value is to be dropped.

  But the entire logic should start with (n + 1) day. The first row should be skipped and the logic should apply from row 2 onwards.

  I have tried using shift in my code example such as:

  if sample_data['Price'].shift(1) < sample_data['Price'].shift(2)):
      sample_data['Income'] = sample_data['Vol'] * sample_data['Price']
  else:
      sample_data['Outgoing'] = sample_data['Vol'] * sample_data['Price']
  

  But it isn't working.

  I feel there would be a simpler and comprehensive tactic to go about this, could someone please help ?

  Update (The final output should look like this):

  

  For day 16, the data is deleted because we have two similar prices for day 15 and 16.
• When I use basemap in python, longitude is sometimes reversed, flipping the map

  In python, I use basemap (https://matplotlib.org/basemap/) for plotting spatial data, and I've used it for several years without any large problems. I recently had to reinstall python3 (through conda, along with a number of modules) and basemap now has a strange issue: under certain conditions, the map will be displayed with flipped longitudes, switching east and west. As an example, I use this code: https://matplotlib.org/basemap/users/robin.html. If I use that code as-is, the map displays fine, but when I set lon_0=180, the map gets flipped, as shown in the image below.

  Image of map problem

  Setting lon_0 to any positive number results in a flipped map, while 0 or negative numbers result in a correct map. lon_0 should simply set the central longitude of the plotted map, and should not have this behavior, so I'm unsure what's going on. Has anyone seen this behavior before, or have suggestions for how to fix it? I could alter my code to work around it, but I'd rather have things work properly.

  I am using python3.7.3. I've tried updating basemap with the command "conda install -c anaconda basemap", but it tells me that basemap is up to date already.

  Here is the code. It is identical to the code linked above, but with lon_0 set to 180.

  from mpl_toolkits.basemap import Basemap
  import numpy as np
  import matplotlib.pyplot as plt
  # lon_0 is central longitude of projection.
  # resolution = 'c' means use crude resolution coastlines.
  m = Basemap(projection='robin',lon_0=180,resolution='c')
  m.drawcoastlines()
  m.fillcontinents(color='coral',lake_color='aqua')
  # draw parallels and meridians.
  m.drawparallels(np.arange(-90.,120.,30.))
  m.drawmeridians(np.arange(0.,360.,60.))
  m.drawmapboundary(fill_color='aqua')
  plt.title("Robinson Projection")
  plt.show()
  

  When I run the code, the only output is this, which seems unrelated:

  map_test.py:36: MatplotlibDeprecationWarning: The dedent function was deprecated in Matplotlib 3.1 and will be removed in 3.3. Use inspect.cleandoc instead. m = Basemap(projection='robin',lon_0=180,resolution='c')

  Any ideas?
• Use format() on variables

  Is it possible to use "{}".format() logic but instead of "", to use a variable?

  x = 1
  y = 2
  a = 'some {} random {} text'
  print(a.format(x, y))
  

  I expect the following output:

  some 1 random 2 text
• Is volatile an illegal instruction in c++ on macos (related to building opencv)?

  I am trying to build OpenCV 4.1.0 on Mac by following this blog: https://gist.github.com/jruizvar/0535fb8612afb105e0eef64051dc0d00.

  Here is the command line for the preparatory cmake - which is successful:

  cmake -DOPENCV_EXTRA_MODULES_PATH=/git/opencv_contrib-4.1.0/modules -DPYTHON_DEFAULT_EXECUTABLE=python3 -DCMAKE_CXX_COMPILER=/usr/local/gcc-9.1/bin/g++-9.1 -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=/usr/local -DBUILD_opencv_python2=False -DBUILD_opencv_python3=True -DPYTHON3_EXECUTABLE=python3 ../
  

  Then the make

  make -j2
  

  That fails:

  /git/opencv-4.1.0/3rdparty/openexr/Half/half.cpp:71:5: internal compiler error: Illegal instruction: 4
     71 |     volatile float f = 1e10;
        |     ^~~~~~~~
  

  Tips from anyone who has successfully built this version of openCV on mac (and with opencv_contrib) would be especially appreciated.
• How to restrict macOS internet to only allow internet over OpenVPN?

  I have a problem where i want to allow macOS internet only if its connected via OpenVPN.

  I have the IP address of the VPN i have achieved the same on Windows using firewall but i can't seem to find anything in macOS

  I want some one to guide me how to setup outbound rules and only allow internet access to just traverse through openVPN.
• How to fix "nested code is modified or invalid" when signing for the Mac App Store?

  I'm trying to sign an OSX app, build with Unity 2018.4.0. Usually the following commands did it:

  chmod -R a+xr "Some.app"  
  codesign -f -s '3rd Party Mac Developer Application: HolyCrapple' "Some.app/Contents/Plugins/unitypurchasing.bundle" 
  codesign -f -s '3rd Party Mac Developer Application: HolyCrapple' --entitlements "Some.entitlements" "Some.app" --deep
  

  Now, all out of a sudden, something seems to be broken. Calling

  codesign --verify --verbose=4 "Some.app"
  

  Prints:

  Some.app: nested code is modified or invalid
  file modified: /Some.app/Contents/Frameworks/MonoBleedingEdge/MonoEmbedRuntime/osx/libMonoPosixHelper.dylib
  file modified: /Some.app/Contents/Frameworks/libssl.dylib
  file modified: /Some.app/Contents/Frameworks/MonoBleedingEdge/MonoEmbedRuntime/osx/libmonobdwgc-2.0.dylib
  file modified: /Some.app/Contents/Frameworks/libcrypto.dylib
  file modified: /Some.app/Contents/Frameworks/UnityPlayer.dylib
  

  Do you have any ideas what could cause this issue or how to fix it? Last time the app was updated (earlier this year using Unity 2018.3.01f1) it worked perfectly. Any advise is appreciated, Thank you.
• C# Selenium : How can I get css or Xpath when clicking on a button?

  I want to get the attributes of a button when clicking on it, when using a Chromedriver component, for instance : exactly what I get when I right-click -> Inspect with my browser (Chrome or Firefox). How can I can get such info, if it's possible, in view to replay a web session, after such memorizing with Selenium. At the moment, I can simulate a click on a button, knowing it's CSS-selector, for instance. I just want to know if I can get the CSS-SElector, using Selenium, and clicking by hand (human action, so), avoiding a pre right-click -> Inspect with a classical browser.

              browser = new ChromeDriver();
              browser.Navigate().GoToUrl("https:/twitter.com/EmiratesTeamNZ");     
  

  I want to get classname, or CSS-selector or Xpath of a like and retweet button being on the page, when I click on it. This code, got here,don't work

  browser.ExecuteAsyncScript("return window.getComputedStyle(document.querySelector('.SomeTitle .bar'),':before').getPropertyValue('content')");
  

  Any idea ? Tx a lot for your help.
• RobotFramework : AttributeError: 'list' object has no attribute 'startswith'

  Using RobotFramework,

  I am trying to retrieve Webelements label by using FOR loop.

  ${temp}=    Get WebElements    xpath=//*[@class='ui-grid-canvas']
  Set Global Variable    ${temp}
  ${as}    Get Element Count    xpath=//*[@class='ui-grid-canvas']
  : FOR    ${ELEMENT}    IN    ${temp}
  \    ${as}=    Get Text    ${ELEMENT}
  

  I am getting error at FOR loop. Kindly correct me.

  AttributeError: 'list' object has no attribute 'startswith'
  
• what to do with IndexError: list index out of range?

  hello so im trying to use selenium for clicking on some buttons in the instagram site but while im running the code this message appears and makes the script crash

  button2 = driver.find_elements_by_xpath("/html/body/div[3]/div/div/div[3]/button[2]")[0]
  IndexError: list index out of range
  

  for another button i set the value of under the bracket to 0 and it worked but now i cant fix other buttons with that solution

  button2 = driver.find_elements_by_xpath("/html/body/div[3]/div/div/div[3]/button[2]")[0]
  button2.click()
  time.sleep(2)
  
• Browsers cache web application despite of headers that disable caching

  We regularly deploy an Angular based web application. Simplified this application consists of an index.html and multipe .css and .js files. Nginx is configured to not cache the / (equates to index.html) but cache the resource files css and js forever. This is feasible because the resource file names change for every update:

  index.html -> include `my-timestamp.css`
  index-html -> include `my1-timestamp.js`
  

  The strange thing is that suddenly (it worked before for months) our main browser (Internet Exploder 11) uses an outdated index.html and tries to retrieve for example my-previous_version_timestamp.css. To make this even worse: the css can not be retrieved from the cache, some of the javascript resources fail too. If this would happen only with IE I would blame that one but the same happens with a recent Chrome too.

  Headers for the root:

  cache-control: no-cache
  date: Fri, 24 May 2019 20:17:00 GMT
  etag: "1dc09d84-322"
  expires: Fri, 24 May 2019 20:16:59 GMT
  last-modified: Sat, 26 Oct 1985 08:15:00 GMT
  

  (others excluded)

  Headers for the resources:

  cache-control: max-age=2592000
  cache-control: public
  etag: "1dc09d84-12d68"
  expires: Sun, 23 Jun 2019 20:17:02 GMT
  last-modified: Sat, 26 Oct 1985 08:15:00 GMT
  

  There is no proxy between the browsers and the webserver. We noticed one thing: it looks like our build process that builds the Angular application no longer creates "sane" timestamps. All files are from 1985 (you can see this in the last-modified header), before they carried the date they were built on. But I don't see how this could change the browsers behaviour.
• How to force a webpage to think that it is in or out focus?

  I am trying to build a web app (to learn about WebSockets and adaptive behavior) that polls different social media sites and shows all the latest updates in one place. I want to make the page stop updating while out of focus, and then update again when in focus.

  Testing the out of focus behavior has been very difficult, since I have to rely on logs to ensure that my app is working properly, and cannot have the window open in one monitor and work on the code in another monitor.

  My question is:
  Is there a way to "force" the tab to think that it is in or out of focus, like force element state in DevTools, but for the entire tab.

  I am running Chrome on Windows 10. I could not find a way to do this using DevTools, and do not want to setup a whole testing framework just for such a simple thing.

  Thank you for your time.
• Is there a way to have Selenium in Python check a download window for content?

  I have a Python code use the Selenium Chrome driver to click multiple tags in a list.

  Each opens a new window where a file is downloaded instantly, and that is all good; however, some of these new windows will have two files as options to download, so no file is downloaded until the next tag is clicked.

  The problem I have is that I can't let Selenium know how to "check" if it should just close the window since the download was automatic, or if it should do another click to begin the download.

  I tried to do a find_elements_by_(all possible methods) to have the driver check if there are any download links, but if the download is automatic, the driver just keeps running. It doesn't turn an error or anything, but it just runs perpetually. If I close the actual download window, it THEN shows a result.

  from selenium import webdriver
  
  browser = webdriver.Chrome('chromedriver.exe', options=options)
  
  #options are set for Chrome to download a PDF file without viewing it first.
  
  main_window = browser.window_handles[0]
  
  #this is the initial click to open the download window 
  browser.find_elements_by_css_selector('selector path').click()
  
  #this is to have the driver activate the new window
  
  pops = browser.window_handles[1]
  browser.switch_to.window(pops)
  
  #attempt to find the <a> tag with the download item
  if browser.find_elements_by_css_selector('selector path') != []:
     time.sleep(1)
     browser.find_elements_by_css_selector('selector path').click()
     browser.close()
     browser.switch_to.window(main_window)
     #this works fine when there are tags in the window. No problems
  else:
     time.sleep(1)
     browser.close()
     browser.switch_to.window(main_window)
     #code can't get to the "else" because the driver gets stuck checking for the selector perpetually.
  

  What I expect is Selenium to check if the window has content, if not, delay for a second and close the window. If there IS content, click the link to download; however, the driver just searches for the selector perpetually.

  EDIT: Forgot to mention the window that starts the download automatically doesn't have any content aside html, script, and head tags.

  Even when I try to run a find_element_by_tag, Selenium doesn't actually find the content.
• Selenium Webdriver is not saving screenshots to directory

  I am trying to take screenshot of a website using a Selenium Webdriver and save it at desired location.

  The below code runs fine but Selenium does not save any screenshots for me?

  from selenium import webdriver
  import time
  
  links = ['https://duckduckgo.com','https://google.com','https://facebook.com','https://reddit.com'];
  
  
  browser=webdriver.Chrome(executable_path='C:/Users/xxxx/Downloads/chromedriver.exe');
  browser.maximize_window()
  
  for x in links:
  
  
      browser.get(x)
  
      browser.save_screenshot("C:\\Users\\xxxxx\\Downloads\\website"+x+".png")
      print("website"+x+".png")
  
      time.sleep(2)
  browser.close()
  

  Does anyone know how I can get Selenium to take a screenshot and save it to my computer?
• Unable to click link / webelement using robotframework selenium method using xpath way

  I have following xpath in a frame.

  <td width="20%" class="datawatchvalue">
  <span data-bind="text: iTotal" onclick="window.parent.dashBoardIndexClick( DASH_BOARD_INDEX_TOTAL, 'All' );">6017</span></td>
  

  where 6017 represent the LINK, and it' dynamic, I have tried multiple method to click the link using xpath method but none of them are working.

  Frame html.

  <div class="middle-north ui-layout-pane ui-layout-pane-north" style="position: absolute; margin: 0px; top: 0px; bottom: auto; left: 0px; right: 0px; width: auto; z-index: 0; height: 208px; display: block; visibility: visible;">
      <div class="ui-widget-header ui-corner-top">Data Watch</div>
      <div class="ui-widget-content">
          <div class="dwtable" id="dwtableid" style="width: 75%">
              <div class="dwrow" style="width: 75%">
                  <div class="cell border-right-dashboard" id="topleftid"> 
                      <div class="cell"> 
  

  Here are my tries.

  Select Frame      middle-north ui-layout-pane ui-layout-pane-north
  Click Element    xpath=//[@data-bind="text: iTotal"]
  
  
  
  click link   xpath=//*[@data-bind="text: iTotal"]
  Click Element  xpath=//*[@title="Open a new Index Window"]
  Click Link  xpath=//*[@id="researchtoolbarcolumn"][@title="Open a new Index Window"][@onclick="createAssetWindow('Index')"]
  click link  xpath=/html/body/div[1]/div[1]/div/div[1]/table/tbody/tr/td[1]
  Click Link  xpath=//*[@id="researchtoolbarcolumn"]
  
• Exception: null when setting up Selenium using ThreadLocal and ChromeDriver (Version 75)?

  Current setup stored inside my DriverFactory:

  private static ThreadLocal<WebDriver> webDriver = new ThreadLocal<WebDriver>();
  return webDriver.get();
  

  Currently the following method seems to be failing:

  public void loadUrl(String url) {
      try {
          getDriver().get(url);
          System.out.println("Successfully navigated to URL: " + url);
      } catch (Exception e) {
          System.out.println(e.getStackTrace());
          Assert.fail("Unable to navigate to URL: " + url + ", Exception: " + e.getMessage());
      }
  }
  

  Set driver method:

   public final void setDriver(String browser) throws Exception {
          String remoteHubUrl = "http://xxx.xxxx.xxx.xxx:4444/wd/hub/";
           try {
              switch (setBrowserType(browser)) {
                   case "grid":
                      DesiredCapabilities capabilities =new DesiredCapabilities();
                      capabilities.setBrowserName("chrome");
                      ChromeOptions op = new ChromeOptions();
                      op.merge(capabilities);
                      webDriver.set(new RemoteWebDriver(new URL(remoteHubUrl), op));
                          break;
                  }
  }
  

  Exception Message:

  Exception: null
  

  There seems to be no issues when using older versions of chromedriver, any ideas?

  Base Step which is used to initialise the driver prior to executing the tests:

  @Before
  public void setupHook()  {
      setDriver("grid");
  }