Using firefox and selenium with tor anonymously

See also questions close to this topic

• unable to click on paper button using selenium web driver

  I am able to identify the element but unfortunately i was not able to click on the button because i am getting null pointer exception

  
                                          Include
                                      
  

  and exception am getting is java.lang.NullPointerException at automation.carousel.allRules.positiveScenarios.TestCarouselAllRules.CreateRule(TestCarouselAllRules.java:239) at automation.carousel.allRules.positiveScenarios.TestCarouselAllRules.launch(TestCarouselAllRules.java:214) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:80) at org.testng.internal.Invoker.invokeMethod(Invoker.java:714) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111) at org.testng.TestRunner.privateRun(TestRunner.java:767) at org.testng.TestRunner.run(TestRunner.java:617) at org.testng.SuiteRunner.runTest(SuiteRunner.java:334) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:329) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:291) at org.testng.SuiteRunner.run(SuiteRunner.java:240) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1198) at org.testng.TestNG.runSuitesLocally(TestNG.java:1123) at org.testng.TestNG.run(TestNG.java:1031) at org.testng.remote.AbstractRemoteTestNG.run(AbstractRemoteTestNG.java:114) at org.testng.remote.RemoteTestNG.initAndRun(RemoteTestNG.java:251) at org.testng.remote.RemoteTestNG.main(RemoteTestNG.java:77)
• How to select a dynamic list element (kendoUI) in robot framework

  I'm trying to test UI with Robot Framework (Selenium). I have a drop down which is dynamically populated and i have to select one of the text in it. I'm able to click on the dropdown element which then shows the list as a popup. But not able to select any of the elements. When i try to access the dropdown using Select from List , it returns an error stating its not a list. Since its dynamic the ID are not constant.

  *<kendo-dropdownlist name="sel" style="width: 400px;" ng-reflect-data="[object Object],[object Object" ng-reflect-text-field="Name" ng-reflect-value-field="Id" ng-reflect-default-item="[object Object]" ng-reflect-value-primitive="true" ng-reflect-name="sel" class="k-widget k-dropdown k-header ng-valid ng-touched ng-dirty" ng-reflect-model="-9999">
   <span role="listbox" unselectable="on" class="k-dropdown-wrap k-state-default k-state-focused" ng-reflect-ng-class="[object Object]" id="5c2a0848-f6fa-433f-a927-8b645ac4047b" dir="ltr" readonly="false" tabindex="0" aria-disabled="false" aria-readonly="false" aria-haspopup="true" aria-expanded="false" aria-owns="c7cb9422-f181-4b66-905e-eaa05305a0e9" aria-activedescendant="b0f86e8c-1fea-4bee-9367-39a207fa4859-undefined">
  <span unselectable="on" class="k-input" ng-reflect-ng-class="[object Object]">
  <span unselectable="on" class="k-select" ng-reflect-ng-class="[object Object]">
  </span>
  </kendo-dropdownlist>*
  
  
  *<kendo-popup class="ng-tns-c7-14 k-animation-container ng-star-inserted k-animation-container-shown" dir="ltr" style="left: 189.6px; top: 338.2px; min-width: 400px; width: 400px;">
  <div class="k-popup ng-trigger ng-trigger-toggle k-list-container k-reset" ng-reflect-klass="k-popup" ng-reflect-ng-class="k-list-container,k-reset">
  <div kendodropdownsselectable="" class="k-state-focused k-state-selected ng-star-inserted k-list-optionlabel" ng-reflect-ng-class="[object Object]" ng-reflect-index="-1" aria-selected="true" style="">Please Select</div>
  <kendo-list ng-reflect-data="[object Object],[object Object" ng-reflect-text-field="Name" ng-reflect-value-field="Id" ng-reflect-height="200" ng-reflect-show="true" ng-reflect-id="c7cb9422-f181-4b66-905e-eaa053" ng-reflect-option-prefix="b0f86e8c-1fea-4bee-9367-39a207" class="ng-star-inserted" style="">
  <div unselectable="on" class="k-list-scroller" ng-reflect-ng-class="[object Object]" style="max-height: 200px;">
  <ul role="listbox" class="k-list k-reset" ng-reflect-ng-class="[object Object]" id="c7cb9422-f181-4b66-905e-eaa05305a0e9" aria-hidden="false">
  <li kendodropdownsselectable="" role="option" class="k-item ng-star-inserted" ng-reflect-ng-class="[object Object]" ng-reflect-index="0" ng-reflect-multiple-selection="false" id="b0f86e8c-1fea-4bee-9367-39a207fa4859-5560" tabindex="-1">
  ................
  ................
  <li kendodropdownsselectable="" role="option" class="k-item ng-star-inserted" ng-reflect-ng-class="[object Object]" ng-reflect-index="10" ng-reflect-multiple-selection="false" id="b0f86e8c-1fea-4bee-9367-39a207fa4859-5360" tabindex="-1">
  </ul>
  </div>
  </kendo-list>
  </div>
  </kendo-popup>*
  

  Any help or pointers would be highly appreciated. Thanks.
• recaptcha v2 does not let me pass the validation even after I picked all the pictures correctly

  I am using Selenium for web scraping, and I am solving the captcha manually. The app I wrote behaves like a human, random waits, random move, random clicks. I am using VPN because I don't want to get my own IP blocked.

  There are a few websites becomes really difficult recently (July 2018).

  • When I use chrome browser and do everything manually, everything is fine.

  • When I use selenium and chromedriver.exe, recaptcha v2 does not let me pass the validation even after I picked all the pictures correctly.

  • So, that means the IP I am using is not blocked by the website. Somehow the website can detect users using selenium or Chromedriver

  I tried the Following things, none of them work.

  • Clear browser histories, cookies .....

  • Use Incognito window

  • Disable Extensions

  • Disable infobars (chrome_options.add_argument("--disable-infobars"))

  • Edit ChromeDriver.exe in a hex editor, change "var key = '$cdc_asdjflasutopfhvcZLmcfl_'" to "var key = 'xxxx_xxxxflasutopfhvcZLmcfl_'"

  Any advice about how to solve the recaptcha v2 automatically or manually is really appreciated.

  Here is one website that I am having trouble using Selenium and ChromeDriver.exe:

  https://courtclerk.org/records-search/search-by-case-number/

  Part of my code:

      public void SeleniumTest()
      {
          var options = new ChromeOptions();
          options.AddArgument(@"--incognito");
          options.AddArguments("disable-infobars");
          using (var driver = new ChromeDriver(myWebdriverPath, options))
          {
              driver.Navigate().GoToUrl("https://courtclerk.org/records-search/search-by-case-number/");
              Thread.Sleep(random.Next(1, 2) * 5000);
              if (driver.FindElement(By.Name("court[COA]")).Selected)
              {
                  driver.FindElement(By.Name("court[COA]")).Click();
                  Thread.Sleep(random.Next(1, 2) * 600);
              }
              MessageBox.Show("Enter Case Number"); Thread.Sleep(1000);
              MessageBox.Show("Input Capcha"); Thread.Sleep(1000);
          }
      }
  
• How to install firefox extension for whole machine

  I've put together my extension for firefox and now I would like to install it. Since it needs native part anyway (and I can install that globally using /usr/lib64/mozilla/native-messaging-hosts/<name>.json) I would like to also install the webextension part globally so I can just pack both parts in one package. How can I do that?
• How to check browser version

  I made a webpage but old browsers don't support some parts of the webpage and i want the page to check the browser version and if it's old, page redirects visitor to another page and i'm using Laravel. is there any way to make this come true?
• Incorrect redirect to https

  I have an issue with some page which is working over http and not https.

  The problem is that I attempted to access the page with https by mistake and now both Chrome and Firefox fail with Privacy Error (ERR_CERT_AUTHORITY_INVALID and MOZILLA_PKIX_ERROR_SELF_SIGNED_CERT respectively). Safari works just fine.

  I tried clearing the Domain Security Policy from chrome://net-internals/#hsts for the host but it keeps failing. Any ideas?

  The page is deployed in kubernetes and has a DNS redirection, but I don't think that should have any impact in the browser, am I right?
• How to route traffic through socks5 proxy by editing /etc/environment?

  I need to route all traffic of my computer through Tor. Is it possible to do by editing /etc/environment? i was able to route through HTTP proxy by adding few lines to /etc/environment.

  http_proxy="http://myproxy.server.com:8080/"

  How to route all traffic through socks5 proxy ?
• Tor Browser IP renewal with python

  Is there a python command to change the identity in Tor Browser on OS Tails? I tried with stem but it didn't work:

  Error:

  ('unable to use the control socket')
  

  OR:

  (Connection refused)
  
• How does the Tor traffic goes during the Man in the Middle Attack?

  I was trying man in the middle attack in my local wifi at home and i was able to capture the http traffic that goes through my device...but when i used TOR i was unable to intercept the traffic. So, how does the traffic is routed when I'm using Tor ( during the man in the middle attack )