Formatting API List with for loop in a Table

See also questions close to this topic

• Which column is generating this error "Input contains NaN, infinity or a value too large for dtype('float64')."?

  I have big dataframe with thousands of columns

  I am trying to fit a predictive model

  but while doing that I get this error

  Traceback (most recent call last):

  File "", line 1, in mdl.fit(X_train, y_train)

  File "C:\Users\am479\AppData\Local\Continuum\anaconda3\lib\site-packages\sklearn\linear_model\base.py", line 458, in fit y_numeric=True, multi_output=True)

  File "C:\Users\am479\AppData\Local\Continuum\anaconda3\lib\site-packages\sklearn\utils\validation.py", line 756, in check_X_y estimator=estimator)

  File "C:\Users\am479\AppData\Local\Continuum\anaconda3\lib\site-packages\sklearn\utils\validation.py", line 573, in check_array allow_nan=force_all_finite == 'allow-nan')

  File "C:\Users\am479\AppData\Local\Continuum\anaconda3\lib\site-packages\sklearn\utils\validation.py", line 56, in _assert_all_finite raise ValueError(msg_err.format(type_err, X.dtype))

  ValueError: Input contains NaN, infinity or a value too large for dtype('float64').

  ok I get it there is a NaN in a numeric field which it does not allow.

  my problem is how to know which column has this error

  the error message does not say much.
• What pattern to use, when relating objects by composition, to facilitate communication between the objects

  Say I have a python class: Foo(), that has a member self.bar which is assigned at initialisation of Foo() to be an instance of Bar(). So something like this:

  class Foo:
      def __init__(self):
          self.bar = Bar()
          self.other_member = 0
  

  Then say I bind some method of Bar() to a signal/callback and when triggered (externally) I want it to make a change to some other member of Foo().

  My question is: is this a crazy thing to want to do? And if not, is there an advised pattern to follow when implementing something like this?
• Edge detection using 5x5 Laplacian filter

  I'm trying to reproduce the Laplacian edge detection as is implemented here: https://pinetools.com/image-edge-detection

  However, I'm getting results that don't look anything like it.

  Here is the code:

  import cv2
  import numpy as np
  
  img = cv2.imread('image.jpg')
  img = cv2.GaussianBlur(img, (5, 5), 0)
  img = cv2.cvtColor(img, cv2.COLOR_BGR2GRAY)
  
  kernel = np.array([[-1, -1, -1, -1, -1],
                     [-1, -1, -1, -1, -1],
                     [-1, -1, 24, -1, -1],
                     [-1, -1, -1, -1, -1],
                     [-1, -1, -1, -1, -1]]);
  
  laplacian = cv2.filter2D(img, kernel = kernel, ddepth=cv2.CV_64F)
  cv2.normalize(laplacian, laplacian, 0, 255, cv2.NORM_MINMAX)
  laplacian = np.uint8(laplacian)
  
  cv2.imshow('laplacian', laplacian)
  cv2.waitKey(0)
  cv2.destroyAllWindows()
  
• Why do my player images "streak" when they go outside the court on my screen?

  My players move fine until they move outside they court, until the images streak. Why is this?

  I tried changing screen.fill(OUT) to drawing a rectangle the size of the screen.

  import pygame
  import time
  
  pygame.init()
  
  # Define some colors
  BLACK = (0, 0, 0)
  OUT = (193, 58, 34)
  COURT = (69, 150, 81)
  WHITE = (255, 255, 255)
  GREEN = (0, 255, 0)
  SKIN = (232, 214, 162)
  
  ballspeed = 2
  
  # Create the screen
  windowsize = (700, 650)
  screen = pygame.display.set_mode(windowsize)
  pygame.display.set_caption('Tennis')
  
  
  
  
  # Player Sprites
  class Robert(pygame.sprite.Sprite):
  
      def __init__(self):
          pygame.sprite.Sprite.__init__(self)
          self.image = pygame.image.load("Robert_tennis.png")
          self.rect = self.image.get_rect()
          self.rect.center = (400, 575)
          self.speedx = 0
          self.speedy = 0
  
  
      def update(self):
          self.speedx = 0
          self.speedy = 0
          keystate = pygame.key.get_pressed()
          if keystate[pygame.K_LEFT]:
              self.speedx = -4
          if keystate[pygame.K_RIGHT]:
              self.speedx = 4
          self.rect.x += self.speedx
          if self.rect.right > 700:
              self.rect.right = 700
          if self.rect.right < 0:
              self.rect.left = 0
          if keystate[pygame.K_UP]:
              self.speedy = -5
          if keystate[pygame.K_DOWN]:
              self.speedy = 3
          self.rect.y += self.speedy
          if self.rect.y < 325:
              self.rect.y = 325
          if self.rect.y < 0:
              self.rect.y = 0
  
  
  
  
  
  class Camden(pygame.sprite.Sprite):
  
      def __init__(self):
          pygame.sprite.Sprite.__init__(self)
          self.image = pygame.image.load("camden_tennis_front.png")
          self.rect = self.image.get_rect()
          self.rect.center = (260, 80)
          self.speedx = 0
          self.speedy = 0
  
  
      def update(self):
          self.speedx = 0
          self.speedy = 0
          keystate = pygame.key.get_pressed()
          if keystate[pygame.K_a]:
              self.speedx = -6
          if keystate[pygame.K_d]:
              self.speedx = 6
          self.rect.x += self.speedx
          if self.rect.right > 700:
              self.rect.right = 700
          if self.rect.right < 0:
              self.rect.left = 0
          if keystate[pygame.K_w]:
              self.speedy = -7
          if keystate[pygame.K_s]:
              self.speedy = 5
          self.rect.y += self.speedy
          if self.rect.y > 250:
              self.rect.y = 250
          if self.rect.y < 0:
              self.rect.y = 0
  
  
  
  class Ball(pygame.sprite.Sprite):
  
      def __init__(self):
          pygame.sprite.Sprite.__init__(self)
          self.image = pygame.image.load("tennisball.png")
          self.rect = self.image.get_rect()
          self.rect.center = (420, 450)
          self.speedx = 0
          self.speedy = 0
  
  
      def update(self):
          #Robert's forehand
          if tennisball.rect.colliderect(robert) and tennisball.rect.x > robert.rect.x + 10:
              robert.image = pygame.image.load("Robert_tennis2 (1).png")
              effect = pygame.mixer.Sound('tennisserve.wav')
              effect.play(0)
              robert.rect.y -5
              self.speedy = -8
              self.speedx = 4
  
          #Robert's backhand
          if tennisball.rect.colliderect(robert) and tennisball.rect.x < robert.rect.x - 10:
              robert.image = pygame.image.load("Robert_tennis2_backhand.png")
              effect = pygame.mixer.Sound('tennisserve.wav')
              effect.play(0)
              robert.rect.y -5
              self.speedy = -7
              self.speedx = -3
  
  
          #Camden's forehand
          if tennisball.rect.colliderect(camden) and tennisball.rect.x < camden.rect.x -10:
              camden.image = pygame.image.load("camden_front_forehand.png")
              effect = pygame.mixer.Sound('tennisserve.wav')
              effect.play(0)
              camden.rect.y -5
              self.speedy = 9
              self.speedx = 2
  
          keystate = pygame.key.get_pressed()
          if keystate[pygame.K_TAB]:
              self.speedx = -7
              self.speedy = -12
  
          self.speedy = self.speedy * .98
          self.speedx = self.speedx * .978
          self.rect = self.rect.move(self.speedx, self.speedy)
  
  
  #Add people
  all_sprites = pygame.sprite.Group()
  robert = Robert()
  camden = Camden()
  tennisball = Ball()
  all_sprites.add(robert)
  all_sprites.add(tennisball)
  all_sprites.add(camden)
  
  carryOn = True
  clock = pygame.time.Clock()
  
  
  global score
  score = 0
  
  
  screen.fill(OUT)
  
  
  
  
  
  
  
  while carryOn:
      font = pygame.font.Font('freesansbold.ttf', 32)
  
      camden.update()
      robert.update()
      tennisball.update()
  
      epsilonComp = .1
      if abs(tennisball.speedx) < epsilonComp and abs(tennisball.speedy) < epsilonComp:
          if tennisball.rect.x != 360 and tennisball.rect.y != 325:
              if time.time() > 1000:
                  score = 15
                  scorebox = font.render(str(score), True, WHITE, BLACK)
                  scoreRect = scorebox.get_rect()
                  scoreRect.center = (625, 50)
                  screen.blit(scorebox, scoreRect)
  
      for event in pygame.event.get():
          if event.type == pygame.QUIT:
              carryOn = False
          elif event.type == pygame.KEYDOWN:
              if event.key == pygame.K_x:
                  carryOn = False
  
  
  
      all_sprites.update()
  
      #Fill the screen with a sky color
  
      # Draw the court
      pygame.draw.rect(screen, COURT, [175, 75, 350, 500])
  
      #outer left line
      pygame.draw.line(screen, WHITE, (175,574), (175,75), 7)
  
      #outer right line
      pygame.draw.line(screen, WHITE, (525,574), (525,75), 7)
  
      #top center line
      pygame.draw.line(screen, WHITE, (175, 200), (525,200), 7)
  
      #top outer line
      pygame.draw.line(screen, WHITE, (175, 78), (525,78), 7)
  
      #bottom outer line
      pygame.draw.line(screen, WHITE, (175, 571), (525,571), 7)
  
      #bottom center line
      pygame.draw.line(screen, WHITE, (175, 450), (525,450), 7)
  
      #center white line
      pygame.draw.line(screen, WHITE, (345,200), (345,450), 7)
  
      #net
      pygame.draw.line(screen, BLACK, (175,325), (525,325), 10)
  
  
  
      # Update
      all_sprites.draw(screen)
      pygame.display.update()
      clock.tick(60)
  
  pygame.quit()
  

  I just need the player's images to not streak and stay on the screen, and for them to move normally like they do while they're on the court.
• Iterate through each row of CSV and write into individual JSON files in a folder using Python-Pandas

  I am trying to generate separate JSON files for every row using the input as CSV and save in to output folder. Using loop logic.

  Below is the code which will generate json file based on out required json structure. Need help loop logic to iterate through each row and generate json files.

  import json
  
  df = pd.DataFrame([['specs','glass','70072187','ESA65Z45','ESA 65Z45','CUT TIP FG 1808-40'],
                     ['specs','glass','666','ESA6665','ESB 666','CUT TIP FG 66-40']],
                         columns = ['name', 'type','aitm','alitm','aaitm','adsc1' ])
  
  
  data = {'entities':[]}
  for key,grp in df.groupby('name'):
      for idx, row in grp.iterrows():
          temp_dict_alpha = {'name':key, 'type':row['type'], 'data':{'attributes':{}}}
  
          attr_row = row[~row.index.isin(['name','type'])]
          for idx2, row2 in attr_row.iteritems():
              dict_temp = {}
              dict_temp[idx2] = {'values':[]}
              dict_temp[idx2]['values'].append({'value':row2,'source':'internal','locale':'en_US'})
  
              temp_dict_alpha['data']['attributes'].update(dict_temp)
  
          data['entities'].append(temp_dict_alpha)
  
  
  print(json.dumps(data, indent= 4))
  
  with open('C:/Users/usasxs174/Desktop/ETL/Data_tables/sample1.json', 'w') as outfile:
          outfile.write(simplejson.dumps(data, indent=4, ignore_nan=True))```
  
• How to format proc tabulate to produce decimal millions?

  My data is in the format of million and I need to tabulate my data as decimal millions in SAS.

  I have data containing rent in millions of dollars i.e. 1,260,678.21 which I hope to tabulate as decimal millions i.e "1.3".

  I attempted to create my own function to divide by as follows:

             /***/
  * create a function to round 
  *;
  
        proc fcmp outlib=work.function.sample;
        function round1000x(value);
        return(round(value/1000000,1));
        endsub; 
        run; 
  
    *
    * make function available
    *;
    options cmplib=work.func;
  
     *
     * create a format that uses the function
     *;
     proc format; 
       value round1000x.;
     run; 
  
  
   /*use this format in a proc tabulate statement*/
  
   proc tabulate data=my_data format=round1000x.;
  var rent_cost;
  table rent_cost;
    run;
  

  However I am getting the error:

  ERROR: The format ROUND1000X has a label that defines another format to be 
   loaded (named ROUND1000X), but this format could not be 
     successfully loaded (possibly for the same reason).
  

  Would anyone be familiar with this problem?
• Possible to filter search a table (HTML format) created with tabulate() in python?

  Is it possible to filter search a table (HTML format) created with tabulate() in python? I am flashing a tabulate made table into an HTML page, and want to incorporate a search filter into it.

  My current code for making and flashing the table:

  def history():
  
      listOfFiles = os.listdir(VERIFIED_FILE_PATH)
      newList = []
      for file in listOfFiles:
          raw_name = stripExtension(file)
          raw_name = stripDate(raw_name)
          fileType = getFileType(raw_name)
          coID = getCoID(raw_name)      
          newList.append([raw_name, fileType, coID, dateUploaded(file)])
      listTable = tabulate(newList, headers = ['File','Type','CompanyID','Upload Date and time'],tablefmt='html')
      flash(listTable)
      return render_template('history.html')
  

  I am flashing the table to history.html