Removing duplicates from a list of dictionaries in Python using deepcopy

See also questions close to this topic

• Python File Tagging System does not retrieve nested dictionaries in dictionary

  I am building a file tagging system using Python. The idea is simple. Given a directory of files (and files within subdirectories), I want to filter them out using a filter input and tag those files with a word or a phrase.

  If I got the following contents in my current directory:

  data/
     budget.xls
     world_building_budget.txt
  a.txt
  b.exe
  hello_world.dat
  world_builder.spec
  

  and I execute the following command in the shell:

  py -3 tag_tool.py -filter=world -tag="World-Building Tool"
  

  My output will be:

  These files were tagged with "World-Building Tool":
  data/ world_building_budget.txt
  hello_world.dat
  world_builder.spec
  

  My current output isn't exactly like this but basically, I am converting all files and files within subdirectories into a single dictionary like this:

  def fs_tree_to_dict(path_):
      file_token = ''
      for root, dirs, files in os.walk(path_):
          tree = {d: fs_tree_to_dict(os.path.join(root, d)) for d in dirs}
          tree.update({f: file_token for f in files})
          return tree
  

  Right now, my dictionary looks like this: key:''.

  In the following function, I am turning the empty values '' into empty lists (to hold my tags):

  def empty_str_to_list(d):
      for k,v in d.items():
          if v == '':
              d[k] = []
          elif isinstance(v, dict):
              empty_str_to_list(v)
  

  When I run my entire code, this is my output:

  hello_world.dat ['World-Building Tool']
  world_builder.spec ['World-Building Tool']
  

  But it does not see data/world_building_budget.txt. This is the full dictionary:

  {'data': {'world_building_budget.txt': []},  
  'a.txt': [],
  'hello_world.dat': [], 
  'b.exe': [], 
  'world_builder.spec': []}
  
  

  This is my full code:

  import os, argparse
  
  
  def fs_tree_to_dict(path_):
      file_token = ''
      for root, dirs, files in os.walk(path_):
          tree = {d: fs_tree_to_dict(os.path.join(root, d)) for d in dirs}
          tree.update({f: file_token for f in files})
          return tree
  
  
  def empty_str_to_list(d):
      for k, v in d.items():
          if v == '':
              d[k] = []
          elif isinstance(v, dict):
              empty_str_to_list(v)
  
  
  parser = argparse.ArgumentParser(description="Just an example", formatter_class=argparse.ArgumentDefaultsHelpFormatter)
  
  parser.add_argument("--filter", action="store", help="keyword to filter files")
  parser.add_argument("--tag", action="store", help="a tag phrase to attach to a file")
  parser.add_argument("--get_tagged", action="store", help="retrieve files matching an existing tag")
  
  args = parser.parse_args()
  
  filter = args.filter
  tag = args.tag
  get_tagged = args.get_tagged
  current_dir = os.getcwd()
  
  files_dict = fs_tree_to_dict(current_dir)
  empty_str_to_list(files_dict)
  
  for k, v in files_dict.items():
      if filter in k:
          if v == []:
              v.append(tag)
              print(k, v)
  
          elif isinstance(v, dict):
              empty_str_to_list(v)
  
      if get_tagged in v:
          print(k, v)
  
• Actaully i am working on a project and in it, it is showing no module name pip_internal plz help me for the same. I am using pycharm(conda interpreter

   File "C:\Users\pjain\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
      return _run_code(code, main_globals, None,
    File "C:\Users\pjain\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code
      exec(code, run_globals)
    File "C:\Users\pjain\AppData\Local\Programs\Python\Python310\Scripts\pip.exe\__main__.py", line 4, in <module>
    File "C:\Users\pjain\AppData\Local\Programs\Python\Python310\lib\site-packages\pip\_internal\__init__.py", line 4, in <module>
      from pip_internal.utils import _log
  

  I am using pycharm with conda interpreter.

  
• Looping the function if the input is not string

  I'm new to python (first of all) I have a homework to do a function about checking if an item exists in a dictionary or not.

  inventory = {"apple" : 50, "orange" : 50, "pineapple" : 70, "strawberry" : 30}
  
  def check_item():
      x = input("Enter the fruit's name: ")
      if not x.isalpha():
          print("Error! You need to type the name of the fruit")
      elif x in inventory:
          print("Fruit found:", x)
          print("Inventory available:", inventory[x],"KG")
      else:
          print("Fruit not found")
  check_item()
  

  I want the function to loop again only if the input written is not string. I've tried to type return Under print("Error! You need to type the name of the fruit") but didn't work. Help
• how do I dissable debian python path/recursion limit

  so, as of late, I've been having path length limit and recursion limit issues, so I really need to know how to disable these.

  I can't even install modules like discord.py!!!!
• TypeError: 'float' object cannot be interpreted as an integer on linspace

     TypeError                                 Traceback (most recent call last)
  d:\website\SpeechProcessForMachineLearning-master\SpeechProcessForMachineLearning-master\speech_process.ipynb Cell 15' in <cell line: 1>()
  
       -->1 plot_freq(signal, sample_rate)
  d:\website\SpeechProcessForMachineLearning-master\SpeechProcessForMachineLearning-master\speech_process.ipynb Cell 10' in plot_freq(signal, sample_rate, fft_size)
  
          2 def plot_freq(signal, sample_rate, fft_size=512):
            3     xf = np.fft.rfft(signal, fft_size) / fft_size
      ----> 4     freq = np.linspace(0, sample_rate/2, fft_size/2 + 1)
            5     xfp = 20 * np.log10(np.clip(np.abs(xf), 1e-20, 1e100))
            6     plt.figure(figsize=(20, 5))
  
  File <__array_function__ internals>:5, in linspace(*args, **kwargs)
  
  File ~\AppData\Local\Programs\Python\Python39\lib\site-packages\numpy\core\function_base.py:120, in linspace(start, stop, num, endpoint, retstep, dtype, axis)
  
       23 @array_function_dispatch(_linspace_dispatcher)
           24 def linspace(start, stop, num=50, endpoint=True, retstep=False, dtype=None,
           25              axis=0):
           26     """
           27     Return evenly spaced numbers over a specified interval.
           28 
         (...)
          118 
          119     """
      --> 120     num = operator.index(num)
          121     if num < 0:
          122         raise ValueError("Number of samples, %s, must be non-negative." % num)
      
      TypeError: 'float' object cannot be interpreted as an integer
  

  What solution about this problem?
• IndexError: list index out of range with api

  all_currencies = currency_api('latest', 'currencies')  # {'eur': 'Euro', 'usd': 'United States dollar', ...}
  all_currencies.pop('brl')
  qtd_moedas = len(all_currencies)
  texto = f'{qtd_moedas} Moedas encontradas\n\n'
  moedas_importantes = ['usd', 'eur', 'gbp', 'chf', 'jpy', 'rub', 'aud', 'cad', 'ars']
  
  while len(moedas_importantes) != 0:
      for codigo, moeda in all_currencies.items():
          if codigo == moedas_importantes[0]:
              cotacao, data = currency_api('latest', f'currencies/{codigo}/brl')['brl'], currency_api('latest', f'currencies/{codigo}/brl')['date']
              texto += f'{moeda} ({codigo.upper()}) = R$ {cotacao}   [{data}]\n'
              moedas_importantes.remove(codigo)
              if len(moedas_importantes) == 0: break  # WITHOUT THIS LINE, GIVES ERROR
  

  Why am I getting this error? the list actually runs out of elements, but the code only works with the if
• Nested list in C# with layers

  I am not an expert coder and I have just started learning about Generic data types. What I am trying to code is a List inside of a list inside of a list .

  For example- at the first level - I want numbers each inside of a list

  Layer 1 list1=[1,2,3,4,5,6,7,8,9,10......1000] ,

  At the 2nd layer I'd like list from 1st layer added as an element to a parent list 2 when layer 1 meets certain condition- ex layer 1 reaches max=10

  List2=[List1[0:10],List1[10:20],List1[20:30], .....] ,

  At layer 3, i'd like to repeat the process, all elements of layer 2 get added as an element to a new parent list 3 when layer 2 meets a max condition. list3[0]=[list2[0:10],list2[10:20],list2[20:30]..... and so on.

  Only the first layer would have integer values, the successive layer would be a wrapping of it's the previous layer. How can I code this in C#?

  Thanks!
• python list ofwords.the program outputsthosewords&theirfrequencies.Ex:if the input is:hey hi Mark hi mark the output is: hey 1 hi 2 Mark 2 hi 2 mark 2

  I thought I could use this code:

  wordInput = input()
  
  myList = wordInput.split(" ")
  
  for i in myList:
  
     print(i,myList.count(i))
  

  but its output is:

  hey 1
  Hi 1
  Mark 1
  hi 1
  mark 1
  

  How can I make it:

  Hey 1
  Hi 2
  Mark 2
  hi 2
  mark 2
  
• How to convert DataTable to List<T> in C#

  For convert DataTable to List you can used the AutoMapper Library and you can do it automatically
• VBA: Creating a class property that is an array of dictionaries

  In Microsoft Excel VBA I need to create a class that has two properties, "Name" and "Holdings". "Name" is just a string so the code for that is easy. But I need "Holdings" to be a variable length array containing dictionary objects. So this is what I wrote:

  Private mName As String
  Private mHoldings() As Scripting.Dictionary
  
  Public Property Let Name(vName As String)
        mName = vName
  End Property
   
  Public Property Get Name() As String
        Name = mName
  End Property
   
  Public Property Set Holdings(vHoldings() As Scripting.Dictionary)
        Set mHoldings = vHoldings
  End Property
   
  Public Property Get Holdings() As Scripting.Dictionary
        Set Holdings = mHoldings
  End Property
  

  When I try to compile it gives me this error: "Definitions of property procedures for the same property are inconsistent, or property procedure has an optional parameter, a ParamArray, or an invalide Set final parameter.

  What I doing wrong?
• Map for react-native ( No google map and apple map)

  Is there a map that can be used in React-Native?

  If so, please upload an example of how to use it.

  But again! No Google map and Apple map.
• In Mongo, If a document I'm saving "Prateek" then I don't want on the next create operation even the "prateek" or "praTEEK", etc is saved

  //** If I'm adding a new document with the name: "India", then I don't want that the DB allow another name with the name: "INDIA", "india", "indIA", etc. I'm new and learning, help would be great!!**

  // Controller

  var Dinosaur = require('../models/dinosaurs');
  
  //addDino
  module.exports.addDino = (req, res) => {
      var name = req.body.name;
      var type = req.body.type;
      var height = req.body.height;
      var weight = req.body.weight;
      var Period = req.body.Period;
  
      req.checkBody('name', 'Name is required').notEmpty();
  
      var errors = req.validationErrors();
      if (errors)
          return res.status(400).send({
              message: 'Name is Required'
          });
      else {
          let newDino = {
              name: name,
              type: type,
              height: height,
              weight: weight,
              Period: Period
          }
          Dinosaur.addDino(newDino, (err, result) => {
              if (err) {
                  if (err.name) return res.status(409).send({
                      message: name + ' Already Exist'
                  });
                  else if (err.url) return res.json({ status: false, error: { url: "Url already exist" }, message: err.url });
                  else return res.json(err, "Server Error");
              }
              else {
                  return res.status(200).send({
                      message: "Done"
                  });
              }
          });
      }
  }
  

  // Model

  var mongoose = require('mongoose');
  
  //dinosaur schema
  var DinosaurSchema = mongoose.Schema({
      name: {
          type: String,
          unique: true
      },
      type: {
          type: String
      },
      height: {
          type: Number
      },
      weight: {
          type: Number
      },
      Period: {
          type: String
      }
  });
  
  var Dinosaur = mongoose.model('dinosaur', DinosaurSchema);
  
  //add
  module.exports.addDino = (query, callback) => {
      Dinosaur.create(query, callback);
  }
  

  // GetAll, Already Created a new document with the name "Brachiosaurus"

  

  // > Create, a new create with the first letter lower case "brachiosaurus", Don't want it to be pushed.

  //Get All, Got pushed.
• Update column values based on another dataframe's index

  I have the following dataframes:

  NUMS = ['1', '2', '3', '4', '5']
  LETTERS = ['a', 'b', 'c']
  df1 = pd.DataFrame(index=NUMS, columns=LETTERS)
      a    b    c
  1  NaN  NaN  NaN
  2  NaN  NaN  NaN
  3  NaN  NaN  NaN
  4  NaN  NaN  NaN
  5  NaN  NaN  NaN
  
  df2 = pd.DataFrame([['tom', 10], ['nick', 15], ['james', 14]],
                     index=LETTERS,
                     columns=['col', 'col2'])
      col  col2
  a    tom    10
  b   nick    15
  c  james    14
  

  I'm trying to update df1 with df2 so that if the column matches the index from df2, all rows are updated with col2:

      a    b    c
  1   10   15  14
  2   10   15  14
  3   10   15  14
  4   10   15  14
  5   10   15  14
  

  I've tried df1.update(df2['col2']), but df1 does not update.

  I've also tried df1.apply(lambda x: df2['col2'].loc[x]), but I'm getting the following error:

  KeyError: "None of [Float64Index([nan, nan, nan, nan, nan], dtype='float64')] are in the [index]"
  

  Thank you!
• How to delete certain number from a list in list using the index in python?

  I have a list in a list, and I am trying to delete the third number of each sublist, but every time I am getting an error TypeError: list indices must be integers or slices, not list

  a = [[0.0, 0.0, 0.0], [0.19, 0.36, 0.0], [0.24, 0.42, 0.0], [0.16, 0.08, 0.0], [0.05, -0.57, 0.0] ]
  
  

  Desired result:-

  a_updated = [[0.0, 0.0], [0.19, 0.36], [0.24, 0.42], [0.16, 0.08], [0.05, -0.57] ]
  
  

  In the second part of my code, I wanted to merge this sublist according to a dictionary shown below, for example, the first value of dictionary:- 1: [1, 2] shows the merging of 1st and 2nd values i.e. [0, 0, 0.19, 0.36].

  I guess this part of my code is right!

  dict_a = { {1: [1, 2], 2: [2, 4], 3: [3, 5], 4: [4, 5] }
  
  

  my attempt:-

  dict_a = { 1: [1, 2], 2: [2, 4], 3: [3, 5], 4: [4, 5]}
  
  a = [[0.0, 0.0], [0.19, 0.36], [0.24, 0.42], [0.16, 0.08], [0.05, -0.57]]
         
  
  # first part 
  for i in a:
      for j in a[i]:
              del j[2]
      print(j)
      
      
  #second part   
  a_list = []
  list_of_index = []
  for i in dict_a:
      index= []
      a_list.append(index)
      for j in dict_a_updated[i]:
              print(j-1)
              index.extend(a_updated[j-1])    
      print('index',index)
      
      
  
  

  Error output -

  
  file "D:\python programming\random python files\4 may axial dis.py", line 18, in <module>
      for j in X[i]:
  
  TypeError: list indices must be integers or slices, not list