Related questions

R; Rbind Excel files from a List of vectors of files in R

2018-12-05 19:58 Ethan James imported from Stackoverflow

I have web-scraped ~1000 Excel Files into a specific folder on my computer I then read these files in which returned a value of chr [1:1049] I then grouped these files by similar names which was every 6 belonged in one group This returned a List of 175, with values of the group of 6 file names.

I am confused on how I would run a loop that would merge/rbind the 6 file names for each group from that list. I would also need to remove the first row but I know how to do that part with read.xlsx

My code so far is 

setwd("C:\\Users\\ewarren\\OneDrive\\Documents\\Reservoir Storage")
files <- list.files()
file_groups <- split(files, ceiling(seq_along(files)/6))

with

for (i in file_groups) {
    print(i) 
}

returning each group of file names

The files for example are: files

They are each compromised of two columns, date and amount I need to add a third to each that is the reservoir name That way when all the rows from all the files are combined theres a date, an amount, and a reservoir. If I do them all at once w/o the reservoir, I wouldnt know which rows belong to which.

1 answer

  • answered 2018-12-05 20:19 PDM

    You can use startRow = 2 to not get the first row in read.xlsx

    for merging the groups of file. If you have an identifier e.g. x in each file that matches with their others in the group, but not with the ones which are in other groups.

    you have make a list group1 <- list.files(pattern = "x) then use do.call(cbind, group1)

See also questions close to this topic

  • Retrieve currency date with oanda in R

    I try to retrieve data about the currency pair USD/EUR in R:

    getSymbols("USD/EUR",src="oanda")

    And I get a mistake:

    Error in open.connection(con, "rb") : HTTP error 404.

    Why it is not working?

  • Why does R not display and recognize all factor levels?

    When declaring a variable as factor, R does not recognize all levels as levels

    dataset$search_term_id <- factor(dataset$search_term_id, levels = unique(dataset$search_term_id), nmax = 100000)

    There are only 3,000 levels in the dataset.

    However

    Example

    I have tried multiple ways, using unique() etc. R does not display the number of factor levels correctly. Any ideas?

  • How to extract repeating rows in a matrix

    I R I have this matrix 

    > Y
>      [,1] [,2] [,3] [,4]
[1,] "0"  "2"  "9"  "5" 
[2,] "4"  "7"  "7"  "3" 
[3,] "1"  "5"  "7"  "9" 
[4,] "7"  "8"  "7"  "4" 
[5,] "7"  "8"  "7"  "4" 
[6,] "1"  "1"  "7"  "2" 
[7,] "7"  "8"  "7"  "4" 
...

    From this matrix I want to get all the repeating rows that repeat 1 time, 2 times, 3 times and so on.

    So for example

    "7" "8" "7" "4"

    occurs 3 times in Y. How do I find all the other cases?

  • DataSource.Error: OLE DB: Could not find installable ISAM power query dbf file handleing

    I have checked many answers for my below issue but it is not working yet One of my DBF file handling by Excel powerquery, I am getting this issue in my second pc I am trying below code in the advanced editor : 

    let
Source = OleDb.DataSource("Provider=Microsoft.ACE.OLEDB.12.0;Data Source=D:\Reports\;extended properties=dBASE IV", [Query="select * from [abcdefgh.dbf]"]),
in
Source

    Error message is :

    DataSource.Error: OLE DB: Could not find installable ISAM. Details:
     DataSourceKind=OleDb
     DataSourcePath=data source=C:\Users\standard\Desktop\ThresholdKPI\;extended
 properties=&quot;dBASE IV&quot;;provider=Microsoft.ACE.OLEDB.12.0
     Message=Could not find installable ISAM.
     ErrorCode=-2147467259

    What is wrong with this code I request to answer with example

  • What commands in C# are equivalent to the Excel commands I'm more familiar with?

    Question: What is the C# equivalent of the excel commands INDEX, RANDBETWEEN, &, and "" ?

    Backstory: I would like to make an android app for personal use. Unity is free, but there doesn't seem to be any way of getting around needing to learn some C# code to get the program to do what I want. What would be the C# equivalent of a string of code in Excel? For example, I frequently use the string: =INDEX(A1:A5,RANDBETWEEN(1,rows (A1:A5)))&"Text"

    I use this to index a list in a 1 cell of data, and randomly select something from that list. The & is convenient for stringing the commands together, and the "" displays text.

    My goal is to make an app that randomly generates a sentence on screen, then saves that data for later. OPENASAPP didn't do what I needed it to do. If there is an easier way to make a clean-looking and convenient app like this, I am all ears.

  • how to create a mysql table by csv file header?

    My goal is to create a MySQL table containing data from my CSV file. is there any way to do this i don't know whether it is possible or not thorugh csv. the thing is like i want to generate mysql table using csv headers as filed names i know how to load csv into table which is already created manually but i want to generate table through csv using batch script and below is my batch script to load csv into table through manually

    load data local infile "C:\\EQA\\project\\input1.csv" 
    into table request_table 
    character set latin1 
    fields terminated by','
    ENCLOSED BY '"'
    lines terminated by'\r\n' 
    IGNORE 1 ROWS

    here above code is for to load csv into table in which request_table is existing in db. but i want to load csv into table dynamically? is that possible?if so can some one help me out to accomplish this?

  • Trouble merging CSV files in Java

    If I have three CSV files stored in a folder on my Desktop, how do I access them in Eclipse and merge them using the Java language?

  • get non-merge log commits of merged branches 
    A---B---C---D---E---K (main branch)
     \             /
      F---G---H---I (branch 1)
           \     /
            I---J  (branch 2)

    I have a main branch and around 10 separate branches for individual modules. And each separate branch has multiple branches. It creates a separate commit at the time we merge branches.

    I want to use git log to get all the commits from the main branch, expect all the merge commits. I want to get the commits of the other branches too but remove the commit that was created when a sub-branch is merged into main branches. Is there a way to do that? If I use --no-merge it removes all the commit from other branches, if I use --merges it gives all the commits from other branches including the commits that are used to merge branches.

  • Python 2.7 PyPDF PdfFileMerger decryption

    i've been seraching for a solution to decrypt pdf's by PyPDF PdfFileMerger,But i can only find solution using PdfFileReader Class Can anyone suggest me to do this. Please find My Code below:

    from PyPDF2 import PdfFileMerger

merger = PdfFileMerger(strict=False)
merger.append(open(pdf_name.pdf, 'rb'))

    Error:

      File "/usr/lib/python2.7/site-packages/PyPDF2/pdf.py", line 1150, in getNumPages raise utils.PdfReadError("File has not been decrypted")
  PdfReadError: File has not been decrypted

    Edit: i've Tried this

    if merger.isEncrypted:
   merger.decrypt("")

    But PdfFileMerger module instance has no method like isEncrypted. Instead of doing this i find a solution by using qpdf -decrypt input.pdf output.pdf