Large File being truncated on Save!
-
Following is the requested debug info:
Notepad++ v8.4.4 (64-bit)
Build time : Jul 15 2022 - 17:54:42
Path : C:\Program Files\Notepad++\notepad++.exe
Command Line :
Admin mode : OFF
Local Conf mode : OFF
Cloud Config : OFF
OS Name : Windows 10 Pro (64-bit)
OS Version : 21H2
OS Build : 19044.1889
Current ANSI codepage : 1252
Plugins :
mimeTools (2.8)
NppConverter (4.4)
NppExport (0.4)The issue I am having is I am trying to edit a CSV file with the size of 8,712,911KB, Notepad++ opens the file with no problem, I make a change to the first row and save it and now the file size is 324,303KB !!! Is there an option to process LARGE files and save them correctly after they have been editted? Any help will be greatly appreciated!! Thanks in advance! Rick
-
An (almost) 9GB file is fairly ambitious! :-)
What is the nature of the truncation? Is the resulting file the first so-many lines of the original, or is the save changing the data in some other way?
-
@Alan-Kilborn The data is the same it is just truncating the rest of the file at the point I stated above. So the data is ok, it is just stopping the save at the point I said.
-
Perhaps I’m grasping at straws now to offer something, but I’m wondering about the number of lines in the original file, and the same for the shortened file…
I’m wondering, if your data is not confidential, if zipping it and creating a Notepad++ “issue” concerning this is the way to go? That way others could try reproducing your exact experience.
I wouldn’t advise putting your data on “any old filesharing site” and providing a link here, because, well, I wouldn’t go there to get it (and others here wouldn’t either). Again, only consider creating an issue if your data is sharable.
See HERE for some info on creating an “issue” aka “bug report”.
-
@Alan-Kilborn Hi Allen, thanks for all the help so far. The data I have been working with is not confidential and is from the Government. Below are the instructions to get the file and the steps I have done to reproduce the problem, which is probably the easiest way to go, I think. Please let me know if there is anything else you might need. Thanks, Rick
Instructions for accessing the table I have been working with.
-
Go to the following link: https://download.cms.gov/nppes/NPI_Files.html
-
Download the file right below the statement “Full Replacement Monthly NPI File”
Entitled: “NPPES Data Dissemination (August 09, 2022) - ZIP format (871 MB)”
-
Unzip the following file: “npidata_pfile_20050523-20220807.csv” from the zip
file you downloaded. -
That file is the one I have been working with.
-
Note the size of the file before you open it.
-
Open the file with Notepad++ and make one simple change
-
Save the file to a different name and now notice the size of the file.
-
-
@Richard-Murray said in Large File being truncated on Save!:
The issue I am having is I am trying to edit a CSV file with the size of 8,712,911KB, Notepad++ opens the file with no problem, I make a change to the first row and save it and now the file size is 324,303KB !!!
I can duplicate these results.
I suggest you put in an “issue” as I originally suggested, and let Notepad++ developers have a look at it.
Perhaps directly attach the zipped file if there’s a chance that the original file may be removed from its site before developers get a chance to get in to the problem – sometimes that takes a while. -
@Richard-Murray Did you create a ticket? Did you find a solution? The same is happening to me.
-
I saw this similar Github issue, which I could reproduce but haven’t had a time for an investigation yet.
-
I have identified the relevant problem in the N++ code.
Further possible progress in the issue above. -
I have the same problem whit a text file. The original file is 9.046.007.808 bytes then I edited and saved the is 456.073.216 bytes.
-
@Seba-G said in Large File being truncated on Save!:
I have the same problem whit a text file. The original file is 9.046.007.808 bytes then I edited and saved the is 456.073.216 bytes.
Saving of >4GB files is the first fix listed in the v8.4.9 Release Candidate. You should try that version out… and if it still truncates large files, post in that thread I just linked to.
—
PS: if you do post in that thread, make sure you include details: especially include the ?-menu’s Debug Info, and anything else you think might be relevant (local drive versus network drive/cloud-directory). The more relevant details you provide, the better the chances that the developers will be able to reproduce your problem and hopefully fix it. -
I just tried editing (adding 3 letters) the CSV file now and it worked OK with Notepad++ version 8.4.9. Initial file size was 9,138,779,797 bytes and after editing 9,138,779,800 bytes. It took about 2 minutes to load and then 2 minutes to save on my NUC 5i5.