Open very large text files

Solved
papa -  
 utitisateur -
Hello,

I am regularly faced with a problem => when there is an issue on a server, the logs start to grow and sometimes form enormous files (200 MB for example).
Other times, these are HTML files generated by a link analyzer.

In any case, once the file is created, it is almost impossible to open it.

Is there a way to either open the file in chunks or split it into usable and ordered pieces?

Thank you

H
Configuration: Windows Vista Internet Explorer 7.0

9 réponses

arnoweb Posted messages 11 Status Membre 44
 
The only software I know that can open very large files (that even Notepad++ can't open) is: Ltfviewer.
40
Youssouf
 
Thank you very much, Sir.
0
Zeel
 
It works perfectly, thank you.
0
Mikeov
 
it didn't work with a 500GB file, but UltraEdit did
0
utitisateur
 
It works with a 10.8 GB CSV file.
0
MicMac81
 
I use ultraedit at home and at work. It is very powerful for manipulating data files (text or binary).
The largest file I had to process was over 3GB.
Practically limitless, as it uses disk space to manage large files, unlike other editors that are only meant for "coding" and not for data manipulation.
9
HostOfSeraphim Posted messages 7340 Status Contributeur 1 609
 
You would be happy under Linux...

"cat filename" and there you go :)

Let's see if this command can be used on Windows as well (wget can, for example).

--
Configuration: Linux Ubuntu 7.10 Gusty Gibbon / GNOME / Bash / Firefox 2
Internet Connection: ADSL Orange 8M (Livebox)
0
papa
 
(wget is, for example).

Can you be more specific (I do PHP but I have no initial computer background)

Thank you
0
HostOfSeraphim Posted messages 7340 Status Contributeur 1 609
 
Apparently, "type" does the same thing on Windows.

Try in the command prompt:

C:\>type file.txt


--
Configuration: Linux Ubuntu 7.10 Gusty Gibbon / GNOME / Bash / Firefox 2
Internet Connection: ADSL Orange 8M (Livebox)
0
Anonymous user
 
Hello everyone,

I don't have the solution to your question, but just a remark to make. I have a text file of 1.2MB, and it already takes almost 5 seconds to open it, so I think it's not a big problem, we can wait a little. But the real issue is that it contains 1260 lines without automatic line breaks, so I'm wondering what your 200MB file could contain, and even if you divide it into 200 pieces of 1MB each, how will it be usable!!!

If the content processing is done by computer, I don't see the point in dividing this file. And if it's done manually, it won't be fun at all, it's going to take you months!
--

zboot
0
xps.fps
 
I'm having the same problem; I generate txt files of 2GB or more, and it's needless to say that no software can open them; even Notepad++ says it's too big... if you have an idea for splitting a txt file, please let me know.
0
Anonymous user
 
Hi,

I advise you to start a new discussion here

@ +
--
►╠◊◊fĀĥĔďŎὫ◊◊╣ ; Call me Fahd ;-)
0
Fanfan72
 
Unbeatable in reading mode
=> ltfviewer : http://www.swiftgear.com/ltfviewer/features.html
0
bidouille
 
type [file name] | more
| More allows you to read the file in small portions.
One of the first commands I learned, originally under DOS 3.1.
0
Anonymous user
 
Otherwise, you have a good program, it's Notepad++

https://www.commentcamarche.net/telecharger/developpement/16295-notepad/

Best regards
-3
papa
 
Splendid!!!!!!!!!!!!!!!!!!!!!!!!!!!!

It works

10 seconds for 718,000 lines of HTML (70 MB) and just as much to go from the beginning to the end of the document

Thank you
0
Kropernic > papa
 
Same question but for a file of almost 2 GB.

No way to open it with Notepad or Notepad++, they say the file is too large.

What to do? ^^
0
Manitra
 
Notepad++ is a very good editor, but it loads the entire file into memory => impossible to read a file that is double the RAM of your computer.
0
Nicolas
 
Hello,

Ultra Edit is capable of handling files larger than several gigabytes, but it is paid... :(
0
Guerini
 
PSPad has been quite helpful, and it's also freeware.
Otherwise, Vim should do the trick.
0