View original (French)

Open very large text files

Solved
papa -  
 utitisateur -
Hello,

I am regularly faced with a problem => when there is an issue on a server, the logs start to grow and sometimes form enormous files (200 MB for example).
Other times, these are HTML files generated by a link analyzer.

In any case, once the file is created, it is almost impossible to open it.

Is there a way to either open the file in chunks or split it into usable and ordered pieces?

Thank you

H
Configuration: Windows Vista Internet Explorer 7.0

9 answers

  1.
    arnoweb Posted messages 11 Status Member 44
     
    The only software I know that can open very large files (that even Notepad++ can't open) is: Ltfviewer.
    40
    1. Youssouf
       
      Thank you very much, Sir.
      0
    2. Zeel
       
      It works perfectly, thank you.
      0
    3. Mikeov
       
      it didn't work with a 500GB file, but UltraEdit did
      0
    4. utitisateur
       
      It works with a 10.8 GB CSV file.
      0
  2. MicMac81
     
    I use ultraedit at home and at work. It is very powerful for manipulating data files (text or binary).
    The largest file I had to process was over 3GB.
    Practically limitless, as it uses disk space to manage large files, unlike other editors that are only meant for "coding" and not for data manipulation.
    9
  3. HostOfSeraphim Posted messages 7340 Status Contributor 1 609
     
    You would be happy under Linux...

    "cat filename" and there you go :)

    Let's see if this command can be used on Windows as well (wget can, for example).

    --
    Configuration: Linux Ubuntu 7.10 Gusty Gibbon / GNOME / Bash / Firefox 2
    Internet Connection: ADSL Orange 8M (Livebox)
    0
  4. papa
     
    (wget is, for example).

    Can you be more specific (I do PHP but I have no initial computer background)

    Thank you
    0
    1. HostOfSeraphim Posted messages 7340 Status Contributor 1 609
       
      Apparently, "type" does the same thing on Windows.

      Try in the command prompt:

      C:\>type file.txt


      --
      Configuration: Linux Ubuntu 7.10 Gusty Gibbon / GNOME / Bash / Firefox 2
      Internet Connection: ADSL Orange 8M (Livebox)
      0
  6. Anonymous user
     
    Hello everyone,

    I don't have the solution to your question, but just a remark to make. I have a text file of 1.2MB, and it already takes almost 5 seconds to open it, so I think it's not a big problem, we can wait a little. But the real issue is that it contains 1260 lines without automatic line breaks, so I'm wondering what your 200MB file could contain, and even if you divide it into 200 pieces of 1MB each, how will it be usable!!!

    If the content processing is done by computer, I don't see the point in dividing this file. And if it's done manually, it won't be fun at all, it's going to take you months!
    --

    zboot
    0
  7. xps.fps
     
    I'm having the same problem; I generate txt files of 2GB or more, and it's needless to say that no software can open them; even Notepad++ says it's too big... if you have an idea for splitting a txt file, please let me know.
    0
    1. Anonymous user
       
      Hi,

      I advise you to start a new discussion here

      @ +
      --
      ►╠◊◊fĀĥĔďŎὫ◊◊╣ ; Call me Fahd ;-)
      0
  8. Fanfan72
     
    Unbeatable in reading mode
    => ltfviewer : http://www.swiftgear.com/ltfviewer/features.html
    0
  9. bidouille
     
    type [file name] | more
    | More allows you to read the file in small portions.
    One of the first commands I learned, originally under DOS 3.1.
    0
  10. Anonymous user
     
    Otherwise, you have a good program, it's Notepad++

    https://www.commentcamarche.net/telecharger/developpement/16295-notepad/

    Best regards
    -3
    1. papa
       
      Splendid!!!!!!!!!!!!!!!!!!!!!!!!!!!!

      It works

      10 seconds for 718,000 lines of HTML (70 MB) and just as much to go from the beginning to the end of the document

      Thank you
      0
    2. Kropernic > papa
       
      Same question but for a file of almost 2 GB.

      No way to open it with Notepad or Notepad++, they say the file is too large.

      What to do? ^^
      0
    3. Manitra
       
      Notepad++ is a very good editor, but it loads the entire file into memory => impossible to read a file that is double the RAM of your computer.
      0
    4. Nicolas
       
      Hello,

      Ultra Edit is capable of handling files larger than several gigabytes, but it is paid... :(
      0
    5. Guerini
       
      PSPad has been quite helpful, and it's also freeware.
      Otherwise, Vim should do the trick.
      0