Big data

[Dottleshead ★]

python -m isi.ph.ph_mw -f /ifs/big.dip -m $((10*1024**4)) --write-pattern dip -vvv

 

# ls -ltr
-rw-r--r--      1 root  wheel            1033 Nov 12 12:18 README.txt
drwxrwxr-x      4 root  wheel              28 Nov 12 12:18 home
drwxrwxrwx      4 root  wheel              54 Nov 13 07:18 data
-rw-rw-rw-      1 root  wheel  17592186044416 Nov 14 12:14 big.dip

 

You want that in unit suffixes??

# ls -lthr
-rw-r--r--      1 root  wheel   1.0K Nov 12 12:18 README.txt
drwxrwxr-x      4 root  wheel    28B Nov 12 12:18 home
drwxrwxrwx      4 root  wheel    54B Nov 13 07:18 data
-rw-rw-rw-      1 root  wheel    16T Nov 14 12:14 big.dip
 

 

16 terabyte files are hard to come by.

[jsharr ★]

Probably a list of all of Airwick's forum grievances.

[JerrySTL ★]

Wow. I was going to request the -h.

What happens when you compress or gzip it? I once create a 10 mb text file of just the a character.  Pkzip brought it down to 5 kb.

[Indy]

2 minutes ago, jsharr said:

Probably a list of all of Airwick's forum grievances.

And "data" contains all of your funny forum posts.

[Dottleshead ★]

4 hours ago, JerrySTL said:

Wow. I was going to request the -h.

What happens when you compress or gzip it? I once create a 10 mb text file of just the a character.  Pkzip brought it down to 5 kb.

If I can remember tomorrow, I will try. I was actually running a test at the time.