961

muskrat's data eng expert's hard drive overheats while processing 60k rows(lemmy.dbzer0.com)

posted
by
Avatar
SchwertImStein@lemmy.dbzer0.com
in
Avatar
programmer_humor@programming.dev
288 comments
hidereport
Sort:
HotTopControversialNewOld
You are viewing a single thread.
View all comments View context
Avatar
easily3667@lemmus.org
143 points

60k is laughably, embarrassingly small. It’s still sqlite-sized.

permalink
report
parent
reply
Avatar
naught@sh.itjust.works
58 points

i mean its even excel sized depending on how many columns. This is seriously sad and alarming

permalink
report
parent
reply
Avatar
easily3667@lemmus.org
11 points
*

Hey now that’s real close to the 65,535 16-bit limit (from 20 years ago)

permalink
report
parent
reply
Avatar
wise_pancake@lemmy.ca
3 points

Holy shit if this ids lm issue that’s too funny

permalink
report
parent
reply
Avatar
morrowind@lemmy.ml
50 points

Sqlite can easily handle millions of rows. Don’t sell it short

permalink
report
parent
reply
Avatar
The_Decryptor@aussie.zone
9 points
permalink
report
parent
reply
Avatar
morrowind@lemmy.ml
6 points

Should be enough to hold 60k rows

permalink
report
parent
reply
Avatar
Korhaka@sopuli.xyz
4 points

I have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable

permalink
report
parent
reply
Avatar
easily3667@lemmus.org
1 point

I’m not

permalink
report
parent
reply
Avatar
Hotzilla@sopuli.xyz
4 points

60k is single json file

permalink
report
parent
reply

Programmer Humor

!programmer_humor@programming.dev

Create post

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

  • Keep content in english
  • No advertisements
  • Posts must be related to programming or programmer topics

Community stats

  • 8.7K

    Monthly active users

  • 1.2K

    Posts

  • 25K

    Comments

Community moderators