this post was submitted on 24 Jul 2023
7 points (88.9% liked)

Lemmy.ca's Main Community

2811 readers
2 users here now

Welcome to lemmy.ca's c/main!

Since everyone on lemmy.ca gets subscribed here, this is the place to chat about the goings on at lemmy.ca, support-type items, suggestions, etc.

Announcements can be found at https://lemmy.ca/c/meta

For support related to this instance, use https://lemmy.ca/c/lemmy_ca_support

founded 3 years ago
MODERATORS
7
Downtime (lemmy.ca)
submitted 1 year ago* (last edited 1 year ago) by Shadow@lemmy.ca to c/main@lemmy.ca
 

Sorry about that! Service ran out of memory for some reason and I took some time to investigate.

Edit: Going to take a second hit, rebooting again to roll back a kernel upgrade that was applied yesterday.

Edit2: It's fixed properly now.

top 6 comments
sorted by: hot top controversial new old
[–] Shadow@lemmy.ca 2 points 1 year ago* (last edited 1 year ago) (2 children)

We seem to be missing about 20gb of our system memory. https://pastebin.com/teprs4qA

Let me know if you have any ideas. No it's not cache, and there's no ZFS on the system =)

[–] Shadow@lemmy.ca 2 points 1 year ago* (last edited 1 year ago)

Never mind, figured it out. I turned on hugepages without setting it up properly.

Look at all this beautiful free ram.

lemmy01 ~ # free -m
               total        used        free      shared  buff/cache   available
Mem:           31983        1491       20070         558       10421       29485
Swap:           1023           3        1020
[–] anonymoose@lemmy.ca 1 points 1 year ago

No ideas here, but memory leaks are always fun to diagnose 🙃

[–] Zoidsberg@lemmy.ca 1 points 1 year ago (1 children)

Is there somewhere we can look for updates (maybe a Mastodon account) when something like this happens?

Thanks for getting it back online so quickly!

[–] Shadow@lemmy.ca 2 points 1 year ago

https://status.lemmy.ca/

The section at the top auto updates.

[–] Grant_M@lemmy.ca 1 points 1 year ago

Thank you for the update!