SD Card Issues

By | March 11, 2014

I’ve had 16 Pis running for about a week (with 16 GB SD cards) with no trouble. I’ve been running them with only 2 of 4 intake fans to maintain a power-to-airflow ratio that’s close to what I should expect from having all 40 of them running. I’ve been seeing case temperatures of roughly 31 °C (88 °F) and core temperatures of up to 77 °C (171 °F). 77 °C seems kind of hot to me, but it’s still acceptable for a BCM2835 core. I’ve read that 85 °C is supposed to be their limit, but this announcement by the Raspberry Pi foundation seems to indicate that 85 °C is an acceptable steady-state operating temperature.

Two nights ago, I decided to bring the remaining 24 Pis online. This required that I use 24 of my 8 GB SD cards . I didn’t anticipate any problems. I flashed 24 fresh 8 GB cards, brought the other 2 intake fans back online, and booted the remaining 24 Pis.

I went to the work of assigning static IPs to all of them. (Managing 40 machines through SSH without assigning static IPs is a hassle.) But, an hour or so in, I had to hard reset the whole system. As it came back online, I noticed that some machines didn’t appear to be booting up properly. (Their indicator lights were staying red.)

After a lot of trial and error to try to get these machines to boot, I realized that a whole bunch of the SD cards had warped, as shown in the photo below:
Warped SD Cards

 

Since the biggest group of them failed, I’ve noticed that a couple of stragglers have also warped to the point that they no longer work. This is important to note, because I’ve been running the system with no filters and with the left side of the case off, which greatly increases airflow. So the warping is continuing, in spite of the fact that they’re probably at no more than 55 °C now.

I’m not really sure what to blame for this. The Pi’s SD card socket doesn’t back the card when it’s fully inserted, which seems like a weakness in the design that would allow this to happen. However, Kingston rates these SD4 series cards for 85 °C and I have a hard time believing that any of them got over 70 °C at any time. There’s also the fact that the 16 GB cards haven’t had the same problem, which leads me to believe this is specifically an issue with the SD4/8GB. Either way, I’m pretty sure the solution is to add a clip to the socket to back the SD card so it doesn’t warp.

2 thoughts on “SD Card Issues

  1. jim stephens

    We have noticed a problem, possibly unrelated to yours with temperature with the Pi. We have a number of individual units running as firewalls in pretty benign thermal environments, just running in open air.

    I have a number which run at 45 to 55c and there are a number of them which run at 55 to 60+ C in open air.

    We have had to try to go the the earlier ones, which happen to be the cooler ones to get reliable operation. The failure symptom is a panic which we get the last bit of on the screen, related to missing interrupts. We have not hooked up serial consoles to monitor all of the panic message, and so do not have anything but what we captured on the screen.

    The system we are running is the ipfire firewall, which is getting the problem, not any of the official pi kernel builds.

    Jim

    1. David Guill Post author

      Most of my Pis have been pretty reliable since I replaced most of the SD card sockets, but I only leave my cluster running overnight if it’s working on something. You may have a lot more data on this than I would if you’re running several dozen of them 24/7. I also wouldn’t have any way to know if I’ve experienced this mode of failure, since I can’t access the HDMI port on any of the Pis in my cluster.

      I wish you luck in sorting it out though.

Comments are closed.