drive

The dumbfuckery of storage drive data integrity

With all the complicated standards including data integrity, it is outrageous how useless it all still is.

I got a 4 TB WD Black harddisk that is probably 99.99999999% just fine, but it is telling me it will die in less than 24 hours and I better throw it in the trash.

If your harddisk suffers from a bad sector, the file occupying it is ruined. But you usually won’t even know that until you try to access it manually, directly, intentionally, and that fails.

Generally you might get a warning of some kind. So you know there’s a defect.
Now, to find out where it is, you need a special tool like GSmartControl that can show you the log and then the 24 or so latest entries shown and spammed with the same error are hopefully indicating only onw bad sector.

Then you would have to use a Windows command line tool nfi.exe to inquire what file if any is using that sector. And once you get that info you know which one is damaged and thus lost.

But now the real insanity starts: Unless repair attempts on the sector succeed, no dozens of failed and time-wasting read attempts can convince the firmware to reallocate the sector, to replace it with a spare or simply block access. I haven’t seen it happening so I cannot even confirm it, but AFAIU this only happens if you WRITE to that sector the next time. BUT… things like secure erase of the file won’t do, because the sector also needs to be unused before you attempt to write to it.
AND apparently even secure erase still leaves a filesystem remnant, basically a nameless undeletable garbage file, and it seems that this is still considered part of the filesystem for God knows how long. Because I verified that the bad sector is not used by any file, and yet chkdsk gets stuck for all eternity on the files check at the start, as if that sector was still part of the filesystem contents. (And if you try chkdsk /b, it might take far too long to get to the damaged spot and even there it is not guaranteed to succeed.)

So to clarify: Failing to read a single damn spot on the disk for half an hour that procudes tons of SMART log spam about the exact location does not convince the drive to replace that bit.

Also, DiskGenius can do targeted scans of disk surface to identify damaged regions, but its repair attempt will fail quite like chkdsk, endless freeze. Sadly it doesn’t offer to replace it without that futile attempts. (It did manage to repair a weak sector, but since SMART does not report a new reallocation event, I have to assume it merely repaired it through writes, so it could start making trouble again soon.)

HDDScan offers such a surface test, too, but its output seems to get stuck on reporting bad sectors long after the one that actually is bad.

But the most frustrating thing about all this pretend-SMARTness that is F.U.C.K.I.N.G.D.U.M.B. is that while I am being informed there is “Current Pending Sector Count = 1”, it does not inform me which sector is the pending one that I haven’t identified yet, even though it would have to know the position from knowing it is there.

More or less realistic options you have:

  • Go to Linux and use command line hackery with smartctl and hdparm to manually surgically replace the bad sector.
  • Alter the disk’s partitioning to exclude the area with the defective sector. (DiskGenius can tell you the megabyte-based region on the disk based on the sector.)
  • Slow-format or secure-erase the whole disk. (But AFAIR I have had issues with such in the past because the system pretended the problems had been repaired but then they reoccured later after I recopied all the data onto it. Not on those writes, apparently, but afterwards.)

So, since I have an installation of that relatively shitty Linux, I went there and after some basic hassle this command did the trick:
“sudo hdparm –write-sector 6960709 –yes-i-know-what-i-am-doing /dev/sdc”
It is described as an alias for “–repair-sector” and I thought ‘damn, not that again’. And it went so quick with no delay whatsoever and reading the sector only yielded zeroes that I was wondering whether it was the correct sector, but after checking back in Windows, the obstacle was gone!
So apparently it can be easy to accomplish such simple and intelligent things!
(But as I keep pointing out, Linux has its own infuriating shortcomings.)

I am still not over my skepticism, though. The reallocated sector count is still the same, so I have to wonder whether under Windows the repair attempt just failed for some reason or whether under Linux that method simply doesn’t trigger the counter.
Also, Offline Uncorrectable is still 1, and I read it is supposed to go back to 0 when everything is fine, not be a history-type statistic, although that’s unreliable info.


Now, what SHOULD happen in this data safety system, as an integral part, is that the OS warns and informs which file is affected by a defective sector and not in its original state anymore, and the drive should also reallocate sectors that are just weak, because in my view there is no such thing as a repaired sector, as my own experience with this drive has shown. If it is weak, it cannot be trusted anymore, and there should be plenty of spares. It is no drama to lose even a couple megabytes, although that will rarely be the case, and if so, the harddisk is probably finished. – But to cause such an obstacle out of a single sector, that is nuts. A late surprise of data corruption and a huge drama. Very unprofessional and sloppy, kinda defying the purpose of accurately tracking what is happening with the data.

The existing system looks like not designed primarily to protect your data but to convince you to buy a new product.

Repetetitive music for repetitititive tasks

This is an expansion on this tweet (chain – click to see the rest):

I wanted to provide a little background to what I meant.

You might have heard about the benefits of giving both left and right brain hemisphere something to do when performing tasks. Well, there’s that, and there’s also association. Mix something you don’t like with something you do and your brain will make a connection. And the factor I wanted to focus on is about the repetition:

I attended a psychedelic spiritual ritual (Santo Daime, ayahuasca) a couple of times where there would be singing of very similar melodies, over and over, for hours. (Some breaks from that for spoken parts, but relatively few.) Now what this does is that if there’s a part of your brain that simply resists the repetitive nature of the experience, e.g. finds it boring or dumb or annoying, that part, which prevents you from accomplishing the task, will eventually have to succumb and admit defeat. You are literally getting your mind out of the way. Not necessarily completely, but the part that resists.

So one of the best example for such situations that I can think of from my own experience is computer games and “farming”. I’m sure you know that. You want something rare or something in great quantity in an MMO, but it involves mind-numbing ( 😉 ) grind for hours, and the longer you do it, the more resistance your mind builds up.
Now if you can find a music that puts you in the right mood, that conveys a kind of vibe of being diligent, productive, to keep going; music that has flow and groove (D&B is usually good with flow), and you find yourself able to listen to that on repeat, over and over, then you can combine that with the repetitive task and you will have fused the best of both worlds. The core issue you took with the grind, the seemingly endless repetitiveness, has been connected to two things: Your wish to accomplish the task and your enjoyment of the music.

You know this really worked well when you eventually realize you’ve overshot the mark and kept going. ^^
You know the music is REALLY good when you KNOW you’ve overshot your mark but keep going anyway. 😀

The following are just some of my personal favorites, but they might give you an idea what I’m talking about. The music needs to speak to a deeper part than your rational mind. Some music can be awesome fun, but only for a while, because it adresses the mind too much. Other is less obtrusive. Generally, what works well is music that makes you want to move your body. As an added effect then, your manual actions towards accomplishing the task will be treated like dancing by your emotional mind.

Awkward Marina – Fairy Tail 2014 Theme (EXCEED The Limit Remix)

PsychGoth – The Derpinator (Fighting theme of Derpy Hooves)

RawGreen – Donut Steel 2: The Soundtrack

 
 
A bit less effective for me, but still in the category:

Whitetail – Rarity Theme (CommandSpry Remix)

DerpyCrash & Leafrunner – Mezza Luna (Hay Tea Remix)

And then there is a set of somewhat different tunes that used to help me a lot in World of Warcraft, in part during daily quests that are quite action-oriented. It might be a change of taste, or the fact that it’s a different game. You’ll have to figure out what fits you and the situation, but this essay might help you understand what to look for and how to find fitting music more easily.
(I also did my own cuts from the following tracks in order to make them ‘cut to the chase’ and work better when looped.)

EVE Online – Retribution

EVE Online – Seven Clans

EVE Online – Fight Like You Live

I am usually not into industrial or acid punk or whatever this is, but it’s about the context and I’m quite open to various music genres.
Even if, for example, you are not at all someone who enjoys listening to orchestral music, when it skillfully complements a movie scene, it’s literally a different story. Should I say…

Klendathu Drop from Starship Troopers

Being a musician is one thing, but being able to find just the right music for a specific occasion is a skillset in itself.

Of course, apart from repetitive music, any music that really gets you going can work, because no matter what you do of whether you do anything at all while listening, you’re already having a good time and thus perceive the world differently. And what I mean by that is beautifully depicted by this:

If you are into chiptunes, the following might do the trick (Not gonna link them, it slows down the article display):
Artist: Yerzmyey
Titles: Break Space, Fifteen Colours, Arcane Zone (Part 2), New Line, XL Dance

As a sidenote: I use to go to a TCM massage parlor and they were playing the same set of tunes every time, all the time. And the choice was perfect, because for reasons I cannot put into words, that music was another example (even if not repetitive and motivating, but calming and unobtrusive) of not getting bothersome even if you hear it again and again. And it was like that throughout the whole CD. A skillful choice … and for the therapist understandably a necessary choice.