High-capacity DNA data storage "is closer than you think," Slashdot wrote in 2019.

Now IEEE Spectrum brings an update on where we're at — and where we're headed — by a participant in the DNA storage collaboration between Microsoft and the Molecular Information Systems Lab of the Paul G. Allen School of Computer Science and Engineering at the University of Washington. "Organizations around the world are already taking the first steps toward building a DNA drive that can both write and read DNA data," while "funding agencies in the United States, Europe, and Asia are investing in the technology stack required to field commercially relevant devices." The challenging part is learning how to get the information into, and back out of, the molecule in an economically viable way... For a DNA drive to compete with today's archival tape drives, it must be able to write about 2 gigabits per second, which at demonstrated DNA data storage densities is about 2 billion bases per second. To put that in context, I estimate that the total global market for synthetic DNA today is no more than about 10 terabases per year, which is the equivalent of about 300,000 bases per second over a year. The entire DNA synthesis industry would need to grow by approximately 4 orders of magnitude just to compete with a single tape drive. Keeping up with the total global demand for storage would require another 8 orders of magnitude of improvement by 2030. But humans have done this kind of scaling up before. Exponential growth in silicon-based technology is how we wound up producing so much data. Similar exponential growth will be fundamental in the transition to DNA storage...

Companies like DNA Script and Molecular Assemblies are commercializing automated systems that use enzymes to synthesize DNA. These techniques are replacing traditional chemical DNA synthesis for some applications in the biotechnology industry... [I]t won't be long before we can combine the two technologies into one functional device: a semiconductor chip that converts digital signals into chemical states (for example, changes in pH), and an enzymatic system that responds to those chemical states by adding specific, individual bases to build a strand of synthetic DNA. The University of Washington and Microsoft team, collaborating with the enzymatic synthesis company Ansa Biotechnologies, recently took the first step toward this device... The path is relatively clear; building a commercially relevant DNA drive is simply a matter of time and money...

At the same time, advances in DNA synthesis for DNA storage will increase access to DNA for other uses, notably in the biotechnology industry, and will thereby expand capabilities to reprogram life. Somewhere down the road, when a DNA drive achieves a throughput of 2 gigabases per second (or 120 gigabases per minute), this box could synthesize the equivalent of about 20 complete human genomes per minute. And when humans combine our improving knowledge of how to construct a genome with access to effectively free synthetic DNA, we will enter a very different world... We'll be able to design microbes to produce chemicals and drugs, as well as plants that can fend off pests or sequester minerals from the environment, such as arsenic, carbon, or gold. At 2 gigabases per second, constructing biological countermeasures against novel pathogens will take a matter of minutes. But so too will constructing the genomes of novel pathogens. Indeed, this flow of information back and forth between the digital and the biological will mean that every security concern from the world of IT will also be introduced into the world of biology...

The future will be built not from DNA as we find it, but from DNA as we will write it.
The article makes an interesting point — that biology labs around the world already order chemically-synthesized ssDNA, "delivered in lengths of up to several hundred bases," and sequence DNA molecules up to thousands of bases in length.

"In other words, we already convert digital information to and from DNA, but generally using only sequences that make sense in terms of biology."

Some ZFS news from Phoronix this week. "At the end of last year OpenZFS 2.2.2 was released to fix a rare but nasty data corruption issue, but it turns out there are other data corruption bug(s) still lurking in the OpenZFS file-system codebase." A Phoronix reader wrote in today about an OpenZFS data corruption bug when employing native encryption and making use of send/recv support. Making use of zfs send on an encrypted dataset can cause one or more snapshots to report errors. OpenZFS data corruption issues in this area have apparently been known for years.

Since May 2021 there's been this open issue around ZFS corruption related to snapshots on post-2.0 OpenZFS. That issue remains open. A new ticket has been opened for OpenZFS as well in proposing to add warnings against using ZFS native encryption and the send/receive support in production environments.
jd (Slashdot reader #1,658) spotted the news — and adds a positive note. "Bugs, old and new, are being catalogued and addressed much more quickly now that core development is done under Linux, even though it is not mainstreamed in the kernel."

Backblaze has published a report on hard drive failures for 2023, finding that rates increased during the year due to aging drives that it plans to upgrade. From a report: Backblaze, which focuses on cloud-based storage services, claims to have more than three exabytes of data storage under its management. As of the end of last year, the company monitored 270,222 hard drives used for data storage, some of which are excluded from the statistics because they are still being evaluated. That still left a collection of 269,756 hard drives comprised of 35 drive models. Statistics on SSDs used as boot drives are reported separately.

Backblaze found one drive model exhibited zero failures for all of 2023, the Seagate 8 TB ST8000NM000A. However, this came with the caveat that there are only 204 examples in service, and these were deployed only since Q3 2022, so have accumulated a limited number of drive days (total time operational). Nevertheless, as Backblaze's principal cloud storage evangelist Andy Klein pointed out: "Zero failures over 18 months is a nice start."

Since 2006 Baldrson (Slashdot reader #78,598) has been part of the team verifying "The Hutter Prize for Lossless Compression of Human Knowledge," an ongoing challenge to compress a 100-MB excerpt of Wikipedia (approximately the amount a human can read in a lifetime).

"The intention of this prize is to encourage development of intelligent compressors/programs as a path to Artificial General Intelligence," explains the project's web site. 15 years ago, Baldrson wrote a Slashdot post explaining the logic (titled "Compress Wikipedia and Win AI Prize"): The basic theory, for which Hutter provides a proof, is that after any set of observations the optimal move by an AI is find the smallest program that predicts those observations and then assume its environment is controlled by that program. Think of it as Ockham's Razor on steroids.
The amount of the prize also increases based on how much compression is achieved. (So if you compress the 1GB file x% better than the current record, you'll receive x% of the prize...) The first prize was awarded in 2006. And now Baldrson writes: Kaido Orav has just improved 1.38% on the Hutter Prize for Lossless Compression of Human Knowledge with his "fx-cmix" entry.

The competition seems to be heating up, with this winner coming a mere 6 months since the prior winner. This is all the more impressive since each improvement in the benchmark approaches the (unknown) minimum size called the Kolmogorov Complexity of the data.

Google has renamed its AI assistant to "Gemini" and unveiled a paid subscription tier offering. The $19.99/month "Gemini Advanced" includes a more powerful AI model and cloud storage integration, targeting users seeking advanced content creation and complex query resolution. Google is also leveraging its Android user base by making Gemini the default digital assistant, aiming to replicate the success of its billion-user products.

A new report from German data recovery company CBL found that devices using NAND chips from reputable brands are declining in quality, with reduced capacity and their manufacturers' logo removed. Furthermore, some USB sticks use the old trick of soldiering a microSD card onto the board. TechSpot reports: Most of the janky USB sticks CBL examined were promotional gifts, the kind given away free with products or by companies at conferences. However, there were some "branded" products that fell into the same inferior-quality category, though CBL didn't say if these were well-known mainstream brands or the kind of brands you've probably never heard of.

Technological advancements have also affected these NAND chips, but not in a good way. The chips originally used single-level cell (SLC) memory cells that only stored one bit each, offering less data density but better performance and reliability. In order to increase the amount of storage the chips offered, manufacturers started moving to four bits per cell (QLC), decreasing the endurance and retention. Combined with the questionable components, it's why CBL warns that "You shouldn't rely too much on the reliability of flash memory."

The report illustrates how some of the components found in the devices had their manufactures' names removed or obscured. One simply printed text over the top of the company name, while another had been scrubbed off completely. There's also a photo of a microSD card found inside a USB stick that had all of its identifying markings removed. It's always wise to be careful when choosing your storage device and beware of offers that seem too good to be true.

"When Satya Nadella replaced Steve Ballmer as Microsoft CEO in February 2014, the software company was mired in mediocrity," writes CNBC, noting that Microsoft's market cap was just over $300 billion.

"A decade later, Microsoft's valuation has swelled tenfold, to $3.06 trillion, making it the world's most valuable public company, ahead of Apple." (And it's also "firmly entrenched as a leader in key areas, such as cloud and artificial intelligence.") As Nadella marks his 10-year anniversary at the helm, he's widely praised across the tech industry for changing the narrative at Microsoft, whose stock fell 30% during Ballmer's 14 years at the top. In that era, the company was squelched by Google in web search and mobile and was completely left behind in social media. Many tech industry analysts and investors would say that, thanks largely to Nadella, Microsoft is now set up to be a powerhouse for the foreseeable future...

In a 2020 interview, Pat Gelsinger, then CEO of VMware, said offering his company's software on Microsoft's Azure cloud was akin to a "Middle East peace treaty...." In the Nadella age, Microsoft has also contributed to open-source projects, released software under open-source licenses and released a version of its Teams communications app for Linux... In 2018, Nadella came to believe in the idea of buying GitHub just 20 minutes after Nat Friedman, then a Microsoft corporate vice president, started pitching him on it. Right away, Nadella suggested that Friedman become GitHub's new CEO, Friedman said. Microsoft paid $7.5 billion for the code-storage startup...

While Nadella may not bring as much entertainment value, he's proven to be more effective than Ballmer when it comes to dealmaking. In addition to GitHub, Nadella has made pricey acquisitions such as LinkedIn, Minecraft parent Mojang, and Nuance Communications that have contributed to Microsoft's top line. More recently, Nadella helped Microsoft land the $75 billion acquisition of game publisher Activision Blizzard...
The article also adds that Microsoft "looked at buying TikTok in the U.S. in 2020, but nothing came of those discussions."

Linus Torvalds had "some robust exchanges" on the Linux kernel mailing list with a contributor from Google. The subject was inodes, notes the Register, "which as Red Hat puts it are each 'a unique identifier for a specific piece of metadata on a given filesystem.'" Inodes have been the subject of debate on the Linux Kernel Mailing list for the last couple of weeks, with Googler Steven Rostedt and Torvalds engaging in some robust exchanges on the matter. In a thread titled, "Have the inodes all for files and directories all be the same," posters noted that inodes may still have a role when using tar to archive files. Torvalds countered that inodes have had their day. "Yes, inode numbers used to be special, and there's history behind it. But we should basically try very hard to walk away from that broken history," he wrote. "An inode number just isn't a unique descriptor any more. We're not living in the 1970s, and filesystems have changed." But debate on inodes continued. Rostedt eventually suggested that inodes should all have unique numbers...

In response... Torvalds opened: "Stop making things more complicated than they need to be." Then he got a bit shouty. "And dammit, STOP COPYING VFS LAYER FUNCTIONS. It was a bad idea last time, it's a horribly bad idea this time too. I'm not taking this kind of crap." Torvalds's main criticism of Rostedt's approach is that the Google dev didn't fully understand the subject matter — which Rostedt later acknowledged.
"An inode number just isn't a unique descriptor any more," Torvalds wrote at one point.

"We're not living in the 1970s, and filesystems have changed."

An anonymous reader quotes a report from ProPublica: Over the last decade, police departments across the U.S. have spent millions of dollars equipping their officers with body-worn cameras that record what happens as they go about their work. Everything from traffic stops to welfare checks to responses to active shooters is now documented on video. The cameras were pitched by national and local law enforcement authorities as a tool for building public trust between police and their communities in the wake of police killings of civilians like Michael Brown, an 18 year old black teenager killed in Ferguson, Missouri in 2014. Video has the potential not only to get to the truth when someone is injured or killed by police, but also to allow systematic reviews of officer behavior to prevent deaths by flagging troublesome officers for supervisors or helping identify real-world examples of effective and destructive behaviors to use for training. But a series of ProPublica stories has shown that a decade on, those promises of transparency and accountability have not been realized.

One challenge: The sheer amount of video captured using body-worn cameras means few agencies have the resources to fully examine it. Most of what is recorded is simply stored away, never seen by anyone. Axon, the nation's largest provider of police cameras and of cloud storage for the video they capture, has a database of footage that has grown from around 6 terabytes in 2016 to more than 100 petabytes today. That's enough to hold more than 5,000 years of high definition video, or 25 million copies of last year's blockbuster movie "Barbie." "In any community, body-worn camera footage is the largest source of data on police-community interactions. Almost nothing is done with it," said Jonathan Wender, a former police officer who heads Polis Solutions, one of a growing group of companies and researchers offering analytic tools powered by artificial intelligence to help tackle that data problem.

The Paterson, New Jersey, police department has made such an analytic tool a major part of its plan to overhaul its force. In March 2023, the state's attorney general took over the department after police shot and killed Najee Seabrooks, a community activist experiencing a mental health crisis who had called 911 for help. The killing sparked protests and calls for a federal investigation of the department. The attorney general appointed Isa Abbassi, formerly the New York Police Department's chief of strategic initiatives, to develop a plan for how to win back public trust. "Changes in Paterson are led through the use of technology," Abbassi said at a press conference announcing his reform plan in September, "Perhaps one of the most exciting technology announcements today is a real game changer when it comes to police accountability and professionalism." The department, Abassi said, had contracted with Truleo, a Chicago-based software company that examines audio from bodycam videos to identify problematic officers and patterns of behavior.

For around $50,000 a year, Truleo's software allows supervisors to select from a set of specific behaviors to flag, such as when officers interrupt civilians, use profanity, use force or mute their cameras. The flags are based on data Truleo has collected on which officer behaviors result in violent escalation. Among the conclusions from Truleo's research: Officers need to explain what they are doing. "There are certain officers who don't introduce themselves, they interrupt people, and they don't give explanations. They just do a lot of command, command, command, command, command," said Anthony Tassone, Truleo's co-founder. "That officer's headed down the wrong path." For Paterson police, Truleo allows the department to "review 100% of body worn camera footage to identify risky behaviors and increase professionalism," according to its strategic overhaul plan. The software, the department said in its plan, will detect events like uses of force, pursuits, frisks and non-compliance incidents and allow supervisors to screen for both "professional and unprofessional officer language." There are around 30 police departments currently use Truleo, according to the company.

Christopher J. Schneider, a professor at Canada's Brandon University who studies the impact of emerging technology on social perceptions of police, is skeptical the AI tools will fix the problems in policing because the findings might be kept from the public just like many internal investigations. "Because it's confidential," he said, "the public are not going to know which officers are bad or have been disciplined or not been disciplined."

YouTube has announced it has surpassed 100 million YouTube Music and YouTube Premium subscribers globally. Variety reports: The 100 million figure includes uses who are on free trials, according to YouTube. The company didn't break down how many are on YouTube Music versus YouTube Premium, the subscription service for ad-free viewing, background listening, offline video downloads and full access to YouTube Music. In November 2022, the company said YouTube Music and YouTube Premium topped 80 million paying subscribers combined.

The announcement comes after Alphabet, in reporting fourth-quarter 2023 earnings, boasted that YouTube and Google subscription services generated more than $15 billion in revenue last year. That includes YouTube Premium and YouTube Music, as well as YouTube TV and Google One cloud storage.

During Alphabet's Q4 2023 earnings call, Sundar Pichai announced that Google One is about to cross 100 million subscribers. From a report: The CEO said Google One is "doing incredibly well with strong user growth." Pichai highlighted how it "provides expanded storage, unlocks exclusive features in Google products, and allows [the company] to build a strong relationship with [its] most engaged users."

The consumer-facing subscription today includes storage (100 GB, 200 GB, 2 TB, 5 TB, 10 TB, 20 TB, and 30 TB tiers are available), which can be shared with up to five other accounts. You also get more Google Photos editing features, Workspace premium, VPN by Google One, dark web monitoring, 3-10% back on the Google Store, and additional customer support. In the US, pricing starts at $1.99 per month for 100 GB, while a popular 2 TB "Premium" plan is $99.99 annually.

Japan is aiming to phase out floppy disks and CD-ROMs, which until now were forms of physical media required for submitting some official documents to the government. Engadget reports: Back in 2022, Minister of Digital Affairs Taro Kono urged various branches of the government to stop requiring businesses to submit information on outdated forms of physical media. The Ministry of Economy, Trade and Industry (METI) is one of the first to make the switch. "Under the current law, there are many provisions stipulating the use of specific recording media such as floppy disks regarding application and notification methods," METI said last week, according to The Register. After this calendar year, METI will no longer require businesses to submit data on floppy disks under 34 ordinances. The same goes for CD-ROMs when it comes to an unspecified number of procedures. There's still quite some way to go before businesses can stop using either format entirely, however.

Kono's staff identified some 1,900 protocols across several government departments that still require the likes of floppy disks, CD-ROMs and even MiniDiscs. The physical media requirements even applied to key industries such as utility suppliers, mining operations and aircraft and weapons manufacturers. There are a couple of main reasons why there's a push to stop using floppy disks, as SoraNews24 points out. One major factor is that floppy disks can be hard to come by. Sony, the last major manufacturer, stopped selling them in 2011. Another is that some data types just won't fit on a floppy disk. A single photo can easily be larger than the format's 1.4MB storage capacity.

Long-time Slashdot reader SonicSpike shared this investigation by Time magazine's senior economics correspondent which argues that America's residential solar industry "is floundering." In late 2023 alone, more than 100 residential solar dealers and installers in the U.S. declared bankruptcy, according to Roth Capital Partners — six times the number in the previous three years combined. Roth expects at least 100 more to fail. The two largest companies in the industry, SunRun and Sunnova, both posted big losses in their most recent quarterly reports, and their shares are down 86% and 81% respectively from their peaks in January 2021... At the root of these struggles is the complicated financial engineering that helped companies raise money but that some investors and analysts say was built on a framework of lies — or at least exaggerations. Since at least 2016, big solar companies have used Wall Street money to fund their growth. This financialization raised the consumer cost of the panels and led companies to aggressively pursue sales to make the cost of borrowing Wall Street money worth it. National solar companies essentially became finance companies that happened to sell solar, engaging in calculations that may have been overly optimistic about how much money the solar leases and loans actually bring in.

"I've often heard solar finance and sales compared to the Wild West due to the creativity involved," says Jamie Johnson, the founder of Energy Sense Finance, who has been studying the residential solar industry for a decade. "It's the Silicon Valley mantra of 'break things and let the regulators figure it out.'"
Leasing the panels lets the companies claim green-energy tax credits (which they then sell to companies like Google). And meanwhile, bundles of solar-panel leases become asset-backed securities. By 2017, there were over $1 billion such securities... However, these financial innovations also increased the pressure on companies to grow quickly. Solar companies needed lots of new customers in order to package the loans into asset-backed securities and sell them to investors. Public companies especially faced intense scrutiny from investors who expected double-digit quarterly growth. And with upfront costs no longer a barrier for new customers, solar companies began to see almost every homeowner as a target, and they deployed expensive sales teams to go out and sell as aggressively as they could... Even today, about one-third of the upfront cost of a residential solar system goes to intermediaries like sales and financing people, says Pol Lezcano, an analyst with Bloomberg New Energy Finance. In Germany, where installation is done locally and there are fewer intermediaries, the typical residential system costs about 50% less than it costs in the U.S. "The upfront cost of these systems is stupidly high," says Lezcano, making residential solar not "scalable."

After growing 31% in 2021 and 40% in 2022, residential solar will only grow by 13% in 2023 and then contract 12% in 2024, according to predictions from the research firm Wood Mackenzie... Meanwhile, the pressure for fast sales may have led some companies to look the other way when salespeople obscured the terms of the solar panel leases and loans they were selling in order to close a deal.
One customer complains the solar panel company actually took out a lien on his house without his knowledge, according to the article. He's "one of a growing number of consumers now saying in courts and in arbitration that salesmen from solar-panel and solar-panel-finance companies — including some of the biggest in the U.S., like GoodLeap, Mosaic, Sunnova, and SunRun — tricked them into taking out onerous loans they didn't want — or that someone signed them up for a loan without their knowledge." Even some people who voluntarily signed up for financing products say they were misled about the actual cost of the solar panels. That's because loans from companies like GoodLeap and Mosaic often include an unexplained and significant "dealer fee." For example, a customer buying a $30,000 solar panel system with a low interest rate may not know that price includes a $10,000 loan-dealer fee. In other words, the cost of the panels, had they paid cash, would have been just $20,000; the extra 30% is the price they paid for the low-interest loan, though many consumers allege this was not explained to them...

In some ways, the current situation in the residential solar market is analogous to the subprime lending crisis that set off the Great Recession, though on a smaller scale. Like in the subprime lending crisis, some companies issued loans to people who could not — or would not — pay them. Like in the subprime lending crisis, thousands of these loans — and in solar's case, also leases — were packaged and sold to investors as asset-backed securities with promised rates of return. The Great Recession was driven largely by the fact that people stopped paying their loans, and the asset-backed securities didn't deliver the promised rate of return to investors. Similar cracks may be forming in the solar asset-backed securities market. For instance, the rate of delinquencies of loans in one of Sunnova's asset-backed securities was approaching 5% in the fall of last year, according to an October 2023 report issued by KBRA, a bond ratings agency. Historically, delinquencies in solar asset-backed securities had been around 1%.

The firms that grade these asset-backed securities have long said delinquencies would be low because rooftop-solar customers had high credit scores. The problem is that they appear not to have considered that even customers with good credit scores may not want to pay for solar panels that they were told would be free — or that salesmen could be signing people up without their knowledge.
Besides consumer cases in court, there's the possibility that regulators may act against solar companies that used inflated projections to juice their tax credits. "As early as 2016, a researcher at MIT's Energy Initiative estimated that such companies were overstating this value by as much as 50%." The broad problems facing residential solar and financing companies are already causing some pain in the forms of layoffs — California alone lost 17,000 solar jobs in 2023, according to the California Solar and Storage Association. There are ripple effects in the industry; Enphase Energy, which makes microinverters for solar panels, said in December it was laying off 10% of its workforce amidst softening demand.

It could get a lot worse before it gets better, with not just lost jobs, but near-total collapse of the current system. Some analysts, like Lezcano of Bloomberg New Energy Finance, think that the big, national players are going to have to fall apart for residential solar to become affordable in the U.S., and that in the future, the solar industry in the U.S. will look more like it does in Germany, where installations are done locally and there's fewer door-to-door sales.
"Over the past few years, a handful of people got rich off of Americans who were told they could simultaneously save money and save the planet. For example, Hayes Barnard, GoodLeap's founder and chairman, was named by Forbes as one of the 400 richest people in the world in 2023..."

An anonymous reader quotes a report from TechRadar: Thanks to new Massachusetts Institute of Technology (MIT) research, which was part-funded by Lamborghini, we could soon see the end of difficult-to-source and often problematic rare metal materials featuring in the batteries of future electric vehicles. The MIT study's aim was to replace cobalt and nickel, typically used as a cathode in today's lithium-ion battery technology, with organic materials that could be produced at a much lower cost. This would also reduce the impact on the planet and conduct electricity at similar rates as cobalt batteries. [...] The research, which has been running for six years, has culminated in a novel organic material that could be a direct replacement for cobalt and nickel. According to details recently released by MIT, this material consists of many layers of TAQ (bis-tetraaminobenzoquinone), an organic small molecule that contains three fused hexagonal rings.

It's a complicated subject for those not donning lab coats for a living, but these TAQ layers can extend outward in every direction, forming a structure similar to graphite. Within the molecules are chemical groups called quinones, which are the electron reservoirs, and amines, which help the material to form strong hydrogen bonds, which ensure they don't dissolve into the battery electrolyte (something that has previously blighted organic cathode compounds), thus extending the lifetime of the battery. It comes as no surprise that Lamborghini has licensed the patent on this technology, seeing as it funded the research and has a certain Lanzador high performance electric vehicle in the pipeline.

Researchers say that tests of the material revealed that its conductivity and storage capacity were comparable to that of traditional cobalt-containing batteries. Also, batteries with a TAQ cathode can be charged and discharged faster than existing batteries, which could speed up the charging rate for electric vehicles. This speedy rate of charge and discharge could help give something like Lamborghini's Lanzador a performance edge, while super-fast charging capabilities will negate the need for lengthy charging stops -- something the Italian marque's discerning clientele will likely be opposed to. However, Lamborghini is also part of the wider Volkswagen Group and seeing that the primary materials needed to manufacture this type of cathode are already commercially available and produced in large quantities as commodity chemicals, we may see the battery tech filter down to more affordable EVs in the future.

In 2003, Hans Reiser answered questions from Slashdot's readers...

Today Wikipedia describes Hans Reiser as "a computer programmer, entrepreneur, and convicted murderer... Prior to his incarceration, Reiser created the ReiserFS computer file system, which may be used by the Linux kernel but which is now scheduled for removal in 2025, as well as its attempted successor, Reiser4."

This week alanw (Slashdot reader #1,822), spotted a development on the Linux kernel mailing list. "Hans Reiser (imprisoned for the murder of his wife) has written a letter, asking it to be published to Slashdot." Reiser writes: I was asked by a kind Fredrick Brennan for my comments that I might offer on the discussion of removing ReiserFS V3 from the kernel. I don't post directly because I am in prison for killing my wife Nina in 2006.

I am very sorry for my crime — a proper apology would be off topic for this forum, but available to any who ask.

A detailed apology for how I interacted with the Linux kernel community, and some history of V3 and V4, are included, along with descriptions of what the technical issues were. I have been attending prison workshops, and working hard on improving my social skills to aid my becoming less of a danger to society. The man I am now would do things very differently from how I did things then.
Click here for the rest of Reiser's introduction, along with a link to the full text of the letter...

The letter is dated November 26, 2023, and ends with an address where Reiser can be mailed. Ars Technica has a good summary of Reiser's lengthy letter from prison — along with an explanation for how it came to be. With the ReiserFS recently considered obsolete and slated for removal from the Linux kernel entirely, Fredrick R. Brennan, font designer and (now regretful) founder of 8chan, wrote to the filesystem's creator, Hans Reiser, asking if he wanted to reply to the discussion on the Linux Kernel Mailing List (LKML). Reiser, 59, serving a potential life sentence in a California prison for the 2006 murder of his estranged wife, Nina Reiser, wrote back with more than 6,500 words, which Brennan then forwarded to the LKML. It's not often you see somebody apologize for killing their wife, explain their coding decisions around balanced trees versus extensible hashing, and suggest that elementary schools offer the same kinds of emotional intelligence curriculum that they've worked through in prison, in a software mailing list. It's quite a document...

It covers, broadly, why Reiser believes his system failed to gain mindshare among Linux users, beyond the most obvious reason. This leads Reiser to detail the technical possibilities, his interpersonal and leadership failings and development, some lingering regrets about dealings with SUSE and Oracle and the Linux community at large, and other topics, including modern Russian geopolitics... Reiser asks that a number of people who worked on ReiserFS be included in "one last release" of the README, and to "delete anything in there I might have said about why they were not credited." He says prison has changed him in conflict resolution and with his "tendency to see people in extremes...."

Reiser writes that he understood the difficulty ahead in getting the Linux world to "shift paradigms" but lacked the understanding of how to "make friends and allies of people" who might initially have felt excluded. This is followed by a heady discussion of "balanced trees instead of extensible hashing," Oracle's history with implementing balanced trees, getting synchronicity just right, I/O schedulers, block size, seeks and rotational delays on magnetic hard drives, and tails. It leads up to a crucial decision in ReiserFS' development, the hard non-compatible shift from V3 to Reiser 4. Format changes, Reiser writes, are "unwanted by many for good reasons." But "I just had to fix all these flaws, fix them and make a filesystem that was done right. It's hard to explain why I had to do it, but I just couldn't rest as long as the design was wrong and I knew it was wrong," he writes. SUSE didn't want a format change, but Reiser, with hindsight, sees his pushback as "utterly inarticulate and unsociable." The push for Reiser 4 in the Linux kernel was similar, "only worse...."

He encourages people to "allow those who worked so hard to build a beautiful filesystem for the users to escape the effects of my reputation." Under a "Conclusion" sub-heading, Reiser is fairly succinct in summarizing a rather wide-ranging letter, minus the minutiae about filesystem architecture.

I wish I had learned the things I have been learning in prison about talking through problems, and believing I can talk through problems and doing it, before I had married or joined the LKML. I hope that day when they teach these things in Elementary School comes.

I thank Richard Stallman for his inspiration, software, and great sacrifices,

It has been an honor to be of even passing value to the users of Linux. I wish all of you well.


It both is and is not a response to Brennan's initial prompt, asking how he felt about ReiserFS being slated for exclusion from the Linux kernel. There is, at the moment, no reply to the thread started by Brennan.

It's "a free and open-source, software-defined storage platform," according to Wikipedia, providing object storage, block storage, and file storage "built on a common distributed cluster foundation". The charter advisory board for Ceph included people from Canonical, CERN, Cisco, Fujitsu, Intel, Red Hat, SanDisk, and SUSE.

And Nite_Hawk (Slashdot reader #1,304) is one of its core engineers — a former Red Hat principal software engineer named Mark Nelson. (He's now leading R&D for a small cloud systems company called Clyso that provides Ceph consulting.) And he's returned to Slashdot to share a blog post describing "a journey to 1 TiB/s". This gnarly tale-from-Production starts while assisting Clyso with "a fairly hip and cutting edge company that wanted to transition their HDD-backed Ceph cluster to a 10 petabyte NVMe deployment" using object-based storage devices [or OSDs]...) I can't believe they figured it out first. That was the thought going through my head back in mid-December after several weeks of 12-hour days debugging why this cluster was slow... Half-forgotten superstitions from the 90s about appeasing SCSI gods flitted through my consciousness...

Ultimately they decided to go with a Dell architecture we designed, which quoted at roughly 13% cheaper than the original configuration despite having several key advantages. The new configuration has less memory per OSD (still comfortably 12GiB each), but faster memory throughput. It also provides more aggregate CPU resources, significantly more aggregate network throughput, a simpler single-socket configuration, and utilizes the newest generation of AMD processors and DDR5 RAM. By employing smaller nodes, we halved the impact of a node failure on cluster recovery....

The initial single-OSD test looked fantastic for large reads and writes and showed nearly the same throughput we saw when running FIO tests directly against the drives. As soon as we ran the 8-OSD test, however, we observed a performance drop. Subsequent single-OSD tests continued to perform poorly until several hours later when they recovered. So long as a multi-OSD test was not introduced, performance remained high. Confusingly, we were unable to invoke the same behavior when running FIO tests directly against the drives. Just as confusing, we saw that during the 8 OSD test, a single OSD would use significantly more CPU than the others. A wallclock profile of the OSD under load showed significant time spent in io_submit, which is what we typically see when the kernel starts blocking because a drive's queue becomes full...

For over a week, we looked at everything from bios settings, NVMe multipath, low-level NVMe debugging, changing kernel/Ubuntu versions, and checking every single kernel, OS, and Ceph setting we could think of. None these things fully resolved the issue. We even performed blktrace and iowatcher analysis during "good" and "bad" single OSD tests, and could directly observe the slow IO completion behavior. At this point, we started getting the hardware vendors involved. Ultimately it turned out to be unnecessary. There was one minor, and two major fixes that got things back on track.
It's a long blog post, but here's where it ends up:

• Fix One: "Ceph is incredibly sensitive to latency introduced by CPU c-state transitions. A quick check of the bios on these nodes showed that they weren't running in maximum performance mode which disables c-states."

• Fix Two: [A very clever engineer working for the customer] "ran a perf profile during a bad run and made a very astute discovery: A huge amount of time is spent in the kernel contending on a spin lock while updating the IOMMU mappings. He disabled IOMMU in the kernel and immediately saw a huge increase in performance during the 8-node tests." In a comment below, Nelson adds that "We've never seen the IOMMU issue before with Ceph... I'm hoping we can work with the vendors to understand better what's going on and get it fixed without having to completely disable IOMMU."

• Fix Three: "We were not, in fact, building RocksDB with the correct compile flags... It turns out that Canonical fixed this for their own builds as did Gentoo after seeing the note I wrote in do_cmake.sh over 6 years ago... With the issue understood, we built custom 17.2.7 packages with a fix in place. Compaction time dropped by around 3X and 4K random write performance doubled."

The story has a happy ending, with performance testing eventually showing data being read at 635 GiB/s — and a colleague daring them to attempt 1 TiB/s. They built a new testing configuration targeting 63 nodes — achieving 950GiB/s — then tried some more performance optimizations...

U.S. lawmakers have banned the Defense Department from buying batteries produced by China's biggest manufacturers. "The rule implemented as part of the latest National Defense Authorization Act that passed on Dec. 22 will prevent procuring batteries from Contemporary Amperex Technology Co. Ltd., BYD Co. and four other Chinese companies beginning in October 2027," reports Bloomberg. From the report: The measure doesn't extend to commercial purchases by companies such as Ford, which is licensing technology from CATL to build electric-vehicle batteries in Michigan. Tesla also sources some of its battery cells from BYD, which became the new top-selling EV maker globally in the fourth quarter. The four other manufacturers whose batteries will be banned are Envision Energy Ltd., EVE Energy Co., Gotion High Tech Co. and Hithium Energy Storage Technology Co.

The decision still requires Pentagon officials to more clearly define the reach of the new rule. It adds to previous provisions outlined by the NDAA that decoupled the Defense Department's supply chain from China, including restrictions on use of Chinese semiconductors. While the Defense Department bans apply strictly to defense procurement, industries and lawmakers closely follow the rules as a guide for what materials, products and companies to trust in their own course of business.

Seagate this week unveiled the industry's first hard disk drive platform that uses heat-assisted media recording (HAMR). Tom's Hardware: The new Mozaic 3+ platform relies on several all-new technologies, including new media, new write and read heads, and a brand-new controller. The platform will be used for Seagate's upcoming Exos hard drives for cloud datacenters with a 30TB capacity and higher. Heat-assisted magnetic recording is meant to radically increase areal recording density of magnetic media by making writes while the recording region is briefly heated to a point where its magnetic coercivity drops significantly.

Seagate's Mozaic 3+ uses 10 glass disks with a magnetic layer consisting of an iron-platinum superlattice structure that ensures both longevity and smaller media grain size compared to typical HDD platters. To record the media, the platform uses a plasmonic writer sub-system with a vertically integrated nanophotonic laser that heats the media before writing. Because individual grains are so small with the new media, their individual magnetic signatures are lower, whereas magnetic inter-track interference (ITI) effect is somewhat higher. As a result, Seagate had to introduce its new Gen 7 Spintronic Reader, which features the "world's smallest and most sensitive magnetic field reading sensors," according to the company. Because Seagate's new Mozaic 3+ platform deals with new media with a very small grain size, an all-new writer, and a reader that features multiple tiny magnetic field readers, it also requires a lot of compute horsepower to orchestrate the drive's work. Therefore, Seagate has equipped with Mozaic 3+ platform with an all-new controller made on a 12nm fabrication process.

An anonymous reader quotes a report from Reuters: OpenAI's CEO Sam Altman on Tuesday said an energy breakthrough is necessary for future artificial intelligence, which will consume vastly more power than people have expected. Speaking at a Bloomberg event on the sidelines of the World Economic Forum's annual meeting in Davos, Altman said the silver lining is that more climate-friendly sources of energy, particularly nuclear fusion or cheaper solar power and storage, are the way forward for AI. "There's no way to get there without a breakthrough," he said. "It motivates us to go invest more in fusion."

In 2021, Altman personally provided $375 million to private U.S. nuclear fusion company Helion Energy, which since has signed a deal to provide energy to Microsoft in future years. Microsoft is OpenAI's biggest financial backer and provides it computing resources for AI. Altman said he wished the world would embrace nuclear fission as an energy source as well. Further reading: Microsoft Needs So Much Power to Train AI That It's Considering Small Nuclear Reactors

An anonymous reader quotes a report from BleepingComputer: Have I Been Pwned has added almost 71 million email addresses associated with stolen accounts in the Naz.API dataset to its data breach notification service. The Naz.API dataset is a massive collection of 1 billion credentials compiled using credential stuffing lists and data stolen by information-stealing malware. Credential stuffing lists are collections of login name and password pairs stolen from previous data breaches that are used to breach accounts on other sites.

Information-stealing malware attempts to steal a wide variety of data from an infected computer, including credentials saved in browsers, VPN clients, and FTP clients. This type of malware also attempts to steal SSH keys, credit cards, cookies, browsing history, and cryptocurrency wallets. The stolen data is collected in text files and images, which are stored in archives called "logs." These logs are then uploaded to a remote server to be collected later by the attacker. Regardless of how the credentials are stolen, they are then used to breach accounts owned by the victim, sold to other threat actors on cybercrime marketplaces, or released for free on hacker forums to gain reputation amongst the hacking community.

The Naz.API is a dataset allegedly containing over 1 billion lines of stolen credentials compiled from credential stuffing lists and from information-stealing malware logs. It should be noted that while the Naz.API dataset name includes the word "Naz," it is not related to network attached storage (NAS) devices. This dataset has been floating around the data breach community for quite a while but rose to notoriety after it was used to fuel an open-source intelligence (OSINT) platform called illicit.services. This service allows visitors to search a database of stolen information, including names, phone numbers, email addresses, and other personal data. The service shut down in July 2023 out of concerns it was being used for Doxxing and SIM-swapping attacks. However, the operator enabled the service again in September. Illicit.services use data from various sources, but one of its largest sources of data came from the Naz.API dataset, which was shared privately among a small number of people. Each line in the Naz.API data consists of a login URL, its login name, and an associated password stolen from a person's device, as shown [here]. "Here's the back story: this week I was contacted by a well-known tech company that had received a bug bounty submission based on a credential stuffing list posted to a popular hacking forum," explained Troy Hunt, the creator of Have I Been Pwned, in blog post. "Whilst this post dates back almost 4 months, it hadn't come across my radar until now and inevitably, also hadn't been sent to the aforementioned tech company."

"They took it seriously enough to take appropriate action against their (very sizeable) user base which gave me enough cause to investigate it further than your average cred stuffing list."

To check if your credentials are in the Naz.API dataset, you can visit Have I Been Pwned.