Solaris Systems Programming

Ben Rockwood writes "UNIX, in all its many forms, was developed by developers for developers. This is evident in the connection between UNIX and C. In many ways, you can't truly understand one without the other. Certainly, there are plenty of UNIX users and admins who understand semaphores but have never written a threaded application, and C programmers who have never left the Windows world, but nevertheless at some point you'll encounter the symbiotic relationship the two share. Often, though, we find system administration books that discuss programming topics but not programming itself -- and conversely, C programming books that don't address the essence of UNIX. When we combine the two topics we get a systems programming book, an epic guide that clarifies relationships essential to understanding both entities in a truly holistic manner." Read on for Rockwood's review of Solaris Systems Programming, a book he describes as reaching this ideal.

Solaris Systems Programming
author	Rich Teer
pages	1248
publisher	Prentice Hall PTR
rating	10
reviewer	Ben Rockwood
ISBN	0201750392
summary	Guide to systems programming using C on UNIX systems, not limited to Solaris

Several such guides have popped up over the years, such as The UNIX Programming Environment (Kernighan & Pike 84), Advanced UNIX Programming (Rochkind 85), The Magic Garden Explained (Goodheart & Cox 94), Advanced UNIX Programming (Gay 00) (that's not a typo, there really are two books with the same name), UNIX Systems Programming (Robbins & Robbins 03), UNIX Systems Programming for SVR4 (Curry 96), and the undisputed heavyweight champ, Advanced Programming in the UNIX Environment (Stevens 92).

Each of these books is distinctive, yet they share a number of topics. Essential topics include low- and high-level IO, signal handling, processes, IPC, and basic file system mechanics. In the more modern books, we see the inclusion of popular topics such as threading. Discussion directed toward broader topics of UNIX vary widely, namely due to the OS agnostic nature of such guides, despite the fact that until recently many books tended to slant toward SunOS/Solaris. Regardless of how many systems programming texts have appear, however, most programmers will agree that Stevens' guide is the only truly definitive choice. Since its release, there has been little challenge to its prominence, despite the emergence of Linux as a major UNIX implementation, despite several newer systems programming books, and even the 2nd edition of Rochkind's guide. But all of this now changes thanks to the release of Rich Teer's Solaris Systems Programming.

At a whopping 1248 pages, this volume dwarfs just about every systems programming book available by over 500 pages. It avoids the distractions of OS ambivalence by being tailored to Solaris, but is applicable to any UNIX platform available including Linux. Its layout is similar to that of Stevens' or Curry's books but builds significantly on each topic.

New systems programmers will immediately appreciate Teer's completeness, both in topic coverage and in his example code. Almost every code example is complete and runnable, unlike many of the other guides that demonstrate a topic only in an abstract function rather than complete program. Essential topics for completeness which have remained surprisingly absent from nearly every guide available (such as memory, code security and 64-bit topics) are thoroughly covered. A striking example is coverage of memory topics. When I pulled volume after volume off the shelf of my local bookstore and looked up "memory" in the index of each, I found surprisingly few even cover the topic beyond explaining the difference between stack and heap. In fact, many don't even include the malloc() function. Solaris Systems Programming is the only book I've ever found so complete in its memory discussion that it not only covered stack and heap, all the available memory management functions, but even discusses such important topics as memory alignment!

A complete chapter on secure C programming is provided, thoroughly discussing such important topics as buffer overflows, chroot jails, and program environment. A good number of tips are provided to help you immediately incorporate better security into your app whether it's a real concern (for now) or not. Combine this with a complete chapter on resource control and limits, including discussions on system information, the /proc file system, and some Solaris-specific resource control facilities, you can write more intelligent, less obtrusive, and better-tuned applications.

The coverage of advanced IO topics (including STREAMS) and file system coverage are superior to that in any other text I've seen. System admins will appreciate the in-depth coverage of file system topics that have only seen this sort of detail in books such as Solaris Internals (Mauro & McDougall, 00). This level of discussion allows not only a better understanding of file system and IO techniques, but also the clarity to immediately start building your own tools that allow you to interact with file system with far greater precision than ever before. Other topics, such as memory mapped IO, have rarely seen such detailed coverage.

A full treatment of IPC topics are handled, but like Stevens', these techniques are discussed using conventional concurrency techniques such as fork(). A discussion of POSIX threading is absent and regarded as too large a topic to address properly in a systems programming book and the reader is urged to consult a complete guide to the topic such as Programming with POSIX Threads (Butenhof, 97). While some readers might be put off by this, you'll appreciate how this keeps IPC discussions unencumbered. POSIX threading is mentioned where applicable, so it's not at all ignored, but readers of Rochkind's 2nd Edition or Robbins' books will notice that introduction of a PThreads overview can quickly overwhelm the rest of the text. Unique to any other text with which I am familiar is the inclusion of a section on Solaris Doors (also applicable to the Linux implementation), which is the fastest IPC method in Solaris, introduced with Solaris 2.6.

Something that both new and seasoned programmers will appreciate is the inclusion of a chapter on utility functions, and another on localization. The utility chapter provides great a discussion of (and reference to) the often-used functions that many other books ignore, such as string handling and manipulation functions, memory management, byte arrays, temporary files, error reporting, command-line argument parsing, character classes and more. While it's true that these aren't strictly systems programming topics, they are inevitably going to be topics of interest to most programmers. It is the inclusion of such topics that allows you to take your pile of reference books and replace it with this single volume.

A major topic to systems programmers today is 64-bit programming. Naturally, Solaris is a robust 64-bit environment, and is well handled in this book. programmers new to 64-bit environments, whether on Linux, Solaris, or other UNIX platforms, will greatly appreciate the gentle introduction to 64-bit coding, as well as best-practice techniques and sprinkled 64-bit wisdom throughout the text.

Like it or not, Solaris is the dominant commercial UNIX platform in the market today and will be for the foreseeable future. This guide doesn't pull any punches in giving you the best information available to exploit that environment to its full potential. If you're a programmer, this book gives you a single reference to consolidate your library and give you a new appreciation for familiar topics and entry point to things that you might have never leveraged before (Doors, 64-bit optimization, etc). If you're a system admin, you'll find a whole new appreciation for Solaris and UNIX in general with unparalleled understanding of how they really work under the covers, especially if you've already read Solaris Internals. Everyone will love the detail and completeness, combined with with the hundreds of tips (not to mention nifty Solaris trivia) scattered throughout the book. Rich's style is compelling and relaxed, very readable in front of your keyboard or with a cup of coffee on the porch. And readers will enjoy his sense of humor, which is admittedly subtle; experienced programmers and system admins, though, will enjoy the book's wit.

Finally, given the impending release of Solaris 10, yet another aspect of this book needs to be considered: it's an essential companion for DTrace users! Rich couldn't have possibly foreseen this need when he started writing the book, but it is extremely important today. Solaris 10 provides more visibility and debugging tools than any other UNIX system in existence today, the most popular of which is DTrace. But all of these tools expect the user to have a certain level of understanding of the system itself. This book should be standard issue for any sysadmin that ever plays with Solaris 10. When doing system root-cause analysis with DTrace, this book becomes an essential reference, especially if you are allergic to system headers. If you have been using DTrace and getting lost, or feel that you just don't know Solaris the way you need to, buy this book and you'll find the confidence and skills to get you back on track.

---

You can learn more about Solaris Systems Programming on Rich Teer's home page for the book. On that page the full contents and index are available, including a sample chapter (Ch 8 "System Information and Resource Limits," 62 pages!). You can also visit Teer's personal home page to learn more about him and his work. You can purchase Solaris Systems Programming from bn.com. Slashdot welcomes readers' book reviews -- to see your own review here, read the book review guidelines, then visit the submission page.

Dougla Adams

Am I the only one that can't read the word holistic without thinking about electric monks on horses?

6 year old view of the computer world

Certainly, there are plenty of UNIX users and admins who understand semaphores but have never written a threaded application, and C programmers who have never left the Windows world,

Newsflash: Windows implements IPC mechanisms. You know, like all modern multitasking OSes?

Other newsflash: C programmers can be found under Windows, Unix, MacOS10, BeOS, GEM, ThingamabobOS... In fact, real professional programmers can program in anything under any environment, they just happen to be a bit more proficient under certain kinds of environments.

Re:6 year old view of the computer world

Third newsflash: there are many things that you can only really do with C on Unix systems, POSIX anybody?

Re:6 year old view of the computer world

There are many things you can only do with C compiled directly to the core on an embedded system, effectively writing your own OS. This does not make programming to the raw iron any better than UNIX or even Windows, just different.

Re:6 year old view of the computer world

Don't mix C and libraries. C is C, the core of the language is so small its list of reserved keywords fits on a half sheet of paper, and the rest isn't much bigger.

Whatever useful you can do on top of C depends on whatever libraries you slap on top of it, that gives you, the programmer, easy access to various abstractions of whatever the OS offers you. conio for example reflects what DOS and the BIOS can do and doesn't exist (originally) in Unix. Some libs are common though, like stdio and stdlib. Those are said to be portable, but they're still not part of the C language per se.

The core of the C la

In other news

Amzon has a great deal on a new book released by O'Reilly. Programming the 8080 in assembler.

So much cheaper here

You can save a lot of money if you buy it at amazon.com [amazon.com].

The relationship between C and UNIX...

...is like the relationship between Petrol and a Car.

You can put a monkey in a car and they might dent it, pee on it, scratch it... but it'll carry on (mostly) working. Let the monkey lose with Petrol and the whole damn thing is going to blow and some poor sod will lose their eyebrows.

at 1200+ pages

Who is this guy really, Robert Jordan?

Re:at 1200+ pages

Well, I don't know. Let's look at the introduction shall we?

"The system runs, and programs come and pass, leaving data that becomes files. Files are deleted, and even the inodes are long forgotten when the program that gave it birth comes again. In one program, called the Compiler by some, a program yet to come, a program long past, an error rose in mountains_of_mist.c. The error was not the beginning. There are neither beginnings nor endings to the running of the system. But it was a beginning."

Yep. Jordan alright.

why a C book on just Solaris?

I'm almost at the end of The C/Unix Programmer's Guide [amazon.com] by Jason W. Bacon.

It's one of the most generalized C/UNIX programming books I've been able to find; it doesn't pidgeon-hole itself into a particular *nix. After all, C in one Unix should ideally be portable to another Unix.

Ok, I have a vaguely related question

I was in a discussion recently and someone asserted that the source for solaris 8 was open, and freely available. Is there any truth to this, or were they thinking of the rumour that solaris 10 is supposedly going to be OSS?

Has it got SCOs approval??? :)

/cynicism on

Do they have SCOs approval to print this?
/cynicism off

Ok this joke has been beat to death.

Just different

By the author's description, I'd say that the topics braches in this book cover two university level courses, Computer Architecture which entails registers, alignment, buses (Structured Computer Organization Tanenbaum) as well as Operating systems internals (APUE, Stevens or Modern Operating Systems, Tanenbaum)

The problem being that both instructors need to agree on the book to get the benefit over the diverging information.

In an academic standpoint, the book's too large to serve as a workable text, and too specific to be used for multi-course uses. Of course I've never actually seen the book, so its all speculation based on the review.

For personal uses, I'm sure the added insights would be nice for those who haven't been beaten over the head with alginment and register offsets from schooling.. (*arg*).

Is unix systems programming so basic

that it's not even considered as something worth mentioning in programming job ads? I mean it's automatically assumed that you know it. Or maybe it's not needed. When was the last time you were asked by a recruiter whether you knew unix IPC?

I'm Feeling Cynical

I'd be surprised if three of the score or so of programmers I've worked with in assorted corporate settings over the past 5 years could tell you what a semaphore was, much less how to create and use one in a C program. In fact, in 15 years of programming in the "real world" I could count on one hand the number of times I've ever seen another programmer use "fork" in their code, even when forking off another process and establishing communication between the two processes would have made the job much easier. And don't get me started on the IPC blunders I've seen over the years from "professional" programmers. And as bad as those are, they pale in comparason to the code I've seen some Java programmers squat and shit. Er... you get the idea...

Security should always be important.

A good number of tips are provided to help you immediately incorporate better security into your app whether it's a real concern (for now) or not

Security should always be important whether you're providing a network server, a setuid application, or neither of these things.

In many cases security issues arise from having malicious input cause an exploit, even in non-security-sensitive applications if you're not careful unexpected input can cause a crash which might be just as painful from a user point of view.

Too many people forget that security is a process, and not an addon.

Many good tips on secure programming can be found in David Wheeler's Secure Programming For Linux and Unix HOWto [dwheeler.com].

Read it, even if you dont think security is important for you yet. It's only a matter of time until it will be.

So - Is this book really for me?

So, coming from the perspective of someone who knows how to move around in UNIX but not much else, would this book be good for me? I have no problem with any of the topics mentioned, I am just worried that my lack of experience combined with my lack of Solaris will make this book too hard to understand. BTW, you can get it a bit cheaper here [superbookdeals.com].

great book review

Despite this thread being conducted with typical /., unrelated comments, I actually thought this was a great book review. I know this book has been a big help for my husband with his work and I'm glad to see there is a review of it for the /. crowd, so maybe it can be of similar assistance for others.

Reviewer is on crack

UNIX, in all its many forms, was developed by developers for developers

It starts badly and goes downhill from there. Unix was developed by bored research scientists who were frustrated by the bureaucracy of their MULTICS system (even the name is a play on it) and its first real use was for typesetting. They used C because it was the best compromise at the time between portability and fine-grained control of the machine.

Then he goes on to talk about semaphores and threads and a bunch of stuff he thinks makes him sound smart.

I wish newbies would grow out of the "unix mystique". There's nothing magical about it. It's a tool for getting a job done, nothing more, nothing less.

Re:Typo

Big Gay Al

Re:Solaris Systems Programming

The title is systems programming, not device drivers.

Re:fork() is a cheap operation on unix

Faster inter-thread communication, and only needing to mmap files once.

Re:fork() is a cheap operation on unix

``fork() is a cheap operation on unix so what is advantage of threading?''

Guess what? Typical UNIX software doesn't use threading. Forking is much easier, was there first, and is usually not significantly less efficient.

``why did apache 2.0 use threads?''

Probably because it runs on systems that don't have cheap forking (like Windows). Besides, IIRC threading is only one of the mechanisms that apache2 can use, and you can use forking if that suits you better.

Re:fork() is a cheap operation on unix

I think it is a culture thing. For a long time, Unix thread code didn't port.
Some flavors didn't even have threads.
So if you wanted to write a product that worked on multiple Unix variants, you used forking and IPC instead of threading.
It took a long time for pthreads to catch on.

Windows programmers generally don't worry about porting so they took to threads more quickly.

Re:fork() is a cheap operation on unix

Guess what? Typical UNIX software doesn't use threading. Forking is much easier, was there first, and is usually not significantly less efficient.

It depends what you call "typical".

A web server generally doesn't need shared data. Apache 1.x only uses shared data for a small amount of statistics gathering/monitoring, which is a very small amount of work compared with the job of actually serving HTTP, so the minor overhead in managing the shared data doesn't hurt very muvh at all.

The same applies to other kinds of server where little or no synchronisation is needed (e.g. telnet server, ftp server, ssh server).

At the other end of the spectrum is a program which does need synchronisation, but each request/response is quick. An X server is a good example. In this case, a single-task tight event loop architecture is appropriate.

And in the middle, you have a lot of jobs which aren't so simple. A typical DBMS is a good example of this. You have multiple concurrent tasks, which may take an unbounded amount of time, and which may require a nontrivial amount of synchronisation. The jobs aren't effectively sequential, meaning that SMP scalability is possible, but they're not completely isolated either. This is the kind of task where multi-threading is almost always the right answer.

Multi-threading is also commonly found in interactive GUI applications, where there may be long background tasks in conjunction with low-latency requirements.

So while it's true to say that typical Unix software, in the sense of most software that comes packaged on the CD from your vendor, is not multi-threaded, that's because most of that software doesn't have difficult synchronisation or scalability problems to solve. On the other hand, a lot of the software that you might buy or obtain after that is indeed multi-threaded.

Re:fork() is a cheap operation on unix

Not quite. COW: copy on write. Basicly you use the same physical page in both processes, until one or the other makes a write to that page. Then and only then do you make a copy.

Re:fork() is a cheap operation on unix

Easy access to shared variables. If you fork, each process gets their own copy of a variable. An update by process A does not propogate to process B. This is a two sides issue, as it also makes race conditions possible if you don't protect data structures correctly. Of course, you can use shared memory, but thats more of a hassle to set up.

The other advantage is task switching speed. When switchign between applications (such as forked processes), you need to do a full task switch- registers, stack, memory, cache invalidate, etc. Very expensive. When switching between threads you only need to swap out the registers, stack, and program counter. Very cheap.

Re:Solaris Systems Programming

``Anyways who write modules for solaris ?''

Quite a few people, actually. And with the plans to release the source, the number will likely grow.

Re:solar system?

ive read it like: "Build your own solar system". wouldnt that be great?

IMHO, Schwartz and McNealy are already "communicating" from outside our solar system, so why the hell not? /troll

Soko

Re:Typo

> I mean, who has "Gay" in the name?

There is a law firm in town named "Gay and Associates".

I almost pissed myself laughing one day when I had to drop some papers off there.

Re:Typo

I mean, who has "Gay" in the name?

Gaylene Pron [google.com] has.

Re:Too bad solaris is completely stupid

You and your colleagues are way out of touch. Solaris has been smashig Linux performance on several new benchmarks. See Sun's web site...

Re:Solaris?

OK Linux troll, if you're not going to be programming on Solaris/Sparc systems, why are you bothering to even post in this story?

Why bother?

Solaris 8 Kernel Module Programming [sun.com]