UNIX Network Programming: The Sockets Networking API / Edition 3

UNIX Network Programming: The Sockets Networking API / Edition 3

ISBN-10:
0131411551
ISBN-13:
9780131411555
Pub. Date:
11/28/2003
Publisher:
Pearson Education
ISBN-10:
0131411551
ISBN-13:
9780131411555
Pub. Date:
11/28/2003
Publisher:
Pearson Education
UNIX Network Programming: The Sockets Networking API / Edition 3

UNIX Network Programming: The Sockets Networking API / Edition 3

$79.99
Current price is , Original price is $79.99. You
$79.99 
  • SHIP THIS ITEM
    Temporarily Out of Stock Online
  • PICK UP IN STORE

    Your local store may have stock of this item.

  • SHIP THIS ITEM

    Temporarily Out of Stock Online

    Please check back later for updated availability.


Overview

This is THE guide to UNIX network programming APIs. Whether you write Web servers, client/server applications, or any other network software, you need to understand networking APIS-especially sockets in greater detail than ever before. You need UNIX Network Programming, Volume 1, Third Edition. In this book, the Authors offer unprecedented, start-to-finish guidance on making the most of sockets, the de facto standard for UNIX network programming with APIs - as well as extensive coverage of the X/Open Transport Interface (XTI).


Product Details

ISBN-13: 9780131411555
Publisher: Pearson Education
Publication date: 11/28/2003
Series: Addison-Wesley Professional Computing Series
Edition description: Third Edition
Pages: 1024
Product dimensions: 7.40(w) x 9.50(h) x 1.50(d)

About the Author

The late W. RICHARD STEVENS was the original author of UNIX Network Programming, First and Second Editions, widely recognized as the classic texts in UNIX networking. BILL FENNER is Principal Technical Staff Member at AT&T Labs in Menlo Park, CA, specializing in IP multicasting, network management, and measurement. He is one of the IETF's Routing Area Directors, responsible for approving all routing-related documents that get published as RFCs. ANDREW M. RUDOFF, Senior Software Engineer at Sun Microsystems, specializes in networking, operating systems internals, file systems, and high availability software architecture.

Read an Excerpt

PrefaceIntroduction

This book is for people who want to write programs that communicate with each otherusing an application program interface (API) known as sockets. Some readers may bevery familiar with sockets already, as that model has become synonymous with networkprogramming. Others may need an introduction to sockets from the ground up. Thegoal of this book is to offer guidance on network programming for beginners as well asprofessionals, for those developing new network-aware applications as well as thosemaintaining existing code, and for people who simply want to understand how the networkingcomponents of their system function.

All the examples in this text are actual, runnable code tested on Unix systems.However, many non-Unix systems support the sockets API and the examples arelargely operating system-independent, as are the general concepts we present. Virtuallyevery operating system (OS) provides numerous network-aware applications such asWeb browsers, email clients, and file-sharing servers. We discuss the usual partitioningof these applications into client and server and write our own small examples of thesemany times throughout the text.

Presenting this material in a Unix-oriented fashion has the natural side effect of providingbackground on Unix itself, and on TCP/IP as well. Where more extensive backgroundmay be interesting, we refer the reader to other texts. Four texts are so commonlymentioned in this book that we've assigned them the following abbreviations:


  • APUE: Advanced Programming in the UNIX Environment Stevens 1992
  • TCPv1: TCP/IP Illustrated, Volume 1 Stevens 1994
  • TCPv2:TCP/IP Illustrated, Volume 2 Wright and Stevens 1995
  • TCPv3: TCP/IP Illustrated, Volume 3 Stevens 1996

TCPv2 contains a high level of detail very closely related to the material in this book, asit describes and presents the actual 4.4BSD implementation of the network programmingfunctions for the sockets API (socket, bind, connect, and so on). If one understandsthe implementation of a feature, the use of that feature in an application makesmore sense.Changes from the Second Edition

Sockets have been around, more or less in their current form, since the 1980s, and it is atribute to their initial design that they have continued to be the network API of choice.Therefore, it may come as a surprise to learn that quite a bit has changed since the secondedition of this book was published in 1998. The changes we've made to the text aresummarized as follows:

  • This new edition contains updated information on IPv6, which was only in draft form at the time of publication of the second edition and has evolved somewhat.
  • The descriptions of functions and the examples have all been updated to reflect the most recent POSIX specification (POSIX 1003.1-2001), also known as the Single Unix Specification Version 3.
  • The coverage of the X/Open Transport Interface (XTI) has been dropped. That API has fallen out of common use and even the most recent POSIX specification does not bother to cover it.
  • The coverage of TCP for transactions (T/TCP) has been dropped.
  • Three chapters have been added to describe a relatively new transport protocol, SCTP. This reliable, message-oriented protocol provides multiple streams between endpoints and transport-level support for multihoming. It was originally designed for transport of telephony signaling across the Internet, but provides some features that many applications could take advantage of.
  • A chapter has been added on key management sockets, which may be used with Internet Protocol Security (IPsec) and other network security services.
  • The machines used, as well as the versions of their variants of Unix, have all been updated, and the examples have been updated to reflect how these machines behave. In many cases, examples were updated because OS vendors fixed bugs or added features, but as one might expect, we've discovered the occasional new bug here and there. The machines used for testing the examples in this book were:
  • Apple Power PC running MacOS/X 10.2.6
  • HP PA-RISC running HP-UX 11i
  • IBM Power PC running AIX 5.1
  • Intel x86 running FreeBSD 4.8
  • Intel x86 running Linux 2.4.7
  • Sun SPARC running FreeBSD 5.1
  • Sun SPARC running Solaris 9

See Figure 1.16 for details on how these machines were used.

Volume 2 of this UNIX Network Programming series, subtitled Interprocess Communications,builds on the material presented here to cover message passing, synchronization,shared memory, and remote procedure calls.Using This Book

This text can be used as either a tutorial on network programming or as a reference forexperienced programmers. When used as a tutorial or for an introductory class on networkprogramming, the emphasis should be on Part 2, ''Elementary Sockets'' (Chapters3 through 11), followed by whatever additional topics are of interest. Part 2 covers thebasic socket functions for both TCP and UDP, along with SCTP, I/O multiplexing,socket options, and basic name and address conversions. Chapter 1 should be read byall readers, especially Section 1.4, which describes some wrapper functions usedthroughout the text. Chapter 2 and perhaps Appendix A should be referred to as necessary,depending on the reader 's background. Most of the chapters in Part 3, ''AdvancedSockets,'' can be read independently of the others in that part of the book.

To aid in the use of this book as a reference, a thorough index is provided, alongwith summaries on the end papers of where to find detailed descriptions of all the functionsand structures. To help those reading topics in a random order, numerous referencesto related topics are provided throughout the text.Source Code and Errata Availability

The source code for all the examples that appear in the book is available on the Web atwww.unpbook.com. The best way to learn network programming is to take these programs,modify them, and enhance them. Actually writing code of this form is the onlyway to reinforce the concepts and techniques. Numerous exercises are also provided atthe end of each chapter, and most answers are provided in Appendix E.

A current errata for the book is also available from the same Web site.

The authors welcome electronic mail from any readers with comments, suggestions,or bug fixes.

Bill Fenner

Woodside, California

Andrew M. Rudoff

Boulder, Colorado

October 2003

authors@unpbook.com

http://www.unpbook.com

Table of Contents

Foreword.


Preface.

I. INTRODUCTION AND TCP/IP.


1. Introduction.


Introduction.


A Simple Daytime Client.


Protocol Independence.


Error Handling: Wrapper Functions.


A Simple Daytime Server.


Roadmap to Client/Server Examples in the Text.


OSI Model.


BSD Networking History.


Test Networks and Hosts.


Unix Standards.


64-Bit Architectures.


Summary.


2. The Transport Layer: TCP, UDP, and SCTP.


Introduction.


The Big Picture.


User Datagram Protocol (UDP).


Transmission Control Protocol (TCP).


Stream Control Transmission Protocol (SCTP).


TCP Connection Establishment and Termination.


TIME_WAIT State.


SCTP Association Establishment and Termination.


Port Numbers.


TCP Port Numbers and Concurrent Servers.


Buffer Sizes and Limitations.


Standard Internet Services.


Protocol Usage by Common Internet Applications.


Summary.

II. ELEMENTARY SOCKETS.


3. Sockets Introduction.


Introduction.


Socket Address Structures.


Value-Result Arguments.


Byte Ordering Functions.


Byte Manipulation Functions.


inet_aton, inet_addr, and inet_ntoa Functions.


inet_pton and inet_ntop Functions.


sock_ntop and Related Functions.


readn, writen, and readline Functions.


Summary.


4. Elementary TCP Sockets.


Introduction.


socket Function.


connect Function.


bind Function.


listen Function.


accept Function.


fork and exec Functions.


Concurrent Servers.


close Function.


getsockname and getpeername Functions.


Summary.


5. TCP Client/Server Example.


Introduction.


TCP Echo Server: main Function.


TCP Echo Server: str_echo Function.


TCP Echo Client: main Function.


TCP Echo Client: str_cli Function.


Normal Startup.


Normal Termination.


POSIX Signal Handling.


Handling SIGCHLD Signals.


wait and waitpid Functions.


Connection Abort before accept Returns.


Termination of Server Process.


SIGPIPE Signal.


Crashing of Server Host.


Crashing and Rebooting of Server Host.


Shutdown of Server Host.


Summary of TCP Example.


Data Format.


Summary.


6. I/O Multiplexing: The select and poll Functions.


Introduction.


I/O Models.


select Function.


str_cli Function (Revisited).


Batch Input and Buffering.


shutdown Function.


str_cli Function (Revisited Again).


TCP Echo Server (Revisited).


pselect Function.


poll Function.


TCP Echo Server (Revisited Again).


Summary.


7. Socket Options.


Introduction.


getsockopt and setsockopt Functions.


Checking if an Option Is Supported and Obtaining the Default.


Socket States.


Generic Socket Options.


IPv4 Socket Options.


ICMPv6 Socket Option.


IPv6 Socket Options.


TCP Socket Options.


SCTP Socket Options.


fcntl Function.


Summary.


8. Elementary UDP Sockets.


Introduction.


recvfrom and sendto Functions.


UDP Echo Server: main Function.


UDP Echo Server: dg_echo Function.


UDP Echo Client: main Function.


UDP Echo Client: dg_cli Function.


Lost Datagrams.


Verifying Received Response.


Server Not Running.


Summary of UDP Example.


connect Function with UDP.


dg_cli Function (Revisited).


Lack of Flow Control with UDP.


Determining Outgoing Interface with UDP.


TCP and UDP Echo Server Using select.


Summary.


9. Elementary SCTP Sockets.


Introduction.


Interface Models.


sctp_bindx Function.


sctp_connectx Function.


sctp_getpaddrs Function.


sctp_freepaddrs Function.


sctp_getladdrs Function.


sctp_freeladdrs Function.


sctp_sendmsg Function.


sctp_recvmsg Function.


sctp_opt_info Function.


sctp_peeloff Function.


shutdown Function.


Notifications.


Summary.


10. SCTP Client/Server Example.


Introduction.


SCTP One-to-Many-Style Streaming Echo Server: main Function.


SCTP One-to-Many-Style Streaming Echo Client: main Function.


SCTP Streaming Echo Client: str_cli Function.


Exploring Head-of-Line Blocking.


Controlling the Number of Streams.


Controlling Termination.


Summary.


11. Name and Address Conversions.


Introduction.


Domain Name System (DNS).


gethostbyname Function.


gethostbyaddr Function.


getservbyname and getservbyport Functions.


getaddrinfo Function.


gai_strerror Function.


freeaddrinfo Function.


getaddrinfo Function: IPv6.


getaddrinfo Function: Examples.


host_serv Function.


tcp_connect Function.


tcp_listen Function.


udp_client Function.


udp_connect Function.


udp_server Function.


getnameinfo Function.


Re-entrant Functions.


gethostbyname_r and gethostbyaddr_r Functions.


Obsolete IPv6 Address Lookup Functions.


Other Networking Information.


Summary.

III. ADVANCED SOCKETS.


12. IPv4 and IPv6 Interoperability.


Introduction.


IPv4 Client, IPv6 Server.


IPv6 Client, IPv4 Server.


IPv6 Address-Testing Macros.


Source Code Portability.


Summary.


13. Daemon Processes and the inetd Superserver.


Introduction.


syslogd Daemon.


syslog Function.


daemon_init Function.


inetd Daemon.


daemon_inetd Function.


Summary.


14. Advanced I/O Functions.


Introduction.


Socket Timeouts.


recv and send Functions.


readv and writev Functions.


recvmsg and sendmsg Functions.


Ancillary Data.


How Much Data Is Queued?


Sockets and Standard I/O.


Advanced Polling.


Summary.


15. Unix Domain Protocols.


Introduction.


Unix Domain Socket Address Structure.


socketpair Function.


Socket Functions.


Unix Domain Stream Client/Server.


Unix Domain Datagram Client/Server.


Passing Descriptors.


Receiving Sender Credentials.


Summary.


16. Nonblocking I/O.


Introduction.


Nonblocking Reads and Writes: str_cli Function (Revisited).


Nonblocking connect.


Nonblocking connect: Daytime Client.


Nonblocking connect: Web Client.


Nonblocking accept.


Summary.


17. ioctl Operations.


Introduction.


ioctl Function.


Socket Operations.


File Operations.


Interface Configuration.


get_ifi_info Function.


Interface Operations.


ARP Cache Operations.


Routing Table Operations.


Summary.


18. Routing Sockets.


Introduction.


Datalink Socket Address Structure.


Reading and Writing.


sysctl Operations.


get_ifi_info Function (Revisited).


Interface Name and Index Functions.


Summary.


19. Key Management Sockets.


Introduction.


Reading and Writing.


Dumping the Security Association Database (SADB).


Creating a Static Security Association (SA).


Dynamically Maintaining SAs.


Summary.


20. Broadcasting.


Introduction.


Broadcast Addresses.


Unicast versus Broadcast.


dg_cli Function Using Broadcasting.


Race Conditions.


Summary.


21. Multicasting.


Introduction.


Multicast Addresses.


Multicasting versus Broadcasting on a LAN.


Multicasting on a WAN.


Source-Specific Multicast.


Multicast Socket Options.


mcast_join and Related Functions.


dg_cli Function Using Multicasting.


Receiving IP Multicast Infrastructure Session Announcements.


Sending and Receiving.


Simple Network Time Protocol (SNTP).


Summary.


22. Advanced UDP Sockets.


Introduction.


Receiving Flags, Destination IP Address, and Interface Index.


Datagram Truncation.


When to Use UDP Instead of TCP.


Adding Reliability to a UDP Application.


Binding Interface Addresses.


Concurrent UDP Servers.


IPv6 Packet Information.


IPv6 Path MTU Control.


Summary.


23. Advanced SCTP Sockets.


Introduction.


An Autoclosing One-to-Many-Style Server.


Partial Delivery.


Notifications.


Unordered Data.


Binding a Subset of Addresses.


Determining Peer and Local Address Information.


Finding an Association ID Given an IP Address.


Heartbeating and Address Failure.


Peeling Off an Association.


Controlling Timing.


When to Use SCTP Instead of TCP.


Summary.


24. Out-of-Band Data.


Introduction.


TCP Out-of-Band Data.


sockatmark Function.


TCP Out-of-Band Data Recap.


Summary.


25. Signal-Driven I/O.


Introduction.


Signal-Driven I/O for Sockets.


UDP Echo Server Using SIGIO.


Summary.


26. Threads.


Introduction.


Basic Thread Functions: Creation and Termination.


str_cli Function Using Threads.


TCP Echo Server Using Threads.


Thread-Specific Data.


Web Client and Simultaneous Connections (Continued).


Mutexes: Mutual Exclusion.


Condition Variables.


Web Client and Simultaneous Connections (Continued).


Summary.


27. IP Options.


Introduction.


IPv4 Options.


IPv4 Source Route Options.


IPv6 Extension Headers.


IPv6 Hop-by-Hop Options and Destination Options.


IPv6 Routing Header.


IPv6 Sticky Options.


Historical IPv6 Advanced API.


Summary.


28. Raw Sockets.


Introduction.


Raw Socket Creation.


Raw Socket Output.


Raw Socket Input.


ping Program.


traceroute Program.


An ICMP Message Daemon.


Summary.


29. Datalink Access.


Introduction.


BSD Packet Filter (BPF).


Datalink Provider Interface (DLPI).


Linux: SOCK_PACKET and PF_PACKET.


libpcap: Packet Capture Library.


libnet: Packet Creation and Injection Library.


Examining the UDP Checksum Field.


Summary.


30. Client/Server Design Alternatives.


Introduction.


TCP Client Alternatives.


TCP Test Client.


TCP Iterative Server.


TCP Concurrent Server, One Child per Client.


TCP Preforked Server, No Locking Around accept.


TCP Preforked Server, File Locking Around accept.


TCP Preforked Server, Thread Locking Around accept.


TCP Preforked Server, Descriptor Passing.


TCP Concurrent Server, One Thread per Client.


TCP Prethreaded Server, per-Thread accept.


TCP Prethreaded Server, Main Thread accept.


Summary.


31. STREAMS.


Introduction.


Overview.


getmsg and putmsg Functions.


getpmsg and putpmsg Functions.


ioctl Function.


Transport Provider Interface (TPI).


Summary.


Appendix A. IPv4, IPv6, ICMPv4, and ICMPv6.


Introduction.


IPv4 Header.


IPv6 Header.


IPv4 Addresses.


IPv6 Addresses.


Internet Control Message Protocols (ICMPv4 and ICMPv6).


Appendix B. Virtual Networks.


Introduction.


The MBone.


The 6bone.


IPv6 Transition: 6to4.


Appendix C. Debugging Techniques.


System Call Tracing.


Standard Internet Services.


sock Program.


Small Test Programs.


tcpdump Program.


netstat Program.


lsof Program.


Appendix D. Miscellaneous Source Code.


unp.h Header.


config.h Header.


Standard Error Functions.


Appendix E. Solutions to Selected Exercises.

Bibliography.

Index.

Preface

Preface Introduction

This book is for people who want to write programs that communicate with each otherusing an application program interface (API) known as sockets. Some readers may bevery familiar with sockets already, as that model has become synonymous with networkprogramming. Others may need an introduction to sockets from the ground up. Thegoal of this book is to offer guidance on network programming for beginners as well asprofessionals, for those developing new network-aware applications as well as thosemaintaining existing code, and for people who simply want to understand how the networkingcomponents of their system function.

All the examples in this text are actual, runnable code tested on Unix systems.However, many non-Unix systems support the sockets API and the examples arelargely operating system-independent, as are the general concepts we present. Virtuallyevery operating system (OS) provides numerous network-aware applications such asWeb browsers, email clients, and file-sharing servers. We discuss the usual partitioningof these applications into client and server and write our own small examples of thesemany times throughout the text.

Presenting this material in a Unix-oriented fashion has the natural side effect of providingbackground on Unix itself, and on TCP/IP as well. Where more extensive backgroundmay be interesting, we refer the reader to other texts. Four texts are so commonlymentioned in this book that we've assigned them the following abbreviations:

  • APUE: Advanced Programming in the UNIX Environment Stevens 1992
  • TCPv1: TCP/IP Illustrated, Volume 1 Stevens 1994
  • TCPv2: TCP/IP Illustrated, Volume 2 Wright and Stevens 1995
  • TCPv3: TCP/IP Illustrated, Volume 3 Stevens 1996

TCPv2 contains a high level of detail very closely related to the material in this book, asit describes and presents the actual 4.4BSD implementation of the network programmingfunctions for the sockets API (socket, bind, connect, and so on). If one understandsthe implementation of a feature, the use of that feature in an application makesmore sense.

Changes from the Second Edition

Sockets have been around, more or less in their current form, since the 1980s, and it is atribute to their initial design that they have continued to be the network API of choice.Therefore, it may come as a surprise to learn that quite a bit has changed since the secondedition of this book was published in 1998. The changes we've made to the text aresummarized as follows:

  • This new edition contains updated information on IPv6, which was only in draft form at the time of publication of the second edition and has evolved somewhat.
  • The descriptions of functions and the examples have all been updated to reflect the most recent POSIX specification (POSIX 1003.1-2001), also known as the Single Unix Specification Version 3.
  • The coverage of the X/Open Transport Interface (XTI) has been dropped. That API has fallen out of common use and even the most recent POSIX specification does not bother to cover it.
  • The coverage of TCP for transactions (T/TCP) has been dropped.
  • Three chapters have been added to describe a relatively new transport protocol, SCTP. This reliable, message-oriented protocol provides multiple streams between endpoints and transport-level support for multihoming. It was originally designed for transport of telephony signaling across the Internet, but provides some features that many applications could take advantage of.
  • A chapter has been added on key management sockets, which may be used with Internet Protocol Security (IPsec) and other network security services.
  • The machines used, as well as the versions of their variants of Unix, have all been updated, and the examples have been updated to reflect how these machines behave. In many cases, examples were updated because OS vendors fixed bugs or added features, but as one might expect, we've discovered the occasional new bug here and there. The machines used for testing the examples in this book were:
  • Apple Power PC running MacOS/X 10.2.6
  • HP PA-RISC running HP-UX 11i
  • IBM Power PC running AIX 5.1
  • Intel x86 running FreeBSD 4.8
  • Intel x86 running Linux 2.4.7
  • Sun SPARC running FreeBSD 5.1
  • Sun SPARC running Solaris 9

See Figure 1.16 for details on how these machines were used.

Volume 2 of this UNIX Network Programming series, subtitled Interprocess Communications,builds on the material presented here to cover message passing, synchronization,shared memory, and remote procedure calls.

Using This Book

This text can be used as either a tutorial on network programming or as a reference forexperienced programmers. When used as a tutorial or for an introductory class on networkprogramming, the emphasis should be on Part 2, ''Elementary Sockets'' (Chapters3 through 11), followed by whatever additional topics are of interest. Part 2 covers thebasic socket functions for both TCP and UDP, along with SCTP, I/O multiplexing,socket options, and basic name and address conversions. Chapter 1 should be read byall readers, especially Section 1.4, which describes some wrapper functions usedthroughout the text. Chapter 2 and perhaps Appendix A should be referred to as necessary,depending on the reader 's background. Most of the chapters in Part 3, ''AdvancedSockets,'' can be read independently of the others in that part of the book.

To aid in the use of this book as a reference, a thorough index is provided, alongwith summaries on the end papers of where to find detailed descriptions of all the functionsand structures. To help those reading topics in a random order, numerous referencesto related topics are provided throughout the text.

Source Code and Errata Availability

The source code for all the examples that appear in the book is available on the Web atwww.unpbook.com. The best way to learn network programming is to take these programs,modify them, and enhance them. Actually writing code of this form is the onlyway to reinforce the concepts and techniques. Numerous exercises are also provided atthe end of each chapter, and most answers are provided in Appendix E.

A current errata for the book is also available from the same Web site.

The authors welcome electronic mail from any readers with comments, suggestions,or bug fixes.

Bill Fenner

Woodside, California

Andrew M. Rudoff

Boulder, Colorado

October 2003

authors@unpbook.com

http://www.unpbook.com

From the B&N Reads Blog

Customer Reviews