W-Note-16 BBN IEN-162 TRANSPORT, ADDRESSING, AND ROUTING IN THE WIDEBAND NET Wideband Net Working Note #16 Internet Experiment Note #162 John A. Pershing Jr. Bolt Beranek and Newman Inc. 50 Moulton Street Cambridge, Mass. 02238 (617) 491-1850 October 1980 The online version of this note does not contain 2 figures. Hardcopy versions including the figures may be obtained from the author at the above address, or by a request via computer mail to JPershing@BBNA. 1
W-Note-16 BBN IEN-162 TRANSPORT, ADDRESSING, AND ROUTING IN THE WIDEBAND NET This note proposes a model for addressing and routing in the DARPA Wideband Satellite Experiment. The purpose of the organization described herein is twofold: (1) to hide the physical structure of the Wideband Net from The Internet and its gateways; and (2) to unify the transport and routing functions performed within the Wideband Net. Certain terms, defined in a glossary at the end of this memo, are used with specific, somewhat non-standard meanings in order to avoid ambiguities. 1. Current Organization The Wideband Satellite Experiment involves the development of the PSAT satellite network, several local networks, and connections to several existing networks such as the ARPANET. Currently, no plan exists for the organization of these parts into a unified communication medium. So far, the Wideband Net is a collection of independent, sovereign networks, each with its own transport protocol, addressing, and routing schemes. This sovereignty of the constituent networks is a feature which should be preserved as much as possible, so that the development of local and satellite network technologies can proceed without artificial constraints. 2
W-Note-16 BBN IEN-162 Figure 1 illustrates a hypothetical organization sometime in the future, after the network has expanded somewhat. Each site has one PSAT, and perhaps a Voice Funnel and/or mini-concentrator; additionally, sites have a number of local networks with various interconnections. Hosts may be connected directly to a PSAT, a Voice Funnel, or to a local network; some hosts may have connections to two or more nets, etc. A uniform plan for communication in the Wideband Net will avoid ad hoc schemes involving specialized interface machines which transform one net's local protocol and addressing into that of another net. Using specialized gateways in combination with source routing will not take full advantage of the topology and dynamics of the situation. (This is particularly evident if the link indicated by the dotted line exists, since only the Voice Funnel at the right side of the figure knows the status of both the dotted link and the satellite link, and only that Voice Funnel is able to choose the appropriate link.) Such ad hoc schemes are inflexible, inefficient in terms of manpower (since large amounts of special-purpose code must be implemented), and do not allow the Wideband Net to be readily integrated into the Internet. A "simple" approach is to consider every component in Figure 1 to be a member of The Internet, assigning an Internet Network Number to each of the constituent nets, and relying on internet 3
W-Note-16 BBN IEN-162 Figure 1: Current Organization of the Wideband Net gateways for routing. However, even this simple diagram has twelve nets, not counting the ARPANET (the Voice Funnels must also behave as networks so that the directly attached hosts have well-defined internet addresses), and there are 16 cross-net connections requiring Internet gateways. It is probably 4
W-Note-16 BBN IEN-162 unreasonable for us to consume so many network numbers from the address space of 255; furthermore, a proliferation of Internet Networks places an unreasonable burden on the gateways and networks of the Internet, both in terms of table space and routing update traffic (since all gateways must track all networks). 2. Proposed Structure This memo proposes that the networks within the Wideband Satellite Experiment collectively behave as one network from the point of view of the rest of The Internet, as illustrated in Figure 2. All components of the Wideband Net share one Internet network number. Internally, the Wideband Net looks like a catenet; this structure was suggested by Vint Cerf in IEN-48 [1]. The various subnets are interconnected by gateways; each subnet maintains its own autonomy, and hosts that are only involved in local communication can ignore the catenet (and Internet) aspects of the arrangement. We will adopt an internal addressing and routing scheme which is transparent to the Internet Protocol (IP) [2], so that all hosts on the Wideband Net will have well-defined Internet addresses; we adopt IP as the Wideband Net's "catenet transport protocol", and superimpose a fine-structure on the 24-bit local address part of the (32-bit) Internet address (see Figure 3). 5
W-Note-16 BBN IEN-162 Figure 2: Proposed Organization of the Wideband Net The high-order 8 bits specify a subnet of the Wideband Net (e.g., a specific LexNet), and the remaining 16 bits specify the local address on that net. 6
W-Note-16 BBN IEN-162 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | 28. | Subnet Number | Reserved for Subnet Use | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ <-------------> <---------------------------------------------> Internet Internet Local Address Network Number Figure 3: Internet Address, as used in the Wideband Net Since the model we are adopting is one that has been thoroughly explored by the Internet community, many of the problems have been solved and many issues have already been resolved. For example, the gateways between these subnets are much like the Internet Gateways. These gateways will pass IP packets among subnets of the Wideband Net, stripping the local transport protocol layer from incoming packets, making routing decisions, and wrapping outgoing packets in the protocol of the next net which the packet will have to traverse. This scheme does not depend on the participation of all attached hosts -- only the gateways are critical, and, as the network becomes richly interconnected, individual gateways cease to be critical to the proper operation of the net. Other catenet transport protocols could be chosen, or one could be devised for use within the Wideband Net. However, hosts would still need to implement IP in order to communicate over The 7
W-Note-16 BBN IEN-162 Internet, so such a "local" catenet protocol would be essentially excess baggage. By adopting IP as the Wideband Net's protocol, there is also a good chance of being able to use existing code with only minor modifications. The issue of what is an Internet network (with its own assigned Internet network number) and what is a subnet is more of a managerial problem than a technical one. The relevant issue is the partitioning of The Internet, in terms of name space and the burden of the routing algorithm on the gateways, as well as in terms of managerial responsibility. The proposed scheme for the Wideband Net is quite flexible in this regard. If one of the subnets becomes an Internet network, then the gateways will perform somewhat different routing with respect to that network, and the other hosts of the Wideband Net will be mostly indifferent to the change (except that the addresses of the hosts on the "promoted" subnet will change). Presumably, any Wideband Net gateways which were connected to the net will be "promoted" to Internet gateways. While we believe that this proposed organization should be adopted, it has several problems. However, these problems also exist in The Internet and are treated more fully in various Internet Experiment Notes; they are only briefly mentioned here. The name space is becoming crowded; using 8 bits for the subnet number and 16 bits for the local host address is perhaps the 8
W-Note-16 BBN IEN-162 wrong partition. However, this choice seems to be a good tradeoff between the potential size of the Wideband Net (measured in subnets) and the addressing requirements of any individual subnet. Eventually, the issue of name-space size will have to be addressed by the Internet community as a whole. Since the fine structure of the Wideband Net is not known to The Internet, it is possible that Internet Gateways will make non-optimal routing decisions with respect to the Wideband Net. This is the penalty which must be paid for trying to minimize the number of Internet Networks. If the Internet Gateways which are connected to the Wideband Net are also Wideband Net gateways (that is, they participate in Wideband Net routing as well as Internet routing), then they may be able to fine-tune the routing of Internet packets through the use of advisory messages exchanged with the other Internet Gateways. 3. Transport Protocol Layers For purposes of discussion, we define the notion of catenet adjacency. Two hosts on some catenet are adjacent if they are connected to the same constituent network. Conversely, two hosts are non-adjacent if they are connected to different constituent networks of some catenet. Note that hosts with interfaces on more than one network (such as a gateway) may be both adjacent and non-adjacent to a given host; in fact, such a host is non-adjacent to itself by this definition. 9
W-Note-16 BBN IEN-162 The transport, addressing, and routing schemes suggested in this memo are intended to be used by non-adjacent hosts on the Wideband Net. Of course this does not prohibit adjacent hosts from communicating with these protocols; however, such hosts have the option of communicating using protocols which are local to the network to which they are attached (and, for efficiency reasons, such hosts will probably exercise this option). Datagrams which are to be transmitted through the Wideband Net are wrapped in a layer of catenet protocol, which is common to the entire Wideband Net, followed by a (possibly null) layer of protocol which is dictated by the particular network that the datagram is traversing. The catenet protocol header is considered to be part of the datagram, and is preserved (with only minor changes) as the datagram traverses the various constituent networks. The layer of local protocol is volatile, and will be discarded as soon as the datagram exits the network defining that particular local protocol. For compatibility with The Internet, the catenet protocol used is the DoD Standard Internet Protocol (IP) [2]. This permits hosts of the Wideband Net to communicate with hosts on other Internet Networks without resorting to yet another layer of protocol. Initially, no internet gateways will be provided on the Wideband Net, so that a restricted subset of IP may be implemented by the various hosts. The restrictions of the initial implementation follow: 10
W-Note-16 BBN IEN-162 o Fragmentation and Reassembly: Not implemented. Total length may not exceed 576 octets; we believe that all participating hosts, gateways, and networks will support Internet datagrams of this length without fragmentation. The "Flags" field will always be set to '010' (binary) to inhibit fragmentation; the "Fragment Offset" field will always be zero. o Source/Destination Addresses: The Internet Network Number (first 8 bits) will always be '28' (decimal). The Source/Destination Local Address (remaining 24 bits) is further interpreted as being 8 bits of network number and 16 bits of local address on that network. o Options: Strictly optional. Any options which are present must be accounted for by the Internet Header Length (IHL) and Header Checksum fields; however, no host is required to interpret any options. The local protocol is dependent on the particular network(s) to which a host is attached -- there is potentially a different local protocol for every constituent network. In addition, a single network may have more than one link-level protocols, depending on the particular type of port to which the host is attached. Issues of local protocols are of no concern to the purposes of this memo; the implementor is referred to the (possibly nonexistent) documentation on the local protocol of the network(s) to which a particular host is to be interfaced. 4. Addressing All hosts on the Wideband Net have at least one unique Internet address. Since the 8-bit Internet Network Number is already specified by the Internet protocols (the Wideband Net is number 28 decimal), this leaves a 24-bit address space for use within the Wideband Net. 11
W-Note-16 BBN IEN-162 Since the Wideband Net is organized as a catenet, the "network number / local host number" strategy employed by The Internet is also employed within the Wideband Net. Each distinct, constituent network is assigned a unique, 8-bit network number; and each host is assigned a unique, 16-bit local address on each network to which it is attached. These two numbers are concatenated to produce the 24-bit Wideband Net Address. 5. Routing and Gateways Routing in the Wideband Net is implemented in the same manner as routing in The Internet [4]. The constituent networks are connected by gateways; these gateways implement the routing function. One of the primary functions of the Voice Funnels is to implement this gateway function for each network to which it is attached. If a network is to be attached to the Wideband Net at some place besides a Voice Funnel, then it is the responsibility of that network to provide a gateway. The IP server in each host needs to know very little about routing in order to function properly. It is assumed that each host knows its own address (that is, its network number and its address on that network) and the address of at least one adjacent gateway. Also, the IP server must be able to produce a local network protocol header from a 24-bit Wideband Net address which specifies this local network. 12
W-Note-16 BBN IEN-162 When a host's IP server is called on to deliver a datagram to an adjacent host it wraps the datagram first in an IP header, then in a local header which is addressed to that host, and sends the result directly to its destination. When an IP server is called on to deliver to a non-adjacent host, it wraps the datagram first in an IP header, then in a local header which is addressed to an adjacent gateway and delivers it. That gateway, in cooperation with the other gateways of the Wideband Net, will deliver the datagram to its destination. In addition to transmitting outgoing datagrams, IP servers will receive datagrams from their network(s). These should be routed internally as appropriate; this is probably dependent on the "Protocol" field of the IP header (but note that a protocol of '3' indicates an advisory message from a gateway directed at the IP server itself). If an IP server is to function optimally, it must keep track of ALL adjacent gateways which are up. Additionally, it must maintain a cache of those non-adjacent hosts to which it has recently sent datagrams, along with the gateway through which these datagrams were forwarded. When it is about to send a datagram, the IP server first checks the cache. If the addressee is found in the cache and if the gateway named in the cache is still up, then the datagram is forwarded to that same gateway. Otherwise, a gateway is chosen arbitrarily through which to forward the datagram. 13
W-Note-16 BBN IEN-162 Occasionally, a routing advisory message will be sent to the IP server by a gateway. Currently, one of two advisories may be received: "destination unreachable", meaning that it will be futile to send more datagrams to some host for a while (e.g. a couple of minutes); and "redirect", meaning that a non-optimal gateway was used, and that further datagrams should be forwarded through the gateway specified in the redirect message. When an IP server receives a routing advisory, it should update its cache, and perhaps notify one or more processes as appropriate. 6. Unresolved Issues Since the currently planned constituents of the Wideband Net (the PSAT Net, LexNets, and Voice Funnels) are all capable of supporting broadcasting, it might be worthwhile to consider some form of broadcasting as a basic Wideband Net service. This would probably take two forms: group addressing, essentially extending the group concept of the PSAT Net to allow broadcasting to a designated group of hosts of the Wideband Net; and general broadcasting, directed at all hosts on a particular subnet or at all hosts of the Wideband Net. The ST protocol should also be supported directly by the Wideband Net's gateways. ST will allow the capacity of the various subnets to be more fully utilized. It should also be made to take advantage of the broadcast nature of the various subnets. 14
W-Note-16 BBN IEN-162 7. Glossary In order to avert the ambiguities inherent in this two-level structure, this memo uses a two-level nomenclature, defined as follows: network: A physical communication service in which all attached hosts communicate with all other hosts using a uniform, local set of link, addressing, and transport protocols; i.e. the "usual" meaning of the word. To quote Cerf [1], "the term 'local' is used in a loose sense here, since it means 'peculiar to the particular network' rather than 'a network of limited geographical extent'. A satellite-based network, such as the ARPA packet satellite network, therefore has 'local' characteristics (e.g. broadcast operation) even though it spans many thousands of square miles geographically speaking." A network must appear to be homogeneous from the "outside looking in"; however, this does not necessarily preclude an internal structure. Internet Network: A communicating system of hosts and/or networks belonging to The Internet, and which can be uniquely identified by an 8-bit "network number" assigned by the number czar [3]. This may correspond to part of a network, one network, or a concatenation of many networks. Note that the Wideband Net is an Internet Network. catenet: A collection of two or more networks, arbitrarily interconnected by gateways, in which the communicating hosts have agreed, a-priori, on some canonical "catenet protocol" which is used for datagram transport. The Internet: The collection of Internet Networks, along with their Internet Gateways. Hosts on The Internet communicate using version 4 of the DoD Standard Internet Protocol [2]. gateway: A logical host which is connected to two or more networks, and which can forward "catenet protocol" datagrams arriving from any of these 15
W-Note-16 BBN IEN-162 networks to the appropriate outgoing network. Many adjectives may be applied to "gateway" as needed. A hidden gateway is one whose presence is generally unknown by the hosts attached to the networks adjacent to the gateway. A non-routing (or static-routing) gateway makes its routing decisions based on a-priori information; a routing gateway exchanges information with other routing gateways in order to be able to make dynamic adjustments to its routing information as the conditions of the catenet change. Internet Gateway: A gateway connected to two or more Internet Networks, which can forward internet datagrams. 16
W-Note-16 BBN IEN-162 REFERENCES [1] Cerf. The Catenet Model for Internetworking. Internet Experiment Note 48, July, 1978. [2] Postel, ed. The DoD Standard Internet Protocol. Internet Experiment Note 128, January, 1980. [3] Postel, ed. Assigned Numbers. Request for Comments 770, September, 1980. [4] Strasisar. How to Build a Gateway. Internet Experiment Note 109, August, 1979. 17