US20030084185A1 - Apparatus and method for scaling TCP off load buffer requirements by segment size - Google Patents
Apparatus and method for scaling TCP off load buffer requirements by segment size Download PDFInfo
- Publication number
- US20030084185A1 US20030084185A1 US10/016,609 US1660901A US2003084185A1 US 20030084185 A1 US20030084185 A1 US 20030084185A1 US 1660901 A US1660901 A US 1660901A US 2003084185 A1 US2003084185 A1 US 2003084185A1
- Authority
- US
- United States
- Prior art keywords
- segment
- transport
- describing
- size
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 239000000872 buffer Substances 0.000 title claims abstract description 55
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000009432 framing Methods 0.000 claims abstract description 42
- 238000012545 processing Methods 0.000 claims description 28
- 238000004891 communication Methods 0.000 claims description 17
- 239000012634 fragment Substances 0.000 claims description 4
- 238000012546 transfer Methods 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 6
- 238000013459 approach Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000005055 memory storage Effects 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000002860 competitive effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000004880 explosion Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/561—Adding application-functional data or data for application control, e.g. adding metadata
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/06—Notations for structuring of protocol data, e.g. abstract syntax notation one [ASN.1]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/40—Network security protocols
Definitions
- This invention relates generally to networked communications and, more particularly, relates to a system and method for managing the buffering of data in systems having transport layers that do not have self-describing transport segments.
- Computer networking allows applications residing on separate computers or devices to communicate with each other by passing data across the network connecting the computers.
- the amount of data segments being sent across networks is rapidly increasing. The increase is due to several factors. These factors include the growth in the number of networked computers and the explosion in growth of digitally based multimedia, which is the combination of video and audio in a digital format for viewing on a computer or other digital device.
- Data is typically sent in segments or packets.
- One of the problems that has occurred as a result of the increased data flow is segment delay, segment loss and reordering of segments (e.g., segments arriving out of order).
- the segment delay, segment loss, and reordering of segments causes problems for many applications that rely on the data being received timely and in the order it was sent. For example, applications such as digitally based multimedia that receive data sent in segments must receive the data in the order the segments were sent and without any delay for proper playback.
- Window_size is generally assumed to be the bandwidth delay product, which is the round trip time (RTT) of data sent between the sending computer and the receiving computer multiplied by the bandwidth of the data.
- RTT round trip time
- the required speed and size of the buffer also increases. For example, on a local area network running at one gigabit/sec with a one millisecond RTT having 100 simultaneous connections, the memory required is 12.5 MB. For wide area networks running at ten gigabits/sec and having 100 millisecond RTT and 100 simultaneous connections, the total buffer memory required is 12.5 GB.
- the required buffer memory is a problem when the Transmission Control Protocol (TCP) is offloaded from the host to a network interface card (NIC).
- TCP Transmission Control Protocol
- NIC network interface card
- the intermediate reassembly buffer is typically placed on the NIC connection (i.e., on the network interface card).
- ULPs upper layer protocols
- An upper layer protocol is a protocol that resides above the data transmission protocol layer in the computer or other digital device.
- the ULPs that perform bulk data transfer include specific application ULPs such as iSCSI and generic hardware acceleration ULPs such as a remote direct memory access (RDMA) protocol.
- RDMA remote direct memory access
- ULP PDU upper layer protocol protocol data unit
- a ULP PDU is an upper layer protocol data packet or message.
- the ULP PDU is not always identical to the size of the transport segment used by the transport protocol to send the data over the network.
- the ULP PDU is split and placed into several transport segments. This results in the ULP PDU header not being located in every transport segment and located at any place in a transport segment.
- the transport segments that do not contain the ULP PDU header are called non self-describing transport segments because they do not have sufficient information to directly place the data into its final location.
- the ULP PDU header must be located for direct placement to work.
- One solution to finding the ULP PDU header in the transport segment is to put a marker in each transport segment at a predefined period that provides a pointer to ULP PDU header of the next PDU. If the period is high relative to packet loss rate (e.g., once per segment), the location of the next PDU can be found with a very high likelihood when a previous PDU header has been lost.
- the problem with this solution is that data must still be buffered. The minimum size of the buffer required is:
- the buffer size required for direct placement approaches the intermediate reassembly buffer sizes of multiple gigabytes as indicated above.
- the present invention provides a method to ensure that there is enough information in each transport segment to allow the data being sent in the transport segment to be placed in the client's buffer.
- a framing header is aligned with the transport segment header so that the framing header is at the beginning of the transport segment.
- Information is placed in the framing header that describes the transport segment in sufficient detail to allow the data in the transport segment to be placed in its final destination. This effectively eliminates the need for an intermediate reassembly buffer in the performance path (i.e., the primary path in which the data is being received).
- the information includes the length of the transport segment (i.e., the size), an offset and the ULP client buffer id.
- the information includes the ULP client buffer id and the ULP client buffer address.
- FIG. 1 is a block diagram illustrating a network system having a plurality of networks connected by a transport in which the present invention operates;
- FIG. 2 is a block diagram generally illustrating an exemplary computer system on which the present invention resides;
- FIG. 3 is a block diagram illustrating an embodiment of a network protocol stack employing a framing protocol in accordance with the teaching of the present invention
- FIG. 4 is a block diagram illustrating an alternate embodiment of an operating system employing a framing protocol in accordance with the teaching of the present invention
- FIG. 5 is a diagram illustrating an example of a framing header aligned with a transport segment header in accordance with the present invention
- FIGS. 6 a and 6 b illustrate a flow chart of a method of transforming a non self-describing protocol data unit into a self-describing protocol data unit in accordance with the present invention
- FIG. 7 is a diagram illustrating the format of a framing data unit in accordance with the present invention.
- each transport segment begins with segment description information and contains an integral number of ULP PDUs.
- Segment description information is information that is sufficient for direct data placement to occur. Direct data placement occurs when a receiving node directly maps the incoming data (e.g., the data in the ULP PDU) to a specific ULP buffer and a specific offset within that buffer. In this way, the destination location of the ULP PDU is known and the out of order ULP PDU is placed in its destination location.
- the size of the buffer memory required is reduced to:
- k is a constant.
- the present invention allows the data in each transport segment to be placed in its final destination independently of all other segments and requires no intermediate reassembly buffers in the performance path.
- program modules include routines, programs, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types.
- program modules include routines, programs, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types.
- program modules may be located in both local and remote memory storage devices.
- the invention is illustrated as being implemented in a suitable networking environment such as the network system environment 20 illustrated in FIG. 1.
- the network system environment 20 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention.
- those of skill in the art will appreciate that the invention can also be used in wireless systems and that various of the acts and operations described hereinafter may also be implemented in hardware.
- the exemplary network system 20 includes local sub-networks 22 , 24 connected to each other by network 26 .
- Network 26 may be a virtual private network, a LAN, a WAN, the Internet, and the like.
- Local sub-network 22 has general purpose computing devices in the form of computers 28 , 30 , and local sub-network 24 has computer 32 .
- the network system 20 may have additional local sub-networks and local sub-networks 22 , 24 may have additional computers.
- Each sub-network 22 , 24 is served by a transport provider 34 , such as TCP/IP, for providing communication between computers and between applications residing on computers.
- FIG. 2 An example of a suitable computing system environment 100 on which the invention may be implemented is illustrated in FIG. 2.
- the computing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing environment 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment 100 .
- the invention is operational with numerous other general purpose or special purpose computing system environments or configurations.
- Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to, personal computers, server computers, handheld or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, network cards, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
- the invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a processing device.
- program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types.
- the invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network.
- program modules may be located in both local and remote computer storage media including memory storage devices.
- an exemplary system for implementing the invention includes a general purpose computing device in the form of a processing device 110 .
- processing device 110 typically includes a processing unit 112 and system memory 114 .
- Processing unit 112 spans a diverse set of implementations including a central processing unit, a hardware finite state machine based implementation, and a microprocessor assembly language implementation.
- memory 114 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.) or some combination of the two.
- Memory 114 has buffers 116 for receiving, sending, and storing data.
- processing device 110 may also have removable mass storage 118 and/or non-removable mass storage 120 such as magnetic disks, magnetic cassettes, optical disks or tape.
- processing device 110 may also have input devices 122 such as a mouse, a keyboard, a modem, and the like and/or output devices 124 such as a display, a printer, speakers and the like.
- Other aspects of processing device 110 may include communication device 126 for communicating to other devices, computers, networks, servers, etc. using either wired or wireless media or a combination of the above. Network communication occurs through communication device 126 and may include buffers 128 on the communication device 126 , buffers 116 in the processing device 110 , or a combination of buffers 116 and buffers 128 . All of these devices are well known in the art and need not be discussed at length here.
- Processing device 110 typically includes at least some form of computer readable media.
- computer readable media may comprise computer storage media and communication media.
- Computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
- Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory, or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information.
- Communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
- modulated data signal means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.
- communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of any of the above should also be included within the scope of computer readable media.
- FIGS. 3 and 4 illustrate where the framing protocol of the present invention resides on standard network stack (or layer) architectures that have transport layers that use transport protocols.
- the framing protocol and transport protocol may reside in the processing device 110 or in the communication device 126 or in a combination of the processing device 110 and communication device 126 .
- FIG. 3 shows an architectural overview of an embodiment of the framing protocol according to the invention implemented in the International Standard Organization's Open System Interconnect (ISO/OSI) model.
- the framing protocol 202 is in communication with upper layer protocol client 200 and with transport layer 204 .
- the framing protocol 202 may be integrated with the transport layer 204 .
- the transport layer 204 resides above the network layer 206 and enforces desired transmission control using a transport protocol.
- a transport protocol controls the transmission of transport segments.
- the network layer 206 ensures that information arrives at its intended destination across a diverse set of data link layers.
- the data link layer 208 resides below the network layer 206 and packages and addresses data and manages the flow of transmissions on a local link.
- the physical layer 210 resides below the data link layer 208 and deals with all aspects of establishing and maintaining a physical link between communicating computers.
- FIG. 4 shows an architectural overview of an embodiment of the framing protocol implemented in the TCP/IP environment.
- the framing protocol 202 sits above the standard TCP protocol 220 , which is a transport protocol, and the IP protocol 222 .
- the IP protocol 222 is in communication with the network interface card (NIC) 226 via NDIS 224 . While the framing protocol 202 has been illustrated as a separate layer in FIGS. 3 and 4, the framing protocol 202 may be integrated with other layers.
- each transport segment 300 has a transport header 302 .
- the invention places a framing header 304 having segment description information within or after the transport header 302 .
- the segment description information describes the data 306 with sufficient detail so that data in transport segments received out of order can be placed in its destination location. Transport segments that have the segment description information are called self-describing segments.
- the framing protocol receives and processes the ULP PDU (step 400 ) from an upper layer sender (e.g., an application, a device, a ULP, etc.) to hand off to the transport layer to send to an upper layer receiver.
- the framing protocol uses buffers 116 , buffers 128 , or a combination of buffers 116 , 128 to receive and process the ULP PDU.
- the framing protocol first determines if the size of the ULP PDU fits within predetermined limits (step 402 ). The limits are selected based upon the transport segment size being used, the maximum transport segment size defined by the protocol used, and the degree that the transport protocol supports chunking.
- a chunking operation is an operation that splits the ULP PDU into packets that fit within the current transport segment size. The limits are provided to the framing protocol by the transport protocol. The framing protocol is notified when the transport segment size presently being used changes.
- the framing protocol fails the submission and generates an error message (step 404 ).
- the framing protocol performs a chunking operation on the ULP PDU when the ULP PDU size is larger than the limit. The chunking operation splits the ULP PDU into packets that fit within each transport segment and splits the ULP PDU into multiple transport segments. The offset within the buffer from the base of the buffer and/or the buffer address is incremented in the transport segments so that direct data placement can occur.
- the length (i.e., size) of the ULP PDUs packed in the transport segment is determined by the framing protocol (step 406 ). If the ULP PDU size is within the limit, the framing protocol determines if multiple ULP PDUs fit within a transport segment (step 408 ). If multiple ULP PDUs will fit within the transport segment, the framing protocol determines if a single PDU option was chosen (step 410 ). The single PDU option is selected by the receiver (e.g., receiving application, protocol, etc.) or the transmitter (e.g., sending application, protocol, etc.). When this option is selected, only one ULP PDU may be packed into a transport segment.
- the receiver e.g., receiving application, protocol, etc.
- the transmitter e.g., sending application, protocol, etc.
- the framing protocol puts one ULP PDU into a transport segment (step 412 ). If multiple ULP PDUs fit within a transport segment and the single PDU option was not chosen, an integral number of ULP PDUs are put into a transport segment (step 414 ).
- Information that self-describes the transport segment is placed into the transport header or right after the transport header in a framing header (step 416 ) and the transport segment is sent to the receiver (step 418 ).
- This information which is called segment description information, includes the length and an identifier that identifies the connection. This information provides a receiver with sufficient information to determine where the ULP PDU should be placed. This allows successive ULP PDUs to be recovered in the event of transport segment delay, loss, or reordering. In the event direct placement networks are being used, further information is put in the transport segment to allow the transport payload (i.e., the ULP PDU(s)) to be put in its final destination.
- the additional information includes the buffer id where the data is to be placed and the offset (i.e., the offset within the buffer from the base of the buffer).
- the length field 502 and identifier field 504 are part of the framing header 304 .
- Following the framing header is at least one integral ULP PDU in the payload 306 .
- the direct placement information (buffer id and offset) is also placed in the framing header 304 .
- the present invention allows the data in each transport segment to be placed in its final destination independently of all other segments and requires no intermediate reassembly buffers in the performance path.
- a reassembly buffer is needed if synchronization of the framing header with the transport header is lost or if there is a program module or hardware device (i.e., a middle box) re-segmenting the data stream in the network.
- the former example i.e., loss of synchronization
- loss of synchronization is a transient condition that only occurs when a path transport segment size being used has been reduced and there is no middle-box in the network which is re-segmenting the data stream.
- any transport segments already converted to self-describing segments and posted to the transmitter will be re-segmented and will result in non self-describing segments being sent to the destination. If the destination does not use a reassembly buffer, these non self-describing segments can never be successfully transmitted.
- the reassembly buffer must be large enough to recover a transport segment that is less than or equal to the maximum transport segment size of the locally attached link.
- the invention has been described with some references to the TCP protocol.
- the invention may also be used with other protocols, such as SCTP, that use transport segments that do not describe in sufficient detail where the payload is to be placed.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Library & Information Science (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
- This invention relates generally to networked communications and, more particularly, relates to a system and method for managing the buffering of data in systems having transport layers that do not have self-describing transport segments.
- Computer networking allows applications residing on separate computers or devices to communicate with each other by passing data across the network connecting the computers. The amount of data segments being sent across networks is rapidly increasing. The increase is due to several factors. These factors include the growth in the number of networked computers and the explosion in growth of digitally based multimedia, which is the combination of video and audio in a digital format for viewing on a computer or other digital device.
- Data is typically sent in segments or packets. One of the problems that has occurred as a result of the increased data flow is segment delay, segment loss and reordering of segments (e.g., segments arriving out of order). The segment delay, segment loss, and reordering of segments causes problems for many applications that rely on the data being received timely and in the order it was sent. For example, applications such as digitally based multimedia that receive data sent in segments must receive the data in the order the segments were sent and without any delay for proper playback.
- Many data transmission protocols account for segment delay, loss, and reordering by placing the data in an intermediate reassembly buffer to restore the sending order which may have been lost as a result of segment delay, loss, or reordering. If data comes in order, the data is put directly in a destination buffer. If data does not come in order, the data is put into an intermediate reassembly buffer. The bandwidth required to move data in and out of the buffer memory of the intermediate reassembly buffer is more than twice the bandwidth of the incoming data. The size of the buffer memory required is:
- K*(window_size)*(# connections)
- where K is a constant. Window_size is generally assumed to be the bandwidth delay product, which is the round trip time (RTT) of data sent between the sending computer and the receiving computer multiplied by the bandwidth of the data. As the speed of networks increases, the required speed and size of the buffer also increases. For example, on a local area network running at one gigabit/sec with a one millisecond RTT having 100 simultaneous connections, the memory required is 12.5 MB. For wide area networks running at ten gigabits/sec and having 100 millisecond RTT and 100 simultaneous connections, the total buffer memory required is 12.5 GB.
- The required buffer memory is a problem when the Transmission Control Protocol (TCP) is offloaded from the host to a network interface card (NIC). When the TCP is running on a NIC, the intermediate reassembly buffer is typically placed on the NIC connection (i.e., on the network interface card). Today, network interface cards having megabytes or gigabytes of memory are not cost competitive due to the memory size and high speed requirements.
- One approach that the computer industry has taken to reduce the amount of memory needed is the development of upper layer protocols (ULPs), such as those which perform bulk data transfer, that permit the final location (i.e., a client's buffer) to be known when the data is received. An upper layer protocol is a protocol that resides above the data transmission protocol layer in the computer or other digital device. The ULPs that perform bulk data transfer include specific application ULPs such as iSCSI and generic hardware acceleration ULPs such as a remote direct memory access (RDMA) protocol. When an upper layer protocol that permits the final location to be known is used, the data can be directly placed at the final location by a direct placement network interface that has knowledge of the final location.
- The information required to find the final location is contained in the upper layer protocol protocol data unit (ULP PDU) header. A ULP PDU is an upper layer protocol data packet or message. However, the ULP PDU is not always identical to the size of the transport segment used by the transport protocol to send the data over the network. When this occurs, the ULP PDU is split and placed into several transport segments. This results in the ULP PDU header not being located in every transport segment and located at any place in a transport segment. The transport segments that do not contain the ULP PDU header are called non self-describing transport segments because they do not have sufficient information to directly place the data into its final location. The ULP PDU header must be located for direct placement to work.
- One solution to finding the ULP PDU header in the transport segment (i.e., transport data packet) is to put a marker in each transport segment at a predefined period that provides a pointer to ULP PDU header of the next PDU. If the period is high relative to packet loss rate (e.g., once per segment), the location of the next PDU can be found with a very high likelihood when a previous PDU header has been lost. The problem with this solution is that data must still be buffered. The minimum size of the buffer required is:
- k*(the size of the ULP PDU)*(the number of connections)
- where k is a constant. If the size of the ULP PDU is limited to the transport segment size, the minimum buffer size required is:
- (maximum transport segment size)*(the number of connections)
- In cases where many transport segments having ULP PDU headers are lost, the buffer size required for direct placement approaches the intermediate reassembly buffer sizes of multiple gigabytes as indicated above.
- The present invention provides a method to ensure that there is enough information in each transport segment to allow the data being sent in the transport segment to be placed in the client's buffer. A framing header is aligned with the transport segment header so that the framing header is at the beginning of the transport segment. Information is placed in the framing header that describes the transport segment in sufficient detail to allow the data in the transport segment to be placed in its final destination. This effectively eliminates the need for an intermediate reassembly buffer in the performance path (i.e., the primary path in which the data is being received).
- The information includes the length of the transport segment (i.e., the size), an offset and the ULP client buffer id. In an alternate embodiment, the information includes the ULP client buffer id and the ULP client buffer address.
- Additional features and advantages of the invention will be made apparent from the following detailed description of illustrative embodiments which proceeds with reference to the accompanying figures.
- While the appended claims set forth the features of the present invention with particularity, the invention, together with its objects and advantages, may be best understood from the following detailed description taken in conjunction with the accompanying drawings of which:
- FIG. 1 is a block diagram illustrating a network system having a plurality of networks connected by a transport in which the present invention operates;
- FIG. 2 is a block diagram generally illustrating an exemplary computer system on which the present invention resides;
- FIG. 3 is a block diagram illustrating an embodiment of a network protocol stack employing a framing protocol in accordance with the teaching of the present invention;
- FIG. 4 is a block diagram illustrating an alternate embodiment of an operating system employing a framing protocol in accordance with the teaching of the present invention;
- FIG. 5 is a diagram illustrating an example of a framing header aligned with a transport segment header in accordance with the present invention;
- FIGS. 6a and 6 b illustrate a flow chart of a method of transforming a non self-describing protocol data unit into a self-describing protocol data unit in accordance with the present invention; and
- FIG. 7 is a diagram illustrating the format of a framing data unit in accordance with the present invention.
- The present invention ensures that ULP PDUs received out of order do not have to be buffered by an intermediate reassembly buffer in the performance path. To provide this ensurance, each transport segment begins with segment description information and contains an integral number of ULP PDUs. Segment description information is information that is sufficient for direct data placement to occur. Direct data placement occurs when a receiving node directly maps the incoming data (e.g., the data in the ULP PDU) to a specific ULP buffer and a specific offset within that buffer. In this way, the destination location of the ULP PDU is known and the out of order ULP PDU is placed in its destination location. The size of the buffer memory required is reduced to:
- k*(the maximum transport segment size)
- where k is a constant. In systems having direct placement capability, the present invention allows the data in each transport segment to be placed in its final destination independently of all other segments and requires no intermediate reassembly buffers in the performance path.
- Although not required, the invention is described hereinafter in the general context of computer-executable instructions, such as program modules, being executed by a processing device. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that the invention may be practiced with other computer system configurations, including network interface cards, hand-held devices, multi-processor systems, microprocessor based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, and the like. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
- Turning to the drawings, wherein like reference numerals refer to like elements, the invention is illustrated as being implemented in a suitable networking environment such as the
network system environment 20 illustrated in FIG. 1. Thenetwork system environment 20 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. For example, those of skill in the art will appreciate that the invention can also be used in wireless systems and that various of the acts and operations described hereinafter may also be implemented in hardware. - The
exemplary network system 20 includeslocal sub-networks network 26.Network 26 may be a virtual private network, a LAN, a WAN, the Internet, and the like.Local sub-network 22 has general purpose computing devices in the form ofcomputers local sub-network 24 hascomputer 32. Thenetwork system 20 may have additional local sub-networks andlocal sub-networks sub-network transport provider 34, such as TCP/IP, for providing communication between computers and between applications residing on computers. - An example of a suitable
computing system environment 100 on which the invention may be implemented is illustrated in FIG. 2. Thecomputing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should thecomputing environment 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in theexemplary operating environment 100. - The invention is operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to, personal computers, server computers, handheld or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, network cards, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
- The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a processing device. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
- With reference to FIG. 2, an exemplary system for implementing the invention includes a general purpose computing device in the form of a
processing device 110. It should be noted thatcomputers processing device 110 and have similar components. In its most basic configuration,processing device 110 typically includes aprocessing unit 112 andsystem memory 114.Processing unit 112 spans a diverse set of implementations including a central processing unit, a hardware finite state machine based implementation, and a microprocessor assembly language implementation. Depending on the exact configuration and type of computing device,memory 114 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.) or some combination of the two.Memory 114 hasbuffers 116 for receiving, sending, and storing data. Additionally,processing device 110 may also have removablemass storage 118 and/or non-removablemass storage 120 such as magnetic disks, magnetic cassettes, optical disks or tape. Similarly,processing device 110 may also haveinput devices 122 such as a mouse, a keyboard, a modem, and the like and/oroutput devices 124 such as a display, a printer, speakers and the like. Other aspects ofprocessing device 110 may includecommunication device 126 for communicating to other devices, computers, networks, servers, etc. using either wired or wireless media or a combination of the above. Network communication occurs throughcommunication device 126 and may includebuffers 128 on thecommunication device 126,buffers 116 in theprocessing device 110, or a combination ofbuffers 116 and buffers 128. All of these devices are well known in the art and need not be discussed at length here. -
Processing device 110 typically includes at least some form of computer readable media. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory, or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information. Communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of any of the above should also be included within the scope of computer readable media. - FIGS. 3 and 4 illustrate where the framing protocol of the present invention resides on standard network stack (or layer) architectures that have transport layers that use transport protocols. The framing protocol and transport protocol may reside in the
processing device 110 or in thecommunication device 126 or in a combination of theprocessing device 110 andcommunication device 126. FIG. 3 shows an architectural overview of an embodiment of the framing protocol according to the invention implemented in the International Standard Organization's Open System Interconnect (ISO/OSI) model. In this embodiment, the framingprotocol 202 is in communication with upperlayer protocol client 200 and withtransport layer 204. The framingprotocol 202 may be integrated with thetransport layer 204. Thetransport layer 204 resides above thenetwork layer 206 and enforces desired transmission control using a transport protocol. A transport protocol controls the transmission of transport segments. Thenetwork layer 206 ensures that information arrives at its intended destination across a diverse set of data link layers. Thedata link layer 208 resides below thenetwork layer 206 and packages and addresses data and manages the flow of transmissions on a local link. Thephysical layer 210 resides below thedata link layer 208 and deals with all aspects of establishing and maintaining a physical link between communicating computers. - FIG. 4 shows an architectural overview of an embodiment of the framing protocol implemented in the TCP/IP environment. The framing
protocol 202 sits above thestandard TCP protocol 220, which is a transport protocol, and theIP protocol 222. TheIP protocol 222 is in communication with the network interface card (NIC) 226 viaNDIS 224. While the framingprotocol 202 has been illustrated as a separate layer in FIGS. 3 and 4, the framingprotocol 202 may be integrated with other layers. - In the description that follows, the invention will be described with reference to acts and symbolic representations of operations that are performed by one or more computers, unless indicated otherwise. As such, it will be understood that such acts and operations, which are at times referred to as being computer-executed, include the manipulation by the processing unit of the computer of electrical signals representing data in a structured form. This manipulation transforms the data or maintains it at locations in the memory system of the computer, which reconfigures or otherwise alters the operation of the computer in a manner well understood by those skilled in the art. The data structures where data is maintained are physical locations of the memory that have particular properties defined by the format of the data. However, while the invention is being described in the foregoing context, it is not meant to be limiting as those of skill in the art will appreciate that various of the acts and operation described hereinafter may also be implemented in hardware.
- Now that the architecture in which the invention operates and resides has been described, the steps taken to ensure that each transport segment begins with an ULP PDU (i.e., the ULP PDU is aligned with the transport segment) and contains an integral number of ULP PDUs can be described as illustrated in FIG. 5. Turning now to FIG. 5, each
transport segment 300 has atransport header 302. The invention places a framingheader 304 having segment description information within or after thetransport header 302. The segment description information describes thedata 306 with sufficient detail so that data in transport segments received out of order can be placed in its destination location. Transport segments that have the segment description information are called self-describing segments. - Turning now to the flow diagram of FIGS. 6a and 6 b, the framing protocol receives and processes the ULP PDU (step 400) from an upper layer sender (e.g., an application, a device, a ULP, etc.) to hand off to the transport layer to send to an upper layer receiver. The framing protocol uses
buffers 116,buffers 128, or a combination ofbuffers - If the ULP PDU size submitted by the ULP is outside the limit, the framing protocol fails the submission and generates an error message (step404). In an alternate embodiment, the framing protocol performs a chunking operation on the ULP PDU when the ULP PDU size is larger than the limit. The chunking operation splits the ULP PDU into packets that fit within each transport segment and splits the ULP PDU into multiple transport segments. The offset within the buffer from the base of the buffer and/or the buffer address is incremented in the transport segments so that direct data placement can occur.
- The length (i.e., size) of the ULP PDUs packed in the transport segment is determined by the framing protocol (step406). If the ULP PDU size is within the limit, the framing protocol determines if multiple ULP PDUs fit within a transport segment (step 408). If multiple ULP PDUs will fit within the transport segment, the framing protocol determines if a single PDU option was chosen (step 410). The single PDU option is selected by the receiver (e.g., receiving application, protocol, etc.) or the transmitter (e.g., sending application, protocol, etc.). When this option is selected, only one ULP PDU may be packed into a transport segment.
- If multiple ULP PDUs do not fit within a transport segment or the single PDU option was chosen, the framing protocol puts one ULP PDU into a transport segment (step412). If multiple ULP PDUs fit within a transport segment and the single PDU option was not chosen, an integral number of ULP PDUs are put into a transport segment (step 414).
- Information that self-describes the transport segment is placed into the transport header or right after the transport header in a framing header (step416) and the transport segment is sent to the receiver (step 418). This information, which is called segment description information, includes the length and an identifier that identifies the connection. This information provides a receiver with sufficient information to determine where the ULP PDU should be placed. This allows successive ULP PDUs to be recovered in the event of transport segment delay, loss, or reordering. In the event direct placement networks are being used, further information is put in the transport segment to allow the transport payload (i.e., the ULP PDU(s)) to be put in its final destination. The additional information includes the buffer id where the data is to be placed and the offset (i.e., the offset within the buffer from the base of the buffer).
- Turning now to FIG. 7, the format of a self-describing
transport segment 500 is illustrated. Thelength field 502 andidentifier field 504 are part of the framingheader 304. Following the framing header is at least one integral ULP PDU in thepayload 306. The direct placement information (buffer id and offset) is also placed in the framingheader 304. - There are exceptions to sending an integral ULP PDU in a transport segment. These exceptions include situations when the connection is in emergency mode, when the transport maximum segment size has been reduced, and when the sender is probing to determine if the maximum transport segment size unit can be increased. A connection is in emergency mode when the transport segment size being used shrinks to a size which leaves no room for a complete ULP PDU to be sent. When an emergency mode occurs, the framing protocol may fragment an ULP PDU across multiple transport segments. The transport segments having a fragment of an ULP PDU should not appear to be a complete ULP PDU to the receiving application/device. There are many ways to ensure this occurs. For example, in one embodiment, this is ensured by the sender making sure that either the data in the length field does not equal the transfer segment length, or that the transfer segment length is less than the framing header in each transport segment.
- As previously indicated, the present invention allows the data in each transport segment to be placed in its final destination independently of all other segments and requires no intermediate reassembly buffers in the performance path. A reassembly buffer is needed if synchronization of the framing header with the transport header is lost or if there is a program module or hardware device (i.e., a middle box) re-segmenting the data stream in the network. The former example (i.e., loss of synchronization) is a transient condition that only occurs when a path transport segment size being used has been reduced and there is no middle-box in the network which is re-segmenting the data stream. If the path transport segment size being used is reduced, any transport segments already converted to self-describing segments and posted to the transmitter will be re-segmented and will result in non self-describing segments being sent to the destination. If the destination does not use a reassembly buffer, these non self-describing segments can never be successfully transmitted. The reassembly buffer must be large enough to recover a transport segment that is less than or equal to the maximum transport segment size of the locally attached link.
- The invention has been described with some references to the TCP protocol. The invention may also be used with other protocols, such as SCTP, that use transport segments that do not describe in sufficient detail where the payload is to be placed.
- In view of the many possible embodiments to which the principles of this invention may be applied, it should be recognized that the embodiment described herein with respect to the drawing figures is meant to be illustrative only and should not be taken as limiting the scope of invention. For example, those of skill in the art will recognize that the elements of the illustrated embodiment shown in software may be implemented in hardware and vice versa or that the illustrated embodiment can be modified in arrangement and detail without departing from the spirit of the invention. Therefore, the invention as described herein contemplates all such embodiments as may come within the scope of the following claims and equivalents thereof.
Claims (27)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/016,609 US7124198B2 (en) | 2001-10-30 | 2001-10-30 | Apparatus and method for scaling TCP off load buffer requirements by segment size |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/016,609 US7124198B2 (en) | 2001-10-30 | 2001-10-30 | Apparatus and method for scaling TCP off load buffer requirements by segment size |
Publications (2)
Publication Number | Publication Date |
---|---|
US20030084185A1 true US20030084185A1 (en) | 2003-05-01 |
US7124198B2 US7124198B2 (en) | 2006-10-17 |
Family
ID=21778020
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/016,609 Expired - Fee Related US7124198B2 (en) | 2001-10-30 | 2001-10-30 | Apparatus and method for scaling TCP off load buffer requirements by segment size |
Country Status (1)
Country | Link |
---|---|
US (1) | US7124198B2 (en) |
Cited By (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030172342A1 (en) * | 2002-03-08 | 2003-09-11 | Uri Elzur | System and method for identifying upper layer protocol message boundaries |
US20040081202A1 (en) * | 2002-01-25 | 2004-04-29 | Minami John S | Communications processor |
US20040093411A1 (en) * | 2002-08-30 | 2004-05-13 | Uri Elzur | System and method for network interfacing |
US20040153578A1 (en) * | 2002-03-08 | 2004-08-05 | Uri Elzur | System and method for handling transport protocol segments |
US20040184459A1 (en) * | 2003-03-20 | 2004-09-23 | Uri Elzur | Self-describing transport protocol segments |
US20040225720A1 (en) * | 2003-05-09 | 2004-11-11 | Pinkerton James T. | Remote invalidation of pre-shared RDMA key |
US20050138180A1 (en) * | 2003-12-19 | 2005-06-23 | Iredy Corporation | Connection management system and method for a transport offload engine |
US20050149632A1 (en) * | 2003-12-19 | 2005-07-07 | Iready Corporation | Retransmission system and method for a transport offload engine |
US20050188123A1 (en) * | 2004-02-20 | 2005-08-25 | Iready Corporation | System and method for insertion of markers into a data stream |
US20050193316A1 (en) * | 2004-02-20 | 2005-09-01 | Iready Corporation | System and method for generating 128-bit cyclic redundancy check values with 32-bit granularity |
US20060083246A1 (en) * | 2004-10-19 | 2006-04-20 | Nvidia Corporation | System and method for processing RX packets in high speed network applications using an RX FIFO buffer |
US7039717B2 (en) | 2000-11-10 | 2006-05-02 | Nvidia Corporation | Internet modem streaming socket method |
US20060095754A1 (en) * | 1998-06-12 | 2006-05-04 | Microsoft Corporation | Method and computer program product for offloading processing tasks from software to hardware |
US20060146814A1 (en) * | 2004-12-31 | 2006-07-06 | Shah Hemal V | Remote direct memory access segment generation by a network controller |
US7260631B1 (en) | 2003-12-19 | 2007-08-21 | Nvidia Corporation | System and method for receiving iSCSI protocol data units |
US20080304410A1 (en) * | 2006-02-07 | 2008-12-11 | Sung Jun Park | Method for Avoiding Collision Using Identifier in Mobile Network |
US20090005095A1 (en) * | 2006-06-21 | 2009-01-01 | Sung Duck Chun | Method for Reconfiguring Radio Link in Wireless Communication System |
US20090011718A1 (en) * | 2006-01-05 | 2009-01-08 | Sung-Duck Chun | Maintaining Communication Between Mobile Terminal and Network in Mobile Communication System |
US20090010219A1 (en) * | 2006-02-07 | 2009-01-08 | Lee Young-Dae | Method of Selection and Signaling of Downlink and Uplink Bandwidth in Wireless Networks |
US20090016254A1 (en) * | 2006-01-05 | 2009-01-15 | Lee Young-Dae | Point-to-Multipoint Service Communication |
US20090036061A1 (en) * | 2006-02-07 | 2009-02-05 | Sung-Duck Chun | Method for operating enhanced rlc entity and rnc entity for wcdma and system thereof |
US20090047912A1 (en) * | 2006-01-05 | 2009-02-19 | Young Dae Lee | Method of transmitting feedback information in a wireless communication system |
US7535913B2 (en) | 2002-03-06 | 2009-05-19 | Nvidia Corporation | Gigabit ethernet adapter supporting the iSCSI and IPSEC protocols |
US20090150739A1 (en) * | 2006-06-21 | 2009-06-11 | Sung Jun Park | Method of supporting data retransmission in a mobile communication system |
US20090185477A1 (en) * | 2006-01-05 | 2009-07-23 | Lg Electronics Inc. | Transmitting Data In A Mobile Communication System |
US20090219868A1 (en) * | 2006-01-05 | 2009-09-03 | Young Dae Lee | Method for scheduling radio resources in mobile communication system |
US7624198B1 (en) | 2003-12-19 | 2009-11-24 | Nvidia Corporation | Sequence tagging system and method for transport offload engine data lists |
US7698413B1 (en) | 2004-04-12 | 2010-04-13 | Nvidia Corporation | Method and apparatus for accessing and maintaining socket control information for high speed network connections |
US20100195579A1 (en) * | 2006-06-21 | 2010-08-05 | Sung-Jun Park | Method of transmitting and receiving radio access information using a message separation in a wireless mobile communications system |
US20100227614A1 (en) * | 2006-03-22 | 2010-09-09 | Sung Duck Chun | Method of supporting handover in a wirwless communication system |
US20100226263A1 (en) * | 2006-06-21 | 2010-09-09 | Sung-Duck Chun | Method for supporting quality of multimedia broadcast multicast service (mbms) in mobile communications system and terminal thereof |
US20100232335A1 (en) * | 2006-06-21 | 2010-09-16 | Lee Young-Dae | Uplink access method of mobile communication system |
US20100290400A1 (en) * | 2006-01-05 | 2010-11-18 | Young Dae Lee | Transmitting data in a mobile communication system |
US7849208B2 (en) | 2002-08-30 | 2010-12-07 | Broadcom Corporation | System and method for TCP offload |
US20110032891A1 (en) * | 2006-02-07 | 2011-02-10 | Young Dae Lee | Method for transmitting response information in mobile communications system |
US7912064B2 (en) | 2002-08-30 | 2011-03-22 | Broadcom Corporation | System and method for handling out-of-order frames |
US7934021B2 (en) | 2002-08-29 | 2011-04-26 | Broadcom Corporation | System and method for network interfacing |
US8065439B1 (en) | 2003-12-19 | 2011-11-22 | Nvidia Corporation | System and method for using metadata in the context of a transport offload engine |
US8116203B2 (en) | 2001-07-23 | 2012-02-14 | Broadcom Corporation | Multiple virtual channels for use in network devices |
US8135842B1 (en) | 1999-08-16 | 2012-03-13 | Nvidia Corporation | Internet jack |
US8176545B1 (en) | 2003-12-19 | 2012-05-08 | Nvidia Corporation | Integrated policy checking system and method |
US8180928B2 (en) | 2002-08-30 | 2012-05-15 | Broadcom Corporation | Method and system for supporting read operations with CRC for iSCSI and iSCSI chimney |
US8244269B2 (en) | 2006-01-05 | 2012-08-14 | Lg Electronics Inc. | Allocating radio resources in mobile communications system |
US8369865B2 (en) | 2006-01-05 | 2013-02-05 | Lg Electronics Inc. | Data transmission method and data re-transmission method |
US8402142B2 (en) | 2002-08-30 | 2013-03-19 | Broadcom Corporation | System and method for TCP/IP offload independent of bandwidth delay product |
US8750320B2 (en) | 1997-01-23 | 2014-06-10 | Broadcom Corporation | Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost |
US8798091B2 (en) | 1998-11-19 | 2014-08-05 | Broadcom Corporation | Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost |
US9444769B1 (en) * | 2015-03-31 | 2016-09-13 | Chelsio Communications, Inc. | Method for out of order placement in PDU-oriented protocols |
US10356658B2 (en) * | 2017-07-10 | 2019-07-16 | Google Llc | Packet segmentation and reassembly for mesh networks |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7631107B2 (en) * | 2002-06-11 | 2009-12-08 | Pandya Ashish A | Runtime adaptable protocol processor |
US7415723B2 (en) * | 2002-06-11 | 2008-08-19 | Pandya Ashish A | Distributed network security system and a hardware processor therefor |
US7944920B2 (en) * | 2002-06-11 | 2011-05-17 | Pandya Ashish A | Data processing system using internet protocols and RDMA |
US7953876B1 (en) * | 2002-10-24 | 2011-05-31 | Emulex Design & Manufacturing Corporation | Virtual interface over a transport protocol |
US7782784B2 (en) * | 2003-01-10 | 2010-08-24 | Cisco Technology, Inc. | Port analyzer adapter |
US7899048B1 (en) | 2003-01-15 | 2011-03-01 | Cisco Technology, Inc. | Method and apparatus for remotely monitoring network traffic through a generic network |
US7685254B2 (en) * | 2003-06-10 | 2010-03-23 | Pandya Ashish A | Runtime adaptable search processor |
US8165136B1 (en) | 2003-09-03 | 2012-04-24 | Cisco Technology, Inc. | Virtual port based SPAN |
US7474666B2 (en) | 2003-09-03 | 2009-01-06 | Cisco Technology, Inc. | Switch port analyzers |
GB0409331D0 (en) * | 2004-04-27 | 2004-06-02 | Ibm | Recovery from MSS change |
US8364849B2 (en) | 2004-08-30 | 2013-01-29 | International Business Machines Corporation | Snapshot interface operations |
US20060075057A1 (en) * | 2004-08-30 | 2006-04-06 | International Business Machines Corporation | Remote direct memory access system and method |
US20060221953A1 (en) * | 2005-04-01 | 2006-10-05 | Claude Basso | Method and apparatus for blind checksum and correction for network transmissions |
US7586936B2 (en) | 2005-04-01 | 2009-09-08 | International Business Machines Corporation | Host Ethernet adapter for networking offload in server environment |
US7577151B2 (en) * | 2005-04-01 | 2009-08-18 | International Business Machines Corporation | Method and apparatus for providing a network connection table |
US7508771B2 (en) | 2005-04-01 | 2009-03-24 | International Business Machines Corporation | Method for reducing latency in a host ethernet adapter (HEA) |
US7881332B2 (en) * | 2005-04-01 | 2011-02-01 | International Business Machines Corporation | Configurable ports for a host ethernet adapter |
US7697536B2 (en) * | 2005-04-01 | 2010-04-13 | International Business Machines Corporation | Network communications for operating system partitions |
US7606166B2 (en) | 2005-04-01 | 2009-10-20 | International Business Machines Corporation | System and method for computing a blind checksum in a host ethernet adapter (HEA) |
US7903687B2 (en) * | 2005-04-01 | 2011-03-08 | International Business Machines Corporation | Method for scheduling, writing, and reading data inside the partitioned buffer of a switch, router or packet processing device |
US7706409B2 (en) | 2005-04-01 | 2010-04-27 | International Business Machines Corporation | System and method for parsing, filtering, and computing the checksum in a host Ethernet adapter (HEA) |
US7492771B2 (en) | 2005-04-01 | 2009-02-17 | International Business Machines Corporation | Method for performing a packet header lookup |
US9141557B2 (en) | 2006-12-08 | 2015-09-22 | Ashish A. Pandya | Dynamic random access memory (DRAM) that comprises a programmable intelligent search memory (PRISM) and a cryptography processing engine |
US7996348B2 (en) | 2006-12-08 | 2011-08-09 | Pandya Ashish A | 100GBPS security and search architecture using programmable intelligent search memory (PRISM) that comprises one or more bit interval counters |
ATE472476T1 (en) * | 2007-05-11 | 2010-07-15 | Sca Hygiene Prod Ab | PACKAGING AND SUPPLY DEVICE FOR GROUPING PRODUCT OBJECTS |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5583859A (en) * | 1994-08-30 | 1996-12-10 | Bell Communications Research, Inc. | Data labeling technique for high performance protocol processing |
US6094712A (en) * | 1996-12-04 | 2000-07-25 | Giganet, Inc. | Computer network interface for direct mapping of data transferred between applications on different host computers from virtual addresses to physical memory addresses application data |
US6141705A (en) * | 1998-06-12 | 2000-10-31 | Microsoft Corporation | System for querying a peripheral device to determine its processing capabilities and then offloading specific processing tasks from a host to the peripheral device when needed |
US6226680B1 (en) * | 1997-10-14 | 2001-05-01 | Alacritech, Inc. | Intelligent network interface system method for protocol processing |
US20010021949A1 (en) * | 1997-10-14 | 2001-09-13 | Alacritech, Inc. | Network interface device employing a DMA command queue |
US20010047433A1 (en) * | 1997-10-14 | 2001-11-29 | Alacritech, Inc. | Obtaining a destination address so that a network interface device can write network data without headers directly into host memory |
US20020049875A1 (en) * | 2000-10-23 | 2002-04-25 | Biran Giora | Data communications interfaces |
US6381647B1 (en) * | 1998-09-28 | 2002-04-30 | Raytheon Company | Method and system for scheduling network communication |
US6434620B1 (en) * | 1998-08-27 | 2002-08-13 | Alacritech, Inc. | TCP/IP offload network interface device |
US6675200B1 (en) * | 2000-05-10 | 2004-01-06 | Cisco Technology, Inc. | Protocol-independent support of remote DMA |
US6804776B1 (en) * | 1999-09-21 | 2004-10-12 | Cisco Technology, Inc. | Method for universal transport encapsulation for Internet Protocol network communications |
US6819679B1 (en) * | 2000-03-31 | 2004-11-16 | Cisco Technology, Inc. | Multiprotocol packet framing technique |
-
2001
- 2001-10-30 US US10/016,609 patent/US7124198B2/en not_active Expired - Fee Related
Patent Citations (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5583859A (en) * | 1994-08-30 | 1996-12-10 | Bell Communications Research, Inc. | Data labeling technique for high performance protocol processing |
US6094712A (en) * | 1996-12-04 | 2000-07-25 | Giganet, Inc. | Computer network interface for direct mapping of data transferred between applications on different host computers from virtual addresses to physical memory addresses application data |
US20010047433A1 (en) * | 1997-10-14 | 2001-11-29 | Alacritech, Inc. | Obtaining a destination address so that a network interface device can write network data without headers directly into host memory |
US6334153B2 (en) * | 1997-10-14 | 2001-12-25 | Alacritech, Inc. | Passing a communication control block from host to a local device such that a message is processed on the device |
US6247060B1 (en) * | 1997-10-14 | 2001-06-12 | Alacritech, Inc. | Passing a communication control block from host to a local device such that a message is processed on the device |
US20010021949A1 (en) * | 1997-10-14 | 2001-09-13 | Alacritech, Inc. | Network interface device employing a DMA command queue |
US20010023460A1 (en) * | 1997-10-14 | 2001-09-20 | Alacritech Inc. | Passing a communication control block from host to a local device such that a message is processed on the device |
US20010027496A1 (en) * | 1997-10-14 | 2001-10-04 | Alacritech, Inc. | Passing a communication control block to a local device such that a message is processed on the device |
US6226680B1 (en) * | 1997-10-14 | 2001-05-01 | Alacritech, Inc. | Intelligent network interface system method for protocol processing |
US6141705A (en) * | 1998-06-12 | 2000-10-31 | Microsoft Corporation | System for querying a peripheral device to determine its processing capabilities and then offloading specific processing tasks from a host to the peripheral device when needed |
US6434620B1 (en) * | 1998-08-27 | 2002-08-13 | Alacritech, Inc. | TCP/IP offload network interface device |
US6381647B1 (en) * | 1998-09-28 | 2002-04-30 | Raytheon Company | Method and system for scheduling network communication |
US6804776B1 (en) * | 1999-09-21 | 2004-10-12 | Cisco Technology, Inc. | Method for universal transport encapsulation for Internet Protocol network communications |
US6819679B1 (en) * | 2000-03-31 | 2004-11-16 | Cisco Technology, Inc. | Multiprotocol packet framing technique |
US6675200B1 (en) * | 2000-05-10 | 2004-01-06 | Cisco Technology, Inc. | Protocol-independent support of remote DMA |
US20020049875A1 (en) * | 2000-10-23 | 2002-04-25 | Biran Giora | Data communications interfaces |
Cited By (113)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8774199B2 (en) | 1997-01-23 | 2014-07-08 | Broadcom Corporation | Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost |
US8750320B2 (en) | 1997-01-23 | 2014-06-10 | Broadcom Corporation | Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost |
US8767756B2 (en) | 1997-01-23 | 2014-07-01 | Broadcom Corporation | Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost |
US20060095754A1 (en) * | 1998-06-12 | 2006-05-04 | Microsoft Corporation | Method and computer program product for offloading processing tasks from software to hardware |
US7284119B2 (en) | 1998-06-12 | 2007-10-16 | Microsoft Corporation | Method and computer program product for offloading processing tasks from software to hardware |
US8798091B2 (en) | 1998-11-19 | 2014-08-05 | Broadcom Corporation | Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost |
US8135842B1 (en) | 1999-08-16 | 2012-03-13 | Nvidia Corporation | Internet jack |
US7039717B2 (en) | 2000-11-10 | 2006-05-02 | Nvidia Corporation | Internet modem streaming socket method |
US8116203B2 (en) | 2001-07-23 | 2012-02-14 | Broadcom Corporation | Multiple virtual channels for use in network devices |
US9036643B2 (en) | 2001-07-23 | 2015-05-19 | Broadcom Corporation | Multiple logical channels for use in network devices |
US8493857B2 (en) | 2001-07-23 | 2013-07-23 | Broadcom Corporation | Multiple logical channels for use in network devices |
US20040081202A1 (en) * | 2002-01-25 | 2004-04-29 | Minami John S | Communications processor |
US7379475B2 (en) | 2002-01-25 | 2008-05-27 | Nvidia Corporation | Communications processor |
US7535913B2 (en) | 2002-03-06 | 2009-05-19 | Nvidia Corporation | Gigabit ethernet adapter supporting the iSCSI and IPSEC protocols |
US8451863B2 (en) * | 2002-03-08 | 2013-05-28 | Broadcom Corporation | System and method for identifying upper layer protocol message boundaries |
US8345689B2 (en) | 2002-03-08 | 2013-01-01 | Broadcom Corporation | System and method for identifying upper layer protocol message boundaries |
US8244890B2 (en) | 2002-03-08 | 2012-08-14 | Broadcom Corporation | System and method for handling transport protocol segments |
US8958440B2 (en) * | 2002-03-08 | 2015-02-17 | Broadcom Corporation | System and method for identifying upper layer protocol message boundaries |
US7295555B2 (en) * | 2002-03-08 | 2007-11-13 | Broadcom Corporation | System and method for identifying upper layer protocol message boundaries |
US20080025315A1 (en) * | 2002-03-08 | 2008-01-31 | Broadcom Corporation | System and method for identifying upper layer protocol message boundaries |
US20030172342A1 (en) * | 2002-03-08 | 2003-09-11 | Uri Elzur | System and method for identifying upper layer protocol message boundaries |
US20130262607A1 (en) * | 2002-03-08 | 2013-10-03 | Broadcom Corporation | System and method for identifying upper layer protocol message boundaries |
US8135016B2 (en) | 2002-03-08 | 2012-03-13 | Broadcom Corporation | System and method for identifying upper layer protocol message boundaries |
US20040153578A1 (en) * | 2002-03-08 | 2004-08-05 | Uri Elzur | System and method for handling transport protocol segments |
US20100220729A1 (en) * | 2002-03-08 | 2010-09-02 | Uri Elzur | System and method for identifying upper layer protocol message boundaries |
US20100174831A9 (en) * | 2002-03-08 | 2010-07-08 | Uri Elzur | System and method for handling transport protocol segments |
US7934021B2 (en) | 2002-08-29 | 2011-04-26 | Broadcom Corporation | System and method for network interfacing |
US8549152B2 (en) | 2002-08-30 | 2013-10-01 | Broadcom Corporation | System and method for TCP/IP offload independent of bandwidth delay product |
US20040093411A1 (en) * | 2002-08-30 | 2004-05-13 | Uri Elzur | System and method for network interfacing |
US7929540B2 (en) | 2002-08-30 | 2011-04-19 | Broadcom Corporation | System and method for handling out-of-order frames |
US7849208B2 (en) | 2002-08-30 | 2010-12-07 | Broadcom Corporation | System and method for TCP offload |
US8677010B2 (en) | 2002-08-30 | 2014-03-18 | Broadcom Corporation | System and method for TCP offload |
US8010707B2 (en) * | 2002-08-30 | 2011-08-30 | Broadcom Corporation | System and method for network interfacing |
US8402142B2 (en) | 2002-08-30 | 2013-03-19 | Broadcom Corporation | System and method for TCP/IP offload independent of bandwidth delay product |
US7912064B2 (en) | 2002-08-30 | 2011-03-22 | Broadcom Corporation | System and method for handling out-of-order frames |
US8180928B2 (en) | 2002-08-30 | 2012-05-15 | Broadcom Corporation | Method and system for supporting read operations with CRC for iSCSI and iSCSI chimney |
US20040184459A1 (en) * | 2003-03-20 | 2004-09-23 | Uri Elzur | Self-describing transport protocol segments |
US7385974B2 (en) * | 2003-03-20 | 2008-06-10 | Broadcom Corporation | Self-describing transport protocol segments |
US7370082B2 (en) | 2003-05-09 | 2008-05-06 | Microsoft Corporation | Remote invalidation of pre-shared RDMA key |
US20040225720A1 (en) * | 2003-05-09 | 2004-11-11 | Pinkerton James T. | Remote invalidation of pre-shared RDMA key |
US7260631B1 (en) | 2003-12-19 | 2007-08-21 | Nvidia Corporation | System and method for receiving iSCSI protocol data units |
US8176545B1 (en) | 2003-12-19 | 2012-05-08 | Nvidia Corporation | Integrated policy checking system and method |
US8549170B2 (en) | 2003-12-19 | 2013-10-01 | Nvidia Corporation | Retransmission system and method for a transport offload engine |
US8065439B1 (en) | 2003-12-19 | 2011-11-22 | Nvidia Corporation | System and method for using metadata in the context of a transport offload engine |
US7624198B1 (en) | 2003-12-19 | 2009-11-24 | Nvidia Corporation | Sequence tagging system and method for transport offload engine data lists |
US20050149632A1 (en) * | 2003-12-19 | 2005-07-07 | Iready Corporation | Retransmission system and method for a transport offload engine |
US20050138180A1 (en) * | 2003-12-19 | 2005-06-23 | Iredy Corporation | Connection management system and method for a transport offload engine |
US7899913B2 (en) | 2003-12-19 | 2011-03-01 | Nvidia Corporation | Connection management system and method for a transport offload engine |
US20050188123A1 (en) * | 2004-02-20 | 2005-08-25 | Iready Corporation | System and method for insertion of markers into a data stream |
US7249306B2 (en) | 2004-02-20 | 2007-07-24 | Nvidia Corporation | System and method for generating 128-bit cyclic redundancy check values with 32-bit granularity |
US20050193316A1 (en) * | 2004-02-20 | 2005-09-01 | Iready Corporation | System and method for generating 128-bit cyclic redundancy check values with 32-bit granularity |
US7206872B2 (en) | 2004-02-20 | 2007-04-17 | Nvidia Corporation | System and method for insertion of markers into a data stream |
US7698413B1 (en) | 2004-04-12 | 2010-04-13 | Nvidia Corporation | Method and apparatus for accessing and maintaining socket control information for high speed network connections |
US7957379B2 (en) | 2004-10-19 | 2011-06-07 | Nvidia Corporation | System and method for processing RX packets in high speed network applications using an RX FIFO buffer |
US20060083246A1 (en) * | 2004-10-19 | 2006-04-20 | Nvidia Corporation | System and method for processing RX packets in high speed network applications using an RX FIFO buffer |
US7580406B2 (en) * | 2004-12-31 | 2009-08-25 | Intel Corporation | Remote direct memory access segment generation by a network controller |
US20060146814A1 (en) * | 2004-12-31 | 2006-07-06 | Shah Hemal V | Remote direct memory access segment generation by a network controller |
US9036596B2 (en) | 2006-01-05 | 2015-05-19 | Lg Electronics Inc. | Transmitting data in a mobile communication system |
EP1980062A4 (en) * | 2006-01-05 | 2011-03-30 | Lg Electronics Inc | Transmitting data in a mobile communication system |
US9955507B2 (en) | 2006-01-05 | 2018-04-24 | Lg Electronics Inc. | Maintaining communication between mobile terminal and network in mobile communication system |
US9456455B2 (en) | 2006-01-05 | 2016-09-27 | Lg Electronics Inc. | Method of transmitting feedback information in a wireless communication system |
US9397791B2 (en) | 2006-01-05 | 2016-07-19 | Lg Electronics Inc. | Transmitting data in a mobile communication system |
CN105515736A (en) * | 2006-01-05 | 2016-04-20 | Lg电子株式会社 | Transmitting data in mobile communication system |
US9253801B2 (en) | 2006-01-05 | 2016-02-02 | Lg Electronics Inc. | Maintaining communication between mobile terminal and network in mobile communication system |
US8244269B2 (en) | 2006-01-05 | 2012-08-14 | Lg Electronics Inc. | Allocating radio resources in mobile communications system |
US20090047912A1 (en) * | 2006-01-05 | 2009-02-19 | Young Dae Lee | Method of transmitting feedback information in a wireless communication system |
US20090011718A1 (en) * | 2006-01-05 | 2009-01-08 | Sung-Duck Chun | Maintaining Communication Between Mobile Terminal and Network in Mobile Communication System |
US20090016254A1 (en) * | 2006-01-05 | 2009-01-15 | Lee Young-Dae | Point-to-Multipoint Service Communication |
US8340026B2 (en) * | 2006-01-05 | 2012-12-25 | Lg Electronics Inc. | Transmitting data in a mobile communication system |
US8867449B2 (en) | 2006-01-05 | 2014-10-21 | Lg Electronics Inc. | Transmitting data in a mobile communication system |
USRE43949E1 (en) | 2006-01-05 | 2013-01-29 | Lg Electronics Inc. | Allocating radio resources in mobile communications system |
US8369865B2 (en) | 2006-01-05 | 2013-02-05 | Lg Electronics Inc. | Data transmission method and data re-transmission method |
US8396020B2 (en) | 2006-01-05 | 2013-03-12 | Lg Electronics Inc. | Point-to-multipoint service communication |
US20090185477A1 (en) * | 2006-01-05 | 2009-07-23 | Lg Electronics Inc. | Transmitting Data In A Mobile Communication System |
US8750217B2 (en) | 2006-01-05 | 2014-06-10 | Lg Electronics Inc. | Method for scheduling radio resources in mobile communication system |
US20090219868A1 (en) * | 2006-01-05 | 2009-09-03 | Young Dae Lee | Method for scheduling radio resources in mobile communication system |
US8428086B2 (en) * | 2006-01-05 | 2013-04-23 | Lg Electronics Inc. | Transmitting data in a mobile communication system |
US8644250B2 (en) | 2006-01-05 | 2014-02-04 | Lg Electronics Inc. | Maintaining communication between mobile terminal and network in mobile communication system |
TWI425794B (en) * | 2006-01-05 | 2014-02-01 | Lg Electronics Inc | Method of transmitting data in a mobile communication system |
US20100290400A1 (en) * | 2006-01-05 | 2010-11-18 | Young Dae Lee | Transmitting data in a mobile communication system |
CN101682557A (en) * | 2006-01-05 | 2010-03-24 | Lg电子株式会社 | Transmitting data in a mobile communication system |
US8223713B2 (en) | 2006-02-07 | 2012-07-17 | Lg Electronics Inc. | Method for transmitting response information in mobile communications system |
US20090036061A1 (en) * | 2006-02-07 | 2009-02-05 | Sung-Duck Chun | Method for operating enhanced rlc entity and rnc entity for wcdma and system thereof |
US8451821B2 (en) | 2006-02-07 | 2013-05-28 | Lg Electronics Inc. | Method for transmitting response information in mobile communications system |
US10045381B2 (en) | 2006-02-07 | 2018-08-07 | Lg Electronics Inc. | Method for transmitting response information in mobile communications system |
US9706580B2 (en) | 2006-02-07 | 2017-07-11 | Lg Electronics Inc. | Method for transmitting response information in mobile communications system |
US9462576B2 (en) | 2006-02-07 | 2016-10-04 | Lg Electronics Inc. | Method for transmitting response information in mobile communications system |
US8493854B2 (en) | 2006-02-07 | 2013-07-23 | Lg Electronics Inc. | Method for avoiding collision using identifier in mobile network |
US20080304410A1 (en) * | 2006-02-07 | 2008-12-11 | Sung Jun Park | Method for Avoiding Collision Using Identifier in Mobile Network |
US20090010219A1 (en) * | 2006-02-07 | 2009-01-08 | Lee Young-Dae | Method of Selection and Signaling of Downlink and Uplink Bandwidth in Wireless Networks |
US8437335B2 (en) | 2006-02-07 | 2013-05-07 | Lg Electronics Inc. | Method for transmitting response information in mobile communications system |
US8406190B2 (en) | 2006-02-07 | 2013-03-26 | Lg Electronics Inc. | Method for transmitting response information in mobile communications system |
US20110032891A1 (en) * | 2006-02-07 | 2011-02-10 | Young Dae Lee | Method for transmitting response information in mobile communications system |
US8238371B2 (en) | 2006-02-07 | 2012-08-07 | Lg Electronics Inc. | Method for operating enhanced RLC entity and RNC entity for WCDMA and system thereof |
US8243665B2 (en) | 2006-02-07 | 2012-08-14 | Lg Electronics Inc. | Method for selection and signaling of downlink and uplink bandwidth in wireless networks |
US20100227614A1 (en) * | 2006-03-22 | 2010-09-09 | Sung Duck Chun | Method of supporting handover in a wirwless communication system |
US8971288B2 (en) | 2006-03-22 | 2015-03-03 | Lg Electronics Inc. | Method of supporting handover in a wireless communication system |
US8429478B2 (en) | 2006-06-21 | 2013-04-23 | Lg Electronics Inc. | Method of supporting data retransmission in a mobile communication system |
US8570956B2 (en) | 2006-06-21 | 2013-10-29 | Lg Electronics Inc. | Method of communicating data in a wireless mobile communications system using message separation and mobile terminal for use with the same |
US20090150739A1 (en) * | 2006-06-21 | 2009-06-11 | Sung Jun Park | Method of supporting data retransmission in a mobile communication system |
US9220093B2 (en) | 2006-06-21 | 2015-12-22 | Lg Electronics Inc. | Method of supporting data retransmission in a mobile communication system |
US20100226263A1 (en) * | 2006-06-21 | 2010-09-09 | Sung-Duck Chun | Method for supporting quality of multimedia broadcast multicast service (mbms) in mobile communications system and terminal thereof |
US8234534B2 (en) | 2006-06-21 | 2012-07-31 | Lg Electronics Inc. | Method of supporting data retransmission in a mobile communication system |
US20100232335A1 (en) * | 2006-06-21 | 2010-09-16 | Lee Young-Dae | Uplink access method of mobile communication system |
US20090005095A1 (en) * | 2006-06-21 | 2009-01-01 | Sung Duck Chun | Method for Reconfiguring Radio Link in Wireless Communication System |
US8189537B2 (en) | 2006-06-21 | 2012-05-29 | Lg Electronics Inc. | Method for reconfiguring radio link in wireless communication system |
US8638707B2 (en) | 2006-06-21 | 2014-01-28 | Lg Electronics Inc. | Method for supporting quality of multimedia broadcast multicast service (MBMS) in mobile communications system and terminal thereof |
US8248924B2 (en) | 2006-06-21 | 2012-08-21 | Lg Electronics Inc. | Uplink access method of mobile communication system |
US20100195579A1 (en) * | 2006-06-21 | 2010-08-05 | Sung-Jun Park | Method of transmitting and receiving radio access information using a message separation in a wireless mobile communications system |
US9444769B1 (en) * | 2015-03-31 | 2016-09-13 | Chelsio Communications, Inc. | Method for out of order placement in PDU-oriented protocols |
US10356658B2 (en) * | 2017-07-10 | 2019-07-16 | Google Llc | Packet segmentation and reassembly for mesh networks |
US20190281496A1 (en) * | 2017-07-10 | 2019-09-12 | Google Llc | Packet Segmentation and Reassembly for Mesh Networks |
US10849016B2 (en) * | 2017-07-10 | 2020-11-24 | Google Llc | Packet segmentation and reassembly for mesh networks |
Also Published As
Publication number | Publication date |
---|---|
US7124198B2 (en) | 2006-10-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7124198B2 (en) | Apparatus and method for scaling TCP off load buffer requirements by segment size | |
US7142540B2 (en) | Method and apparatus for zero-copy receive buffer management | |
US20200328973A1 (en) | Packet coalescing | |
US6629141B2 (en) | Storing a frame header | |
US8958440B2 (en) | System and method for identifying upper layer protocol message boundaries | |
US20070208820A1 (en) | Apparatus and method for out-of-order placement and in-order completion reporting of remote direct memory access operations | |
US7031904B1 (en) | Methods for implementing an ethernet storage protocol in computer networks | |
US6321269B1 (en) | Optimized performance for transaction-oriented communications using stream-based network protocols | |
EP1523148A1 (en) | Header compression/decompression device and header compression/decompression method | |
EP2232791B1 (en) | Tcp packet spacing | |
US20020046289A1 (en) | Protocol stack for linking storage area networks over an existing LAN, MAN,or WAN Protocol stack for linking storage area networks over on existing , man, or wan | |
EP1398938A2 (en) | System and method for transmission of data through multiple streams | |
US7480301B2 (en) | Method, system and article for improved TCP performance during retransmission in response to selective acknowledgement | |
US20070291782A1 (en) | Acknowledgement filtering | |
US20060015655A1 (en) | Method and system for supporting read operations with CRC for iSCSI and iSCSI chimney | |
US8578040B2 (en) | Method, system and article for client application control of network transmission loss tolerance | |
US8228919B2 (en) | Communication device, and communication method and program thereof | |
US6311222B1 (en) | Translator memory management system | |
EP1357721A2 (en) | System and method for identifying upper layer protocol message boundaries | |
US20050283545A1 (en) | Method and system for supporting write operations with CRC for iSCSI and iSCSI chimney | |
Morais et al. | 5G Transport Payload: Ethernet-Based Packet-Switched Data | |
EP1734720B1 (en) | System and method for identifying upper layer protocol message boundaries | |
WO1997040441A1 (en) | Network acceleration system | |
WO1999067925A1 (en) | Content storage and redundancy elimination |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MICROSOFT CORPORATION, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PINKERTON, JIM;REEL/FRAME:012354/0052 Effective date: 20011024 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
AS | Assignment |
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034541/0001 Effective date: 20141014 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.) |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20181017 |