Protocols/Standards: How Do Computers Talk to Each Other?

While people are intuitive enough to detect slang and dialects within most engineering standards, computers are too dumb to recognize slight variants on a data transfer. Engineers representing all the largest organizations, therefore, must constantly meet to make agreed-upon standards to accommodate the stupidity of computers.

Standard-Setters

There are a lot of standard-setting organizations, though not all of them necessarily deal with computers. Some of them are non-profit and others are for-profit, and their pricing/membership model for individuals varies wildly from “totally free” to “free to have (but not reproduce) if you pay a few hundred dollars”.

These standard-setting groups move around as technology changes, scandals happen, new technologies replace old, and another group makes a new set of standards.

Here are some of the more notable organizations that set computer-related standards (as of 2021), with some of their more notable contributions.

General:

  • ANSI (American National Standards Institute)
  • AIIM (Association for Information and Image Management)
  • ASAM (Association for Standardisation of Automation and Measuring Systems)
  • ISO (international Organization of Standards)
  • IEC (International Electrotechnical Commission)
  • IEEE (Institute of Electrical and Electronics Engineers)
  • OMG (Object Management Group)
  • OSGi Alliance (Open Services Gateway) – Java-specific

Computer manufacturing:

Open-source:

Internet/networks:

  • ARIB (Association of Radio Industries and Businesses) – Japan-specific
  • ATIS (Alliance for Telecommunications Industry Solutions) – USA-specific
  • CCSA (China Communications Standards Association) – China-specific
  • ETSI (European Telecommunications Standards Institute) – Europe-specific
  • IETF (Internet Engineering Task Force)
  • ITU (International Telecommunications Union)
  • OCF (Open Connectivity Foundation) – specifically for IoT
  • OIF (Optical Internetworking Forum)
  • TIA (Telecommunications Industry Association)
  • TM Forum
  • TSDSI (Telecommunications Standards Development Society, India) – India-specific
  • TTC (Telecommunication Technology Committee) – Japan-specific

Wireless/radio:

  • CISPR (International Special Committee on Radio Interference) – part of the IEC
  • OMA (Open Mobile Alliance)

Internet – web content:

  • DCMI (Dublin Core Metadata Initiative)
  • IPTC (International Press Telecommunications Council)
  • OASIS (Organization for the Advancement of Structured Information Standards)
  • W3C (World Wide Web Consortium)
  • XMPP Standards Foundation

Internet – media content:

  • DDEX (Digital Data Exchange) – for music
  • SMPTE (Society of Motion Picture and Television Engineers)

Internet – cybersecurity:

Storage:

  • CFA (CompactFlash Association)
  • SDA (SD Association)
  • SNIA (Storage Networking Industry Association)

Screen/printer:

  • CIE (International Commission on Illumination)

Audio:

  • AES (Audio Engineering Society)

GPS/satellites:

  • CCSDS (Consultative Committee for Space Data Systems)
  • OGC (Open Geospatial Consortium)

Distributed systems and large-scale technology:

  • DMTF (Distributed Management Task Force)
  • OGF (Open Grid Forum)

Other:

  • GS1 – standardized the barcode

Protocols/Standards

Many networking standards are thoroughly fixed as protocols. Many of them operate specifically on a port number, but some don’t use specific ports.

Very often, the spirit of freedom comes through protocols. Platforms are proprietary, but protocols allow a broader interoperability between various computers, programs, and tasks.

Cabling:

  • USB – Universal Serial Bus, a standard swappable cable for most computers designed to be as near-universal as possible:
    • USB Type A – the most frequently seen form factor, rectangular port that only inserts one way
      • First standardized in 1990’s
      • Supports USB 1.1, USB 2, and USB 3.x
    • USB 3.0 – a direct update to USB Type A and therefore typically backwards compatible, indicated by blue on the connector
    • USB Type B – rectangular form factor with tapered ends on one side, less frequently used (e.g., printers, scanners) and typically is Type A on the cable’s other side
    • USB Mini – small form factor typically for smaller devices (e.g., cameras, scanners), largely deprecated for USB Micro
    • USB Micro – the smallest form factor typically used for lower-power technology (e.g., cellphones), largely depreciated for USB Type C
    • USB Type C – symmetrical, comparatively newer form factor
    • USB Micro B – one male plug with two separate odd-shaped female connectors, typically for steady data transfer
  • Category 5 – more specifically, Cat5e is the most standard cabling for networked computers, but can go as low as Cat3 or up to and beyond Cat7
  • SFP – Small Form factor Pluggable, a standard for large-scale servers

Network identification:

  • ARP and RARP – address resolution protocol and (reverse) for IPv4, find out the MAC address from an IP address and vice versa, can be proxy (as a response) or gratuitous (as an unsolicited response)
  • NDP – neighbor discovery protocol, ARP for IPv6
  • CIDR – classless inter-domain routing, a system of demarcating classes of IPv4 addresses
  • DHCP – dynamic hosting control protocol, assigns IP addresses automatically, a huge part of maintaining networks
    • APIPA – automatic private IP addressing, the fallback for when DHCP fails on IPv4
    • SLAAC – stateless address auto configuration, an alternative for DHCP on IPv6
  • DNS – domain name system, access a server that links a URL with an IP address
  • IP – internet protocol, find an IP address of a computer

Network routing and status:

  • Ethernet – the only surviving LAN (“Local Area Network”) protocol, designed in the mid-1970’s
  • RIP – routing information protocol, counts the number of “hops” to determine the shortest network path
  • SNMP – simple network management protocol, keep track of relevant network information
  • ICMP – internet control message protocol, to send error messages about a specific IP address

File and information transfer:

  • FTP and FTPS – file transfer protocol (and secured version), send files
  • HTTP – hyper-text transfer protocol, send hyper-text across the internet
    • WebDAV – web distributed authoring and versioning, an extension to HTTP that allows the content to be both read and written (e.g., typing content into a web form)
  • L2TP – Layer 2 tunneling protocol, a core component of VPNs

Streaming file and information transfer:

  • IGMP – internet group management protocol, to multicast to specific IP addresses
  • RPC – remote procedure call, remotely request another computer to run a service
  • TCP – transmission control protocol, safely send data across the internet
  • UDP – user datagram protocol, quickly send data across the internet (it doesn’t check it afterward)

Message transfer protocols:

  • SMS – short message service, which is completely unencrypted and maxes out at 160 characters
  • MMS – multimedia message service, which allows a photo/video and 1,000 characters
  • Signal – an unencrypted, highly secure protocol
  • RSS – really simple syndication, a straightforward time-based feed of content that permits built-in media and hyperlinks
  • IRC – internet relay chat, a real-time text-based chat system
    • DCC – direct client-to-client, a sub-protocol for file transfer via IRC
    • XDCC – eXtended DCC or Xabi DCC, an expanded version of DCC for large files

Email-specific protocols:

  • POP3 – post office protocol v3, receive emails and delete the original
  • IMAP – internet message access protocol, receive and synchronize copies of emails
  • SMTP – simple mail transfer protocol, send emails

Console/terminal data protocols:

  • Telnet – remotely access an unencrypted command-line interface

Mobile carrier protocols:

  • GSM – global system for mobile communications, a European standard on the 900-1800 MHz band that the whole world uses (though the US uses the 1900 MHz band which makes its phones incompatible without dual-band hardware).
  • CDMA – code division multiple access, high-quality proprietary WWII-era protocol that gives full-band data to multiple connections at once by splitting the code into small pieces
  • WLL – wireless in local loop, a LAN protocol
  • GPRS – general packet radio services, the standard for 2G and 3G data services

Some protocols are encryption-specific:

  • TLS – transport layer security, which has succeeded secure socket layer (SSL), and tends to use other encryption primitives like AES
  • PGP – pretty good privacy, encrypts and authenticates mail messages
  • SSH – secure shell, remotely access an encrypted command-line interface (i.e., Telnet but encrypted)
  • HTTPS – hyper-text transfer protocol secured, send hyper-text across the internet (i.e., HTTP with SSL/TLS)
  • WEP – wireless encrypted protocol, a compromised network standard for wireless signals, has been compromised
  • WPA/WPA2/WPA3 – Wi-Fi protected access, the network standard for wireless signals
  • Some protocols verify email domains for validity, such as DMARC (Domain-based Message Authentication, Reporting and Conformance)

Synchronizing a network across time zones, while also accounting for (relatively) severe latency, daylight savings time, differences in altitude (since time travels slower when moving faster due to Einstein’s relativity), and differences between conventions makes timezones insanely difficult to keep track of. It uses the Network Time Protocol (NTP) just to keep track, and it has two different standards: IETF’s RFC 3339 and ISO’s 8601. They have overlap, but not entirely.

It’s worth noting most of the above protocols have very specific network “ports” they work through.

Most computer design specifications must abide by certain compliance standards to work correctly. While it’s often possible to hack them, those standards are often there for a safety reason.

There are many standards about how to setup cabling arrangements as well:

  • Horizontal cabling and cabling runs which travel long-distance.
  • Structured cabling for nearby systems, like twisted-pair and optical cabling.
  • Arrangements for wireless technologies’ power output, which considers their range and materials that the signals are passing through.

Further Learning

Fun with IP address parsing

All About USB-C: Illegal Adapters

Email explained from first principles