2022-05-06 16:49:46 +00:00
|
|
|
# Copyright (c) 2017 - 2022 LiteSpeed Technologies Inc. See LICENSE.
|
2017-09-22 21:00:03 +00:00
|
|
|
LSQUIC Examples
|
|
|
|
===============
|
|
|
|
|
2019-09-11 15:27:58 +00:00
|
|
|
LSQUIC comes with several examples of how the library is used.
|
|
|
|
|
|
|
|
The client and server programs described below are built on a common
|
|
|
|
framework and share many options.
|
|
|
|
|
2019-10-15 21:02:21 +00:00
|
|
|
Echo client and server
|
|
|
|
----------------------
|
|
|
|
|
2020-05-17 16:42:32 +00:00
|
|
|
Echo client and server (see bin/echo_{client,server}.c) are for simple
|
2019-10-15 21:02:21 +00:00
|
|
|
line-based request and reply communication. Only one stream per connection
|
|
|
|
is supported for simplicity. The client reads input from stdin.
|
|
|
|
|
|
|
|
MD5 client and server
|
|
|
|
---------------------
|
|
|
|
|
2020-05-17 16:42:32 +00:00
|
|
|
See bin/md5_{client,server}.c
|
2019-10-15 21:02:21 +00:00
|
|
|
|
|
|
|
MD5 server accepts connections, computes MD5 sum of streams' (one or more)
|
|
|
|
payload, and sends back the checksum. MD5 client sends one or more file
|
|
|
|
contents to the server. Both client and server support various options to
|
|
|
|
exercise different aspects of LSQUIC.
|
|
|
|
|
2019-09-11 15:27:58 +00:00
|
|
|
HTTP client and server
|
|
|
|
----------------------
|
|
|
|
|
2020-05-17 16:42:32 +00:00
|
|
|
See bin/http_{client,server}.c
|
2019-09-11 15:27:58 +00:00
|
|
|
|
|
|
|
This pair of programs is to demonstrate how to use HTTP features of QUIC.
|
|
|
|
HTTP server is interoperable with proto-quic's quic_client.
|
2017-09-22 21:00:03 +00:00
|
|
|
|
2020-09-15 20:42:13 +00:00
|
|
|
Duck client and server
|
|
|
|
----------------------
|
|
|
|
|
|
|
|
See bin/duck_{client,server}.c
|
|
|
|
|
|
|
|
This pair of programs implement the siduck-00 protocol. They provide an
|
|
|
|
illustration of using the datagram API.
|
|
|
|
|
2017-09-22 21:00:03 +00:00
|
|
|
Usage Examples
|
|
|
|
--------------
|
|
|
|
|
|
|
|
Fetch Google's home page:
|
|
|
|
|
2021-02-11 15:55:49 +00:00
|
|
|
./bin/http_client -s www.google.com -p /
|
2017-09-26 15:26:05 +00:00
|
|
|
|
2018-05-16 19:48:43 +00:00
|
|
|
The default port number is 443, but it can be specified after colon
|
|
|
|
using the -s flag. The value of the `host' header as well as the SNI
|
|
|
|
value defaults to the host part of the -s option. -H option can be
|
|
|
|
used to override it. For example:
|
2017-09-22 21:00:03 +00:00
|
|
|
|
2021-02-11 15:55:49 +00:00
|
|
|
./bin/http_client -H www.youtube.com -s www.google.com:443 -p / -M HEAD
|
2018-05-16 16:14:02 +00:00
|
|
|
|
2018-05-16 19:48:43 +00:00
|
|
|
The host part can be an IP address. Both IPv4 and IPv6 are supported.
|
2021-02-11 15:55:49 +00:00
|
|
|
See ./bin/http_client -h for a (long) list of different flags.
|
2018-04-23 20:12:38 +00:00
|
|
|
|
2017-09-22 21:00:03 +00:00
|
|
|
POST a file to calculate its CRC32 checksum:
|
|
|
|
|
2021-02-11 15:55:49 +00:00
|
|
|
./bin/http_client -H www.litespeedtech.com -s 443 \
|
2017-09-22 21:00:03 +00:00
|
|
|
-p /cgi-bin/crc32.cgi -P file-256M -M POST
|
|
|
|
|
|
|
|
HTTP/1.1 200 OK
|
|
|
|
content-type: text/plain
|
|
|
|
date: Fri, 09 Jun 2017 08:40:45 GMT
|
|
|
|
server: LiteSpeed
|
|
|
|
alt-svc: quic=":443"; v="35,37"
|
|
|
|
|
|
|
|
CRC32: 2A0E7DBB
|
|
|
|
|
|
|
|
This is a good way to check that the payload gets to the other side
|
|
|
|
correctly. The CGI script is:
|
|
|
|
|
|
|
|
#!/usr/bin/perl
|
|
|
|
use String::CRC32;
|
|
|
|
printf "Content-type: text/plain\r\n\r\nCRC32: %X\n", crc32(*STDIN)
|
|
|
|
|
|
|
|
On the command line, I do
|
|
|
|
|
|
|
|
alias crc32="perl -MString::CRC32 -e'printf qq(%X\n), crc32(<>)'"
|
|
|
|
|
|
|
|
To submit several requests concurrently, one can use -n and -r options:
|
|
|
|
|
2021-02-11 15:55:49 +00:00
|
|
|
./bin/http_client -H www.litespeedtech.com -s 443 \
|
2017-09-22 21:00:03 +00:00
|
|
|
-p /cgi-bin/crc32.cgi -P file-256M -M POST -n 3 -r 10
|
|
|
|
|
|
|
|
This will open three parallel connections which will make ten POST
|
|
|
|
requests together.
|
|
|
|
|
|
|
|
To perform load testing, it is good to mix sending and receiving data:
|
|
|
|
|
|
|
|
for i in {1..100}; do
|
2021-02-11 15:55:49 +00:00
|
|
|
./bin/http_client $COMMON_OPTS -p /cgi-bin/crc32.cgi -P file-256M \
|
2017-09-22 21:00:03 +00:00
|
|
|
-M POST >out-post.$i &
|
2021-02-11 15:55:49 +00:00
|
|
|
./bin/http_client $COMMON_OPTS -p /docs/file-256M >out-get.$i &
|
2017-09-22 21:00:03 +00:00
|
|
|
sleep 1
|
|
|
|
done
|
|
|
|
|
|
|
|
If you don't want to create a hundred 256-megabyte out-get.* files, use -K
|
|
|
|
flag to discard output.
|
|
|
|
|
2019-09-11 15:27:58 +00:00
|
|
|
Testing Large Packet Sizes
|
|
|
|
---------------------------------
|
|
|
|
|
|
|
|
IETF QUIC supports all valid UDP packet sizes. This section outlines the
|
|
|
|
environment setup and testing parameters necessary to test this feature.
|
|
|
|
|
|
|
|
Compilation
|
|
|
|
- Make sure to compile the library in DEBUG mode so that the NDEBUG
|
|
|
|
define is off.
|
|
|
|
- Build both the http_client and http_server test programs.
|
|
|
|
|
|
|
|
Running Instructions
|
2020-07-29 15:33:52 +00:00
|
|
|
- Specify maximum packet size using -o base_plpmtu=$number.
|
|
|
|
Valid sizes are up to 65535.
|
2019-09-11 15:27:58 +00:00
|
|
|
- Use the -W flag for http_client and http_server for the ability
|
|
|
|
to send packets of large size.
|
|
|
|
- On the client side, use the -z flag to specify the maximum size
|
|
|
|
of packet that the client will accept.
|
|
|
|
|
|
|
|
Example Usage
|
2021-02-11 15:55:49 +00:00
|
|
|
./bin/http_client -p /file-1M -H www.litespeedtech.com -s 192.168.0.85:5443
|
2020-07-29 15:33:52 +00:00
|
|
|
-o version=FF000014
|
2021-02-11 15:55:49 +00:00
|
|
|
./bin/http_server -c www.litespeedtech.com,certschain,privkey
|
2020-07-29 15:33:52 +00:00
|
|
|
-s 0.0.0.0:5443 -W -o base_plpmtu=65535
|
2019-09-11 15:27:58 +00:00
|
|
|
|
|
|
|
Additional Notes
|
|
|
|
Since this feature does not have MTU discovery enabled at the time of
|
|
|
|
writing, make sure to use client and server machines that share a path
|
|
|
|
with the intended MTU.
|
|
|
|
|
2017-09-22 21:00:03 +00:00
|
|
|
Control QUIC Settings via -o Flag
|
|
|
|
---------------------------------
|
|
|
|
|
2022-11-03 14:56:42 +00:00
|
|
|
Most of the settings in struct lsquic_engine_settings can be controlled
|
2017-09-22 21:00:03 +00:00
|
|
|
via -o flag. With exception of es_versions, which is a bit mask, other
|
|
|
|
es_* options can be mapped to corresponding -o value via s/^es_//:
|
|
|
|
|
|
|
|
es_cfcw => -o cwcf=12345
|
|
|
|
es_max_streams_in => -o max_streams_in=123
|
|
|
|
|
|
|
|
And so on.
|
|
|
|
|
2019-09-11 15:27:58 +00:00
|
|
|
For example, to test version negotiation:
|
|
|
|
|
2021-02-11 15:55:49 +00:00
|
|
|
./bin/http_server -c www.litespeedtech.com,certschain,privkey \
|
2019-09-11 15:27:58 +00:00
|
|
|
-o version=Q035 -L debug 2>server.out &
|
2021-02-11 15:55:49 +00:00
|
|
|
./bin/http_client -H www.litespeedtech.com -p Makefile -L debug 2>client.out
|
2019-09-11 15:27:58 +00:00
|
|
|
|
|
|
|
Above, the client will start with the default, which is the highest supported
|
|
|
|
QUIC version, which the server should negotiate down. You should see it from
|
|
|
|
the log files.
|
|
|
|
|
2017-09-22 21:00:03 +00:00
|
|
|
The code to set options via -o flag lives in set_engine_option(). It is good
|
|
|
|
to update this function at the same time as member fields are added to struct
|
|
|
|
lsquic_engine_settings.
|
|
|
|
|
|
|
|
Control LSQUIC Behavior via Environment Variables
|
|
|
|
-------------------------------------------------
|
|
|
|
|
2019-09-11 15:27:58 +00:00
|
|
|
LSQUIC_PACKET_OUT_LIMIT
|
|
|
|
|
|
|
|
If set, the value of this environment variable is the maximum number
|
|
|
|
of packets that can be sent out in one shot. The limit is in the test
|
|
|
|
program framework's ea_packets_out() callback.
|
|
|
|
|
|
|
|
It is not applicable when sendmmsg(2) is used.
|
|
|
|
|
|
|
|
Note 1: sendmmsg can be enabled using -g option, if available for your
|
|
|
|
platform.
|
|
|
|
|
|
|
|
Note 2: see -m option for a related packet-out limitation.
|
|
|
|
|
|
|
|
LSQUIC_LOSE_PACKETS_RE
|
|
|
|
|
|
|
|
If set, this regular expression specifies the numbers of packets which
|
|
|
|
the sender will lose on purpose. For example:
|
|
|
|
|
|
|
|
export LSQUIC_LOSE_PACKETS_RE='^(3|5|10)$'
|
|
|
|
|
|
|
|
The act of losing a packet is performed by changing its payload to
|
|
|
|
zero-filled buffer of the same size, which is almost as good as
|
|
|
|
not sending anything. The latter is difficult to implement without
|
|
|
|
negatively affecting the regular code flow.
|
|
|
|
|
|
|
|
Only available in debug builds.
|
|
|
|
|
2017-09-22 21:00:03 +00:00
|
|
|
LSQUIC_PACER_INTERTICK
|
|
|
|
|
|
|
|
Number of microsecods to use as constant intertick time in lieu of the
|
|
|
|
pacer's dynamic intertick time approximation.
|
|
|
|
|
|
|
|
Only available in debug builds.
|
|
|
|
|
2018-02-26 21:01:16 +00:00
|
|
|
LSQUIC_CUBIC_SAMPLING_RATE
|
|
|
|
|
|
|
|
Number of microseconds between times CWND is logged at info level.
|
|
|
|
|
|
|
|
Only available in debug builds.
|
|
|
|
|
2018-05-21 19:02:33 +00:00
|
|
|
LSQUIC_RANDOM_SEND_FAILURE
|
|
|
|
|
|
|
|
Frequency with which sending of packets fails: one out of this many
|
|
|
|
times on average.
|
|
|
|
|
|
|
|
Only available when compiled with -DLSQUIC_RANDOM_SEND_FAILURE=1
|
|
|
|
|
2019-09-11 15:27:58 +00:00
|
|
|
LSQUIC_LOG_SECRETS
|
|
|
|
|
|
|
|
If set to true value, crypto secrets will be logged. Applies to
|
|
|
|
IETF QUIC only.
|
|
|
|
|
|
|
|
LSQUIC_COALESCE
|
|
|
|
|
|
|
|
If set to false, packets are not coalesced. Defaults to true.
|
|
|
|
|
|
|
|
LSQUIC_USE_POOLS
|
|
|
|
|
|
|
|
If set to false, all memory pooling code is replaced with calls to
|
|
|
|
malloc() and free(). This facilitates debugging memory issues.
|
|
|
|
The default is true.
|
|
|
|
|
2019-12-30 16:29:05 +00:00
|
|
|
LSQUIC_ACK_ATTACK
|
|
|
|
|
|
|
|
If set to true, generate optimistic ACKs.
|
|
|
|
|
2017-09-22 21:00:03 +00:00
|
|
|
Control Network-Related Stuff
|
|
|
|
-----------------------------
|
|
|
|
|
|
|
|
-D Set `do not fragment' flag on outgoing UDP packets.
|
|
|
|
|
|
|
|
-z BYTES Maximum size of outgoing UDP packets. The default is 1370
|
|
|
|
bytes for IPv4 socket and 1350 bytes for IPv6 socket.
|
|
|
|
|
|
|
|
-S opt=val Socket options. Supported options:
|
|
|
|
sndbuf=12345 # Sets SO_SNDBUF
|
|
|
|
rcvbuf=12345 # Sets SO_RCVBUF
|
|
|
|
|
2019-09-11 15:27:58 +00:00
|
|
|
-g Use sendmmsg() to send packets. This is only compiled in
|
|
|
|
if available.
|
|
|
|
|
2017-09-22 21:00:03 +00:00
|
|
|
More Compilation Options
|
|
|
|
------------------------
|
|
|
|
|
2019-01-16 20:13:59 +00:00
|
|
|
-DLSQUIC_CONN_STATS=1
|
2017-09-22 21:00:03 +00:00
|
|
|
|
2019-01-16 20:13:59 +00:00
|
|
|
Track some statistics about connections -- packets in, sent, delayed,
|
2017-09-22 21:00:03 +00:00
|
|
|
stream payload per packet size ratio, and some others -- and print them
|
|
|
|
at NOTICE level when connection is destroyed.
|
|
|
|
|
2019-01-16 20:13:59 +00:00
|
|
|
Cumulative connections statistics are printed by the engine when it is
|
|
|
|
destroyed if lsquic_engine_api.ea_stats_fh is set. The HTTP client
|
|
|
|
programs sets it when -t or -T command-line option is used.
|
2017-09-22 21:00:03 +00:00
|
|
|
|
|
|
|
-DLSQUIC_PACKINTS_SANITY_CHECK=1
|
|
|
|
|
|
|
|
Turn on sanity checking for packet interval code. The packet interval
|
|
|
|
code, shared by both send and receive history modules, contained a bug
|
|
|
|
which prompted me to add a checking function.
|
|
|
|
|
|
|
|
-DLSQUIC_SEND_STATS=0
|
|
|
|
|
|
|
|
Turn off statistics collection performed by the send controller: number
|
|
|
|
of packets sent, resent, and delayed.
|
|
|
|
|
2019-09-11 15:27:58 +00:00
|
|
|
-DLOG_PACKET_CHECKSUM=1
|
|
|
|
|
|
|
|
When turned on, CRC32 checksum of each sent and received packet is
|
|
|
|
logged as an event.
|
|
|
|
|
2017-09-22 21:00:03 +00:00
|
|
|
-DLSQUIC_LOWEST_LOG_LEVEL=LSQ_LOG_WARN
|
|
|
|
|
|
|
|
If you want to go even faster: compile out some log levels entirely.
|
2018-02-26 21:01:16 +00:00
|
|
|
|
|
|
|
-DLSQUIC_EXTRA_CHECKS=1
|
|
|
|
|
|
|
|
Add relatively expensive run-time sanity checks
|
|
|
|
|
2018-05-21 19:02:33 +00:00
|
|
|
-DLSQUIC_RANDOM_SEND_FAILURE=1
|
|
|
|
|
|
|
|
Simulate failure to send packets to test send resumption logic. When
|
|
|
|
this flag is specified, sending of packets will randomly fail, about
|
|
|
|
one out of every 10 attempts. Set environment variable
|
|
|
|
LSQUIC_RANDOM_SEND_FAILURE to change this frequency.
|
2019-09-18 15:22:20 +00:00
|
|
|
|
|
|
|
-DLSQUIC_ECN_BLACK_HOLE=1
|
|
|
|
|
|
|
|
When compiled with this flag, setting environment variable
|
|
|
|
LSQUIC_ECN_BLACK_HOLE to 1 will emulate ECN black hole: all received
|
|
|
|
packets with ECN markings are dropped on the floor.
|
2019-12-30 16:29:05 +00:00
|
|
|
|
|
|
|
-DLSQUIC_ACK_ATTACK=1
|
|
|
|
|
|
|
|
Enable ACK attack mode. See LSQUIC_ACK_ATTACK environment variable
|
|
|
|
entry above.
|