raphael
9876dd9b5a
tests / build-and-test (push) Successful in 2m59s
tests / thread-sanitizer (push) Successful in 3m36s
tests / tshark-dissector (push) Successful in 2m25s
tests / secs4j-interop (push) Successful in 59s
tests / python-interop (push) Successful in 3m20s
tests / libfuzzer (push) Successful in 3m40s
Completes the daemon's GEM300 surface and adds two new test tiers. D10 — E87 carriers: CarrierStore gains the HandlerSlot observer pattern (add_id/slot_map/access_handler). The daemon's id-observer forwards host S3F17 decisions onto the Subscribe stream as CarrierAction (PROCEED on a Confirmed transition, CANCEL on CancelCarrier); ReportCarrier drives the flow tool-side: WAITING creates the carrier + records the slot map, IN_ACCESS/COMPLETE advance the access FSM (INVALID_OBJECT on unknown, CANNOT_DO_NOW on an illegal transition). E16 — operations RPCs: Describe (full name inventory: variables/events/ alarms/commands/constants + device header), FlushSpool (purge or drain), SendTerminalMessage (S10F1 tool->host, honest CANNOT_DO_NOW when no host and stream 10 isn't spoolable). Stream responsiveness: Subscribe/WatchHealth poll at 100ms (was 500ms) so a cancelled stream frees its sync-server worker thread promptly — this was found by the new stress test, which hung under Subscribe churn at 500ms. Tests: - A randomized concurrent RPC stress case: 4 threads x 250 seeded ops (set/get/fire/alarm/control-state/describe + Subscribe churn), asserts no failed RPC and a still-responsive engine afterward; prints its seed; a strong TSan target. - A virtual fab (interop/virtual_fab.py + the `fab` compose service / tools/spawn_fab.sh): N daemons, each with a secsgem-py host AND a secsgem_client tool, driven by seeded random traffic with end-to-end invariant checks (set/get round-trips, event->S6F11 and alarm->S5F1 delivery, command->tool->completion). Verified green at N=3 (~150 ops/eq, all commands round-tripped, 0 violations). Wired into run_interop.sh (now 13 steps). Also fixes the CI break from the previous commit: the Python-client lane's test_values.py step lacked PYTHONPATH=clients/python (now step-level env). Two bugs found and fixed while building this, both mine from this batch: 1. carrier test hung on a CancelCarrier of a still-NotConfirmed carrier — a self-transition the FSM doesn't signal, so the observer never fired and the stream Read blocked forever. Fixed to cancel a Confirmed carrier; the NotConfirmed edge is documented as a known E87 limitation. 2. the 500ms stream poll above. Daemon suite 7 cases / 214 assertions; core 475 / 3097; virtual fab green. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
162 lines
6.2 KiB
Bash
Executable File
162 lines
6.2 KiB
Bash
Executable File
#!/usr/bin/env bash
|
|
# Run EVERY external-validation harness in one shot, with a PASS/FAIL summary.
|
|
#
|
|
# The unit suite is partly self-referential (our parsers validate our
|
|
# builders); these harnesses are the real oracle — independent implementations
|
|
# (secsgem-py, secs4java8, Wireshark) judging our wire behaviour. This script
|
|
# exists so they run routinely, not "when someone remembers".
|
|
#
|
|
# tools/run_interop.sh # everything
|
|
# SKIP_SECS4J=1 tools/run_interop.sh # skip the (slow) Java image build
|
|
#
|
|
# Steps (each independently PASS/FAIL, all attempted, nonzero exit if any fail):
|
|
# build compose builder (cmake + ninja, includes secs_gemd)
|
|
# unit secsgem_tests (full C++ suite)
|
|
# daemon-unit secs_gemd_tests (in-process gRPC service tests)
|
|
# py-host secsgem-py active host vs C++ secs_server (31 checks)
|
|
# conformance secs_conformance C++ host vs C++ secs_server (47 checks)
|
|
# daemon gRPC tool + secsgem-py host vs secs_gemd (bridge proof)
|
|
# pyclient published secsgem-client package vs secs_gemd (13 checks)
|
|
# spool spool persistence across a server restart
|
|
# daemon-ops unix-socket gRPC + Prometheus gauges + graceful SIGTERM
|
|
# fab randomized virtual fab: FAB_N daemons x (host + tool) actors
|
|
# tshark Wireshark HSMS dissector on a live capture
|
|
# secs4j secs4java8 Java host vs C++ secs_server (55 checks)
|
|
#
|
|
# Requires: docker compose. Runs from any cwd.
|
|
set -u
|
|
cd "$(dirname "${BASH_SOURCE[0]}")/.."
|
|
|
|
declare -a NAMES RESULTS
|
|
overall=0
|
|
|
|
note() { printf '\n\033[1m== %s ==\033[0m\n' "$*"; }
|
|
record() { # record <name> <exit-code>
|
|
NAMES+=("$1"); RESULTS+=("$2")
|
|
if [ "$2" -ne 0 ]; then overall=1; fi
|
|
}
|
|
|
|
compose() { docker compose "$@"; }
|
|
|
|
stop_services() { compose stop server gemd server-spool fab >/dev/null 2>&1 || true; }
|
|
trap stop_services EXIT
|
|
|
|
# ---- build -----------------------------------------------------------------
|
|
# -j 2: unbounded ninja at -O3 OOM-kills cc1plus in memory-constrained Docker
|
|
# VMs (macOS Docker Desktop). Two jobs is reliably safe and still fast.
|
|
note "build (compose builder, -j 2)"
|
|
compose run --rm builder bash -lc \
|
|
"cmake -S /app -B /app/build -G Ninja -DCMAKE_BUILD_TYPE=Release && \
|
|
cmake --build /app/build -j 2"
|
|
build_rc=$?
|
|
record build $build_rc
|
|
if [ "$build_rc" -ne 0 ]; then
|
|
echo "build failed — aborting (everything below needs the binaries)"
|
|
exit 1
|
|
fi
|
|
|
|
# ---- unit suites -----------------------------------------------------------
|
|
note "unit: secsgem_tests"
|
|
compose run --rm builder /app/build/secsgem_tests; record unit $?
|
|
|
|
note "daemon-unit: secs_gemd_tests"
|
|
if compose run --rm builder test -x /app/build/secs_gemd_tests; then
|
|
compose run --rm builder /app/build/secs_gemd_tests; record daemon-unit $?
|
|
else
|
|
echo "secs_gemd_tests not built (grpc missing from toolchain?) — FAIL"
|
|
record daemon-unit 1
|
|
fi
|
|
|
|
# ---- secsgem-py host vs C++ server ------------------------------------------
|
|
note "py-host: secsgem-py GemHostHandler vs secs_server"
|
|
compose up -d --no-deps server
|
|
sleep 2
|
|
compose run --rm --no-deps interop python3 host_vs_cpp_server.py --host server
|
|
record py-host $?
|
|
compose stop server >/dev/null 2>&1
|
|
|
|
# ---- C++ conformance host vs C++ server -------------------------------------
|
|
note "conformance: secs_conformance vs secs_server"
|
|
compose up -d --no-deps server
|
|
sleep 2
|
|
compose run --rm builder /app/build/secs_conformance --host server --port 5000
|
|
record conformance $?
|
|
compose stop server >/dev/null 2>&1
|
|
|
|
# ---- daemon: gRPC tool + secsgem-py host vs secs_gemd ------------------------
|
|
note "daemon: gRPC + secsgem-py vs secs_gemd"
|
|
compose up -d --no-deps gemd
|
|
sleep 2
|
|
compose run --rm --no-deps interop \
|
|
python3 daemon_interop.py --grpc gemd:50051 --hsms-host gemd
|
|
record daemon $?
|
|
compose stop gemd >/dev/null 2>&1
|
|
|
|
# ---- Python client package vs secs_gemd --------------------------------------
|
|
note "pyclient: secsgem_client package + secsgem-py host vs secs_gemd"
|
|
(
|
|
set -e
|
|
compose run --rm --no-deps -e PYTHONPATH=/app/clients/python interop \
|
|
python3 /app/clients/python/tests/test_values.py
|
|
compose up -d --no-deps gemd
|
|
sleep 2
|
|
compose run --rm --no-deps -e PYTHONPATH=/app/clients/python interop \
|
|
python3 pyclient_interop.py --grpc gemd:50051 --hsms-host gemd
|
|
)
|
|
record pyclient $?
|
|
compose stop gemd >/dev/null 2>&1
|
|
|
|
# ---- spool persistence across restart ---------------------------------------
|
|
note "spool: persistence across server restart"
|
|
(
|
|
set -e
|
|
compose up -d --no-deps server-spool
|
|
sleep 2
|
|
compose run --rm --no-deps interop \
|
|
python3 spool_persistence_test.py --phase enqueue --host server-spool
|
|
compose restart server-spool
|
|
sleep 2
|
|
compose run --rm --no-deps interop \
|
|
python3 spool_persistence_test.py --phase drain --host server-spool
|
|
)
|
|
record spool $?
|
|
compose stop server-spool >/dev/null 2>&1
|
|
|
|
# ---- daemon operations: unix socket + metrics + graceful shutdown ------------
|
|
note "daemon-ops: unix socket, Prometheus gauges, SIGTERM drains cleanly"
|
|
compose run --rm builder bash tools/check_daemon_ops.sh
|
|
record daemon-ops $?
|
|
|
|
# ---- randomized virtual fab ----------------------------------------------------
|
|
note "fab: ${FAB_N:-3} equipment x (secsgem-py host + secsgem-client tool), seeded random traffic"
|
|
compose up -d --no-deps fab
|
|
sleep 3
|
|
compose run --rm --no-deps -e PYTHONPATH=/app/clients/python interop \
|
|
python3 virtual_fab.py --host fab --n "${FAB_N:-3}" --seconds "${FAB_SECONDS:-20}"
|
|
record fab $?
|
|
compose stop fab >/dev/null 2>&1
|
|
|
|
# ---- Wireshark dissector ------------------------------------------------------
|
|
note "tshark: Wireshark HSMS dissector"
|
|
compose run --rm builder bash interop/tshark_validate.sh
|
|
record tshark $?
|
|
|
|
# ---- secs4java8 ---------------------------------------------------------------
|
|
if [ "${SKIP_SECS4J:-0}" = "1" ]; then
|
|
echo "secs4j skipped (SKIP_SECS4J=1)"
|
|
else
|
|
note "secs4j: secs4java8 host vs secs_server"
|
|
bash interop/secs4j_validate.sh; record secs4j $?
|
|
fi
|
|
|
|
# ---- summary -----------------------------------------------------------------
|
|
printf '\n\033[1m== interop summary ==\033[0m\n'
|
|
for i in "${!NAMES[@]}"; do
|
|
if [ "${RESULTS[$i]}" -eq 0 ]; then
|
|
printf ' \033[32mPASS\033[0m %s\n' "${NAMES[$i]}"
|
|
else
|
|
printf ' \033[31mFAIL\033[0m %s (exit %s)\n' "${NAMES[$i]}" "${RESULTS[$i]}"
|
|
fi
|
|
done
|
|
exit $overall
|