0
0
Fork 0
Codesys-MCP-SP21-plus/tests
Karstein Phobic Nyvold Kvistad f7d564bc47 test(bench): v5 sweep -- fix set_pou_code params, all 10 cases pass
Three changes:
1. Fix the bench harness's set_pou_code case. The previous version
   passed POU_PATH / DECLARATION_CODE / IMPLEMENTATION_CODE, but the
   script template expects POU_FULL_PATH / DECLARATION_CONTENT /
   IMPLEMENTATION_CONTENT. Plus the recently-added SET_DECLARATION /
   SET_IMPLEMENTATION boolean flags from 35abc8c. With these
   corrections, set_pou_code passes for the first time in the bench.
2. Add bench-results-v5.json from a fresh persistent-mode run on
   MCPTest2 v1.3.4.0. All 10 cases PASS.
3. Update TEST_OVERVIEW.md with the v5 numbers alongside the v1
   historical numbers. v5 is ~2x faster across the board than v1
   (likely the cumulative effect of the ScriptManager cache removal +
   SP22 Patch 1 IPC improvements). first-cold open_project is slower
   than v1 (10.6 s vs 7.7 s) -- one-shot, noise probably; warm
   already-open call dropped from 740 ms to 314 ms.

The v5 set_pou_code pass is the third end-to-end signal that the
omitted-decl wipe fix is good (after the e2e regression test and the
live PLC_PRG restoration earlier today).
2026-04-26 19:30:48 +02:00
..
integration fix(set_pou_code): omitted declaration/impl no longer wipes the POU 2026-04-26 18:41:48 +02:00
unit fix(create_folder): try project.create_folder(name, SV_POU) first; drop ScriptManager cache 2026-04-26 17:16:44 +02:00
bench-results-v5.json test(bench): v5 sweep -- fix set_pou_code params, all 10 cases pass 2026-04-26 19:30:48 +02:00
bench-results.json fix: 4 broken-tool fixes (compile json long, connect_to_device LoginMode, 2026-04-26 16:53:25 +02:00
bench.mjs test(bench): v5 sweep -- fix set_pou_code params, all 10 cases pass 2026-04-26 19:30:48 +02:00
mock_watcher.py Initial release: MCP server for CODESYS with persistent UI instance 2026-02-08 18:59:16 +10:00
test-fixes.mjs fix(create_folder): try project.create_folder(name, SV_POU) first; drop ScriptManager cache 2026-04-26 17:16:44 +02:00
TEST_OVERVIEW.md test(bench): v5 sweep -- fix set_pou_code params, all 10 cases pass 2026-04-26 19:30:48 +02:00