[verifier] model.patch applied (58341 bytes) [verifier] Resetting files touched by test.patch [verifier] Applying test.patch [verifier] base pytest rc=0; new pytest rc=1 ===== raw suite output: base.log ===== ============================= test session starts ============================== platform linux -- Python 3.12.12, pytest-9.0.3, pluggy-1.6.0 benchmark: 5.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000) rootdir: /app configfile: pyproject.toml plugins: mock-3.15.1, sugar-1.1.1, cov-7.1.0, django-4.12.0, xdist-3.8.0, benchmark-5.2.3, asyncio-1.4.0, timeout-2.4.0, anyio-4.12.0 asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=module, asyncio_default_test_loop_scope=function timeout: 60.0s timeout method: signal timeout func_only: False created: 4/4 workers 4 workers [1473 items] .....................................................................x....................s........................xxxxx.x....xx....xxx.xx..x..xx....................................................................................................ssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................x..............xxxxx.x....xx.......xxx.xx..x...xx..........................................................................................................................................................................................xx.................................................................................................................................x.x.............................x.................x...............................................................x.........x.....................x........................x..................... ----------------- generated xml file: /logs/verifier/base.xml ------------------ ================ 1286 passed, 143 skipped, 44 xfailed in 31.07s ================ ===== raw suite output: new.log ===== ============================= test session starts ============================== platform linux -- Python 3.12.12, pytest-9.0.3, pluggy-1.6.0 -- /usr/local/bin/python benchmark: 5.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000) rootdir: /app configfile: pyproject.toml plugins: mock-3.15.1, sugar-1.1.1, cov-7.1.0, django-4.12.0, xdist-3.8.0, benchmark-5.2.3, asyncio-1.4.0, timeout-2.4.0, anyio-4.12.0 asyncio: mode=Mode.AUTO, debug=False, asyncio_default_fixture_loop_scope=module, asyncio_default_test_loop_scope=function timeout: 60.0s timeout method: signal timeout func_only: False collecting ... collected 72 items tests/test_state_data.py::TestStateDataBasic::test_state_with_data_initializes_on_entry[sync] PASSED tests/test_state_data.py::TestStateDataBasic::test_state_with_data_initializes_on_entry[async] PASSED tests/test_state_data.py::TestStateDataBasic::test_state_data_accessible_via_callback_parameter[sync] PASSED tests/test_state_data.py::TestStateDataBasic::test_state_data_accessible_via_callback_parameter[async] PASSED tests/test_state_data.py::TestStateDataBasic::test_state_data_modified_in_callback_persists_within_state[sync] PASSED tests/test_state_data.py::TestStateDataBasic::test_state_data_modified_in_callback_persists_within_state[async] PASSED tests/test_state_data.py::TestStateDataBasic::test_multiple_data_variables_on_one_state[sync] PASSED tests/test_state_data.py::TestStateDataBasic::test_multiple_data_variables_on_one_state[async] PASSED tests/test_state_data.py::TestStateDataBasic::test_data_with_different_types[sync] PASSED tests/test_state_data.py::TestStateDataBasic::test_data_with_different_types[async] PASSED tests/test_state_data.py::TestStateDataHierarchicalScoping::test_child_inherits_parent_compound_data[sync] PASSED tests/test_state_data.py::TestStateDataHierarchicalScoping::test_child_inherits_parent_compound_data[async] PASSED tests/test_state_data.py::TestStateDataHierarchicalScoping::test_child_data_shadows_parent_data[sync] PASSED tests/test_state_data.py::TestStateDataHierarchicalScoping::test_child_data_shadows_parent_data[async] PASSED tests/test_state_data.py::TestStateDataHierarchicalScoping::test_callback_in_child_sees_merged_data[sync] PASSED tests/test_state_data.py::TestStateDataHierarchicalScoping::test_callback_in_child_sees_merged_data[async] PASSED tests/test_state_data.py::TestStateDataHierarchicalScoping::test_parallel_regions_have_isolated_data[sync] PASSED tests/test_state_data.py::TestStateDataHierarchicalScoping::test_parallel_regions_have_isolated_data[async] PASSED tests/test_state_data.py::TestStateDataLifecycle::test_data_initialized_before_on_enter[sync] PASSED tests/test_state_data.py::TestStateDataLifecycle::test_data_initialized_before_on_enter[async] PASSED tests/test_state_data.py::TestStateDataLifecycle::test_data_accessible_during_on_exit[sync] PASSED tests/test_state_data.py::TestStateDataLifecycle::test_data_accessible_during_on_exit[async] PASSED tests/test_state_data.py::TestStateDataLifecycle::test_data_cleaned_up_after_exit[sync] PASSED tests/test_state_data.py::TestStateDataLifecycle::test_data_cleaned_up_after_exit[async] PASSED tests/test_state_data.py::TestStateDataLifecycle::test_reenter_state_reinitializes_data[sync] PASSED tests/test_state_data.py::TestStateDataLifecycle::test_reenter_state_reinitializes_data[async] PASSED tests/test_state_data.py::TestStateDataHistory::test_deep_history_restores_data[sync] PASSED tests/test_state_data.py::TestStateDataHistory::test_deep_history_restores_data[async] PASSED tests/test_state_data.py::TestStateDataHistory::test_shallow_history_restores_data[sync] PASSED tests/test_state_data.py::TestStateDataHistory::test_shallow_history_restores_data[async] PASSED tests/test_state_data.py::TestStateDataAPI::test_get_state_data_returns_dict_for_active[sync] PASSED tests/test_state_data.py::TestStateDataAPI::test_get_state_data_returns_dict_for_active[async] PASSED tests/test_state_data.py::TestStateDataAPI::test_get_state_data_returns_none_for_inactive[sync] PASSED tests/test_state_data.py::TestStateDataAPI::test_get_state_data_returns_none_for_inactive[async] PASSED tests/test_state_data.py::TestStateDataAPI::test_state_data_values_returns_snapshot[sync] PASSED tests/test_state_data.py::TestStateDataAPI::test_state_data_values_returns_snapshot[async] PASSED tests/test_state_data.py::TestStateDataValidation::test_non_dict_data_raises_invalid_definition PASSED tests/test_state_data.py::TestStateDataValidation::test_non_string_keys_raise_invalid_definition PASSED tests/test_state_data.py::TestStateDataValidation::test_empty_dict_data_is_valid PASSED tests/test_state_data.py::TestStateDataValidation::test_state_without_data_backward_compat PASSED tests/test_state_data.py::TestStateDataPersistence::test_pickle_round_trip_preserves_state_data PASSED tests/test_state_data.py::TestStateDataSCXML::test_scxml_datamodel_parsed_and_applied_to_state PASSED tests/test_state_data.py::TestStateDataSCXML::test_scxml_state_data_works_like_python_api PASSED tests/test_state_data.py::TestStateDataCompoundParallel::test_compound_state_with_data[sync] PASSED tests/test_state_data.py::TestStateDataCompoundParallel::test_compound_state_with_data[async] PASSED tests/test_state_data.py::TestStateDataCompoundParallel::test_parallel_state_with_data[sync] PASSED tests/test_state_data.py::TestStateDataCompoundParallel::test_parallel_state_with_data[async] PASSED tests/test_state_data.py::TestStateDataEdgeCases::test_transition_from_data_state_to_no_data_state[sync] PASSED tests/test_state_data.py::TestStateDataEdgeCases::test_transition_from_data_state_to_no_data_state[async] PASSED tests/test_state_data.py::TestStateDataEdgeCases::test_self_transition_reinitializes_data[sync] PASSED tests/test_state_data.py::TestStateDataEdgeCases::test_self_transition_reinitializes_data[async] PASSED tests/test_state_data.py::TestStateDataEdgeCases::test_multiple_entry_exit_cycles[sync] PASSED tests/test_state_data.py::TestStateDataEdgeCases::test_multiple_entry_exit_cycles[async] PASSED tests/test_state_data.py::TestDataVarSupport::test_datavar_with_default_and_type[sync] PASSED tests/test_state_data.py::TestDataVarSupport::test_datavar_with_default_and_type[async] PASSED tests/test_state_data.py::TestDataVarSupport::test_datavar_factory_creates_fresh_list_on_each_entry[sync] FAILED tests/test_state_data.py::TestDataVarSupport::test_datavar_factory_creates_fresh_list_on_each_entry[async] PASSED tests/test_state_data.py::TestDataVarSupport::test_datavar_type_validation_on_set_state_data[sync] PASSED tests/test_state_data.py::TestDataVarSupport::test_datavar_type_validation_on_set_state_data[async] PASSED tests/test_state_data.py::TestDataVarSupport::test_datavar_default_and_factory_raises_invalid_definition PASSED tests/test_state_data.py::TestSetStateDataAPI::test_set_state_data_updates_value[sync] PASSED tests/test_state_data.py::TestSetStateDataAPI::test_set_state_data_updates_value[async] PASSED tests/test_state_data.py::TestSetStateDataAPI::test_set_state_data_on_inactive_state_raises[sync] PASSED tests/test_state_data.py::TestSetStateDataAPI::test_set_state_data_on_inactive_state_raises[async] PASSED tests/test_state_data.py::TestSetStateDataAPI::test_set_state_data_with_undeclared_key_raises[sync] PASSED tests/test_state_data.py::TestSetStateDataAPI::test_set_state_data_with_undeclared_key_raises[async] PASSED tests/test_state_data.py::TestDataChangeTracking::test_get_data_changes_returns_changes_after_set[sync] PASSED tests/test_state_data.py::TestDataChangeTracking::test_get_data_changes_returns_changes_after_set[async] PASSED tests/test_state_data.py::TestDataChangeTracking::test_changes_cleared_between_macrosteps[sync] PASSED tests/test_state_data.py::TestDataChangeTracking::test_changes_cleared_between_macrosteps[async] PASSED tests/test_state_data.py::TestCallableDefaults::test_callable_default_creates_fresh_instance_on_each_entry[sync] PASSED tests/test_state_data.py::TestCallableDefaults::test_callable_default_creates_fresh_instance_on_each_entry[async] PASSED =================================== FAILURES =================================== _ TestDataVarSupport.test_datavar_factory_creates_fresh_list_on_each_entry[sync] _ self = sm_runner = async def test_datavar_factory_creates_fresh_list_on_each_entry(self, sm_runner): from statemachine import State, StateChart from statemachine import DataVar captured_ids = [] class SM(StateChart): s1 = State(initial=True, data={"items": DataVar(factory=list)}) s2 = State() s3 = State(final=True) go = s1.to(s2) back = s2.to(s1) finish = s1.to(s3) def on_enter_s1(self, state_data): captured_ids.append(id(state_data["items"])) sm = await sm_runner.start(SM) await sm_runner.send(sm, "go") await sm_runner.send(sm, "back") assert len(captured_ids) == 2 > assert captured_ids[0] != captured_ids[1] E assert 47060153652416 != 47060153652416 tests/test_state_data.py:642: AssertionError ------------------ generated xml file: /logs/verifier/new.xml ------------------ =========================== short test summary info ============================ FAILED tests/test_state_data.py::TestDataVarSupport::test_datavar_factory_creates_fresh_list_on_each_entry[sync] ========================= 1 failed, 71 passed in 0.33s ========================= ===== grade ===== [verifier] ===== FAILURES (1) ===== [verifier] ✗ [f2p] tests.test_state_data.TestDataVarSupport.test_datavar_factory_creates_fresh_list_on_each_entry[sync] assert 47060153652416 != 47060153652416 self = sm_runner = async def test_datavar_factory_creates_fresh_list_on_each_entry(self, sm_runner): from statemachine import State, StateChart from statemachine import DataVar captured_ids = [] class SM(StateChart): s1 = State(initial=True, data={"items": DataVar(factory=list)}) s2 = State() s3 = State(final=True) go = s1.to(s2) back = s2.to(s1) finish = s1.to(s3) def on_enter_s1(self, state_data): captured_ids.append(id(state_data["items"])) sm = await sm_runner.start(SM) await sm_runner.send(sm, "go") await sm_runner.send(sm, "back") assert len(captured_ids) == 2 > assert captured_ids[0] != captured_ids[1] E assert 47060153652416 != 47060153652416 tests/test_state_data.py:642: AssertionError P2P 1286/1286 pass 0 fail; F2P 71/72 pass 1 fail; PARTIAL 0.9992636229749632; BINARY 0 [verifier] reward.json={"reward": 0, "f2p_total": 72, "f2p_passed": 71, "p2p_total": 1286, "p2p_passed": 1286, "f2p": 0.9861111111111112, "p2p": 1.0, "partial": 0.9992636229749632}