Enable EVP flagevaluation system tests for Java

[leoromanovsky]

Motivation

Java needs the shared server-side EVP flagevaluation system-test contract enabled so APM reviewers can validate that Java evaluations produce the same backend-visible signal as the other SDKs. This PR provides the public system-tests companion for the Java SDK fanout.

Changes

• Enables tests/ffe/test_flag_eval_evp.py for Java spring-boot in manifests/java.yml at v1.64.0-SNAPSHOT.
• Leaves other Java weblogs marked irrelevant.
• Keeps the test implementation inherited from current system-tests main.

Decisions

• Enable only spring-boot because that is the Java weblog covered by the companion SDK validation.
• Keep this PR to the Java manifest surface; SDK behavior remains in DataDog/dd-trace-java#11639.
• Existing OTel metric coverage stays in tests/ffe/test_flag_eval_metrics.py; this PR is only for EVP flagevaluation.

Validation Evidence

System Tests

• Companion SDK PR: feat(openfeature): emit server-side EVP flagevaluation dd-trace-java#11639
• This PR enables the Java manifest surface used by that SDK PR for EVP flagevaluation validation.

[github-actions]

CODEOWNERS have been resolved as:

manifests/java.yml                                                      @DataDog/asm-java @DataDog/apm-java

[datadog-datadog-prod-us1-2]

 

⚠️ Warnings

🚦 3 Pipeline jobs failed

Testing the test | System Tests (java, dev) / End-to-end #1 / spring-boot 1     

🔧 Fix in code. This looks caused by changes in this PR.

Test run failed with AssertionError: Timed out waiting for EVP flagevaluation events.

🧪 11 Tests failed

tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Basic.test_ffe_evp_flagevaluation_basic[spring-boot] from system_tests_suite  

AssertionError: Timed out waiting for EVP flagevaluation event for flag evp-basic-flag
assert False
 +  where False = <bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator('agent')>(<function wait_for_evp_flagevaluation_event.<locals>.<lambda> at 0x7f75a3ebe980>, timeout=30)
 +    where <bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator('agent')> = AgentInterfaceValidator('agent').wait_for
 +      where AgentInterfaceValidator('agent') = interfaces.agent

self = <tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Basic object at 0x7f75f5c3e7b0>

    def test_ffe_evp_flagevaluation_basic(self) -> None:
        assert self.r.status_code == 200, f"Flag evaluation failed: {self.r.text}"
...

tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Burst_Aggregation.test_ffe_evp_flagevaluation_burst_aggregation[spring-boot] from system_tests_suite  

AssertionError: Timed out waiting for EVP flagevaluation event for flag evp-burst-aggregation-flag
assert False
 +  where False = <bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator('agent')>(<function wait_for_evp_flagevaluation_event.<locals>.<lambda> at 0x7f75b7211e40>, timeout=30)
 +    where <bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator('agent')> = AgentInterfaceValidator('agent').wait_for
 +      where AgentInterfaceValidator('agent') = interfaces.agent

self = <tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Burst_Aggregation object at 0x7f75f5c3dca0>

    def test_ffe_evp_flagevaluation_burst_aggregation(self) -> None:
        for index, response in enumerate(self.responses):
...

tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Context_Bounds.test_ffe_evp_flagevaluation_context_bounds[spring-boot] from system_tests_suite  

AssertionError: Timed out waiting for EVP flagevaluation event for flag evp-context-bounds-flag
assert False
 +  where False = <bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator('agent')>(<function wait_for_evp_flagevaluation_event.<locals>.<lambda> at 0x7f75a3ebf420>, timeout=30)
 +    where <bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator('agent')> = AgentInterfaceValidator('agent').wait_for
 +      where AgentInterfaceValidator('agent') = interfaces.agent

self = <tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Context_Bounds object at 0x7f75f5c3eba0>

    def test_ffe_evp_flagevaluation_context_bounds(self) -> None:
        assert self.r.status_code == 200, f"Flag evaluation failed: {self.r.text}"
...

View all failed tests

Testing the test | System Tests (java, prod) / End-to-end #1 / spring-boot 1     

🔧 Fix in code. This looks caused by changes in this PR.

11 failed tests due to timeout waiting for EVP flagevaluation events.

Testing the test | all-jobs-are-green     

See error

Job did not run: blocked by a failed job in an earlier pipeline stage.

📋 Copy prompt for your agent

CI on my pull request is failing. Help me find and fix the root cause of each failing job below — they were flagged as caused by changes in this PR, so focus on the diff. For each job, explain the failure and propose a fix.

Branch: leo.romanovsky/ffe-evp-flagevaluation-enable-java-clean

Testing the test | System Tests (java, dev) / End-to-end #1 / spring-boot 1
Commit: e018ca7af119a2244538ae0d34605bee0b309de8
Error (code / test):
10 tests failed with AssertionError: Timed out waiting for EVP flagevaluation events.
CI job: https://github.com/DataDog/system-tests/actions/runs/31531020969/job/93914163585

Testing the test | System Tests (java, prod) / End-to-end #1 / spring-boot 1
Commit: e018ca7af119a2244538ae0d34605bee0b309de8
Error (code / test):
11 failed tests due to timeout waiting for EVP flagevaluation events.
CI job: https://github.com/DataDog/system-tests/actions/runs/31531020969/job/93913987980

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 9be2744 | Docs | Datadog PR Page | Give us feedback!}

[datadog-system-tests-org]

⚠️ Warnings

🚦 2 Pipeline jobs failed

Testing the test | System Tests (java, dev) / End-to-end #1 / spring-boot 1     

Testing the test | all-jobs-are-green     

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 923dc46 | Docs | Give us feedback!}