Skip to content

[CORE-12853] update java kafka client for e2e verifier #26897

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

IoannisRP
Copy link
Contributor

@IoannisRP IoannisRP commented Jul 18, 2025

What the title says.

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v25.2.x
  • v25.1.x
  • v24.3.x
  • v24.2.x

Release Notes

  • none

@IoannisRP
Copy link
Contributor Author

/ci-repeat 1
skip-units
dt-repeat=50
tests/rptest/tests/simple_e2e_test.py::SimpleEndToEndTest.test_consumer_interruption

@vbotbuildovich
Copy link
Collaborator

vbotbuildovich commented Jul 18, 2025

CI test results

test results on build#69283
test_class test_method test_arguments test_kind job_url test_status passed reason
SimpleEndToEndTest test_consumer_interruption ducktape https://buildkite.com/redpanda/redpanda/builds/69283#01981e95-4c17-4b22-893a-b6276dbd7add FLAKY 61/70 upstream reliability is '100.0'. current run reliability is '65.38461538461539'. drift is 34.61538 and the allowed drift is set to 50. The test should PASS
SimpleEndToEndTest test_consumer_interruption ducktape https://buildkite.com/redpanda/redpanda/builds/69283#01981e97-209f-4fde-ad5d-63487669b1ad FLAKY 68/70 upstream reliability is '100.0'. current run reliability is '90.9090909090909'. drift is 9.09091 and the allowed drift is set to 50. The test should PASS
test results on build#69328
test_class test_method test_arguments test_kind job_url test_status passed reason
ConsumerGroupTest test_group_lag_metrics ducktape https://buildkite.com/redpanda/redpanda/builds/69328#01982c9c-59b6-4283-aeca-d0d6915b8b45 FLAKY 20/21 upstream reliability is '99.08256880733946'. current run reliability is '95.23809523809523'. drift is 3.84447 and the allowed drift is set to 50. The test should PASS
TestReadReplicaService test_identical_lwms_after_delete_records {"cloud_storage_type": 1, "partition_count": 5} ducktape https://buildkite.com/redpanda/redpanda/builds/69328#01982c9c-59ba-4fd1-8191-f2b462e173a3 FLAKY 7/21 upstream reliability is '100.0'. current run reliability is '33.33333333333333'. drift is 66.66667 and the allowed drift is set to 50. The test should FAIL
TestReadReplicaService test_identical_lwms_after_delete_records {"cloud_storage_type": 1, "partition_count": 5} ducktape https://buildkite.com/redpanda/redpanda/builds/69328#01982ca1-f48b-4664-872e-a5b92a38d531 FLAKY 9/21 upstream reliability is '100.0'. current run reliability is '42.857142857142854'. drift is 57.14286 and the allowed drift is set to 50. The test should FAIL
test results on build#69540
test_class test_method test_arguments test_kind job_url test_status passed reason
JavaCompressionTest test_upgrade_java_compression {"compression_type": "gzip"} integration https://buildkite.com/redpanda/redpanda/builds/69540#01983827-5209-4a68-9878-8388fb5d86ce FAIL 0/21 The test has failed across all retries
JavaCompressionTest test_upgrade_java_compression {"compression_type": "gzip"} integration https://buildkite.com/redpanda/redpanda/builds/69540#0198382d-cd45-4a23-847b-9d1fc3962e79 FAIL 0/21 The test has failed across all retries
JavaCompressionTest test_upgrade_java_compression {"compression_type": "lz4"} integration https://buildkite.com/redpanda/redpanda/builds/69540#01983827-520a-47d0-a516-3aab785b4067 FAIL 0/21 The test has failed across all retries
JavaCompressionTest test_upgrade_java_compression {"compression_type": "lz4"} integration https://buildkite.com/redpanda/redpanda/builds/69540#0198382d-cd46-4000-9623-03f2897e2258 FAIL 0/21 The test has failed across all retries
JavaCompressionTest test_upgrade_java_compression {"compression_type": "snappy"} integration https://buildkite.com/redpanda/redpanda/builds/69540#01983827-520b-439b-a6a7-385f080e2bdc FAIL 0/21 The test has failed across all retries
JavaCompressionTest test_upgrade_java_compression {"compression_type": "snappy"} integration https://buildkite.com/redpanda/redpanda/builds/69540#0198382d-cd47-4df8-b710-94a14d827c67 FAIL 0/21 The test has failed across all retries
JavaCompressionTest test_upgrade_java_compression {"compression_type": "zstd"} integration https://buildkite.com/redpanda/redpanda/builds/69540#01983827-520d-42d4-818b-da1a70975cf0 FAIL 0/21 The test has failed across all retries
JavaCompressionTest test_upgrade_java_compression {"compression_type": "zstd"} integration https://buildkite.com/redpanda/redpanda/builds/69540#0198382d-cd48-4070-80a3-e7d978236b87 FAIL 0/21 The test has failed across all retries
NodeDecommissionSpaceManagementTest test_decommission {"single_partition": true} integration https://buildkite.com/redpanda/redpanda/builds/69540#01983827-520b-439b-a6a7-385f080e2bdc FLAKY 20/21 upstream reliability is '99.40119760479041'. current run reliability is '95.23809523809523'. drift is 4.1631 and the allowed drift is set to 50. The test should PASS

@IoannisRP IoannisRP force-pushed the CORE-12853/java/e2e-verifiers-update branch from 48768c9 to 9b8e1d7 Compare July 18, 2025 21:06
@IoannisRP
Copy link
Contributor Author

/ci-repeat 1
skip-units
dt-repeat=50
tests/rptest/tests/simple_e2e_test.py::SimpleEndToEndTest.test_consumer_interruption

@IoannisRP IoannisRP self-assigned this Jul 18, 2025
@IoannisRP
Copy link
Contributor Author

/ci-repeat 1
skip-units
dt-repeat=50
tests/rptest/tests/simple_e2e_test.py::SimpleEndToEndTest.test_consumer_interruption

2 similar comments
@IoannisRP
Copy link
Contributor Author

/ci-repeat 1
skip-units
dt-repeat=50
tests/rptest/tests/simple_e2e_test.py::SimpleEndToEndTest.test_consumer_interruption

@IoannisRP
Copy link
Contributor Author

/ci-repeat 1
skip-units
dt-repeat=50
tests/rptest/tests/simple_e2e_test.py::SimpleEndToEndTest.test_consumer_interruption

@IoannisRP
Copy link
Contributor Author

/ci-repeat 1

@vbotbuildovich
Copy link
Collaborator

vbotbuildovich commented Jul 21, 2025

Retry command for Build#69328

please wait until all jobs are finished before running the slash command

/ci-repeat 1
tests/rptest/tests/read_replica_e2e_test.py::TestReadReplicaService.test_identical_lwms_after_delete_records@{"cloud_storage_type":1,"partition_count":5}

@IoannisRP IoannisRP force-pushed the CORE-12853/java/e2e-verifiers-update branch from 9b8e1d7 to 1a96026 Compare July 23, 2025 16:18
@IoannisRP IoannisRP marked this pull request as ready for review July 23, 2025 16:19
@IoannisRP IoannisRP requested review from BenPope and a team July 23, 2025 16:19
@IoannisRP IoannisRP changed the title [DRAFT] [CORE-12853] update java kafka client for e2e verifier [CORE-12853] update java kafka client for e2e verifier Jul 23, 2025
@vbotbuildovich
Copy link
Collaborator

vbotbuildovich commented Jul 23, 2025

Retry command for Build#69540

please wait until all jobs are finished before running the slash command

/ci-repeat 1
tests/rptest/tests/compatibility/java_compression_test.py::JavaCompressionTest.test_upgrade_java_compression@{"compression_type":"zstd"}
tests/rptest/tests/compatibility/java_compression_test.py::JavaCompressionTest.test_upgrade_java_compression@{"compression_type":"gzip"}
tests/rptest/tests/compatibility/java_compression_test.py::JavaCompressionTest.test_upgrade_java_compression@{"compression_type":"snappy"}
tests/rptest/tests/compatibility/java_compression_test.py::JavaCompressionTest.test_upgrade_java_compression@{"compression_type":"lz4"}

Copy link
Member

@dotnwat dotnwat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should it be 4.0 ?

@IoannisRP
Copy link
Contributor Author

@dotnwat this is to unblock @BenPope on the topic ids work. It was meant to be 3.9.0, but even that introduces some flakiness in some tests, so it needs some investigation as to why.

3.0.0 seems stable and does unblock Ben, so it is a good compromise till i figure out what is happening.

Upgrading the java clients to 4.0.0 is something we will address separately.

@IoannisRP IoannisRP enabled auto-merge July 24, 2025 12:53
Copy link
Member

@BenPope BenPope left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@IoannisRP IoannisRP merged commit 5e0b6d5 into redpanda-data:dev Jul 24, 2025
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants