-
Notifications
You must be signed in to change notification settings - Fork 237
Comparing changes
Open a pull request
base repository: AutoMQ/automq
base: 1.3.2-rc0
head repository: AutoMQ/automq
compare: main
Commits on Nov 1, 2024
-
perf: limit the inflight requests (#2100)
* docs: add todos Signed-off-by: Ning Yu <ningyu@automq.com> * perf(network): limit the inflight requests by size Signed-off-by: Ning Yu <ningyu@automq.com> * perf(ReplicaManager): limit the queue size of the `fetchExecutor`s Signed-off-by: Ning Yu <ningyu@automq.com> * perf(KafkaApis): limit the queue size of async request handlers Signed-off-by: Ning Yu <ningyu@automq.com> * refactor(network): make "queued.max.requests.size.bytes" configurable Signed-off-by: Ning Yu <ningyu@automq.com> * style: fix lint Signed-off-by: Ning Yu <ningyu@automq.com> * fix(network): limit the min queued request size per queue Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for a7250cd - Browse repository at this point
Copy the full SHA a7250cdView commit details
Commits on Nov 3, 2024
-
fix(issue2108): avoid blocking at the end of a compaction iteration w…
…hen there are un-uploaded data (#2109) Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 412a99b - Browse repository at this point
Copy the full SHA 412a99bView commit details -
fix(s3stream): wait force upload complete before return (#2112)
Signed-off-by: Shichao Nie <niesc@automq.com> Co-authored-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 8338f18 - Browse repository at this point
Copy the full SHA 8338f18View commit details
Commits on Nov 5, 2024
-
fix(compaction): prevent double release on compaction shutdown (#2115)
Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 04b53f4 - Browse repository at this point
Copy the full SHA 04b53f4View commit details -
fix(s3stream): fix available bandwidth metrics (#2119)
Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 4f93b92 - Browse repository at this point
Copy the full SHA 4f93b92View commit details
Commits on Nov 6, 2024
-
fix(checkstyle): fix checkstyle (#2122)
Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 0443529 - Browse repository at this point
Copy the full SHA 0443529View commit details -
fix(e2e): remove unstable autobalancer tests (#2124)
Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for e53c837 - Browse repository at this point
Copy the full SHA e53c837View commit details -
Configuration menu - View commit details
-
Copy full SHA for 08ca9ec - Browse repository at this point
Copy the full SHA 08ca9ecView commit details
Commits on Nov 7, 2024
-
perf(log): avoid too many checkpoint at the same time (#2130)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 9c51a61 - Browse repository at this point
Copy the full SHA 9c51a61View commit details -
perf(tools/perf): assuming all partitions have the same offset at the…
… same time (#2127) (#2128) * feat(tools/perf): log progress on resetting offsets * fix: reset timeouts * feat: increase the log interval * perf(tools/perf): assuming all partitions have the same offset at the same time * feat: limit the min of --backlog-duration --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 42debe7 - Browse repository at this point
Copy the full SHA 42debe7View commit details -
refactor(tools/perf): retry sending messages in when waiting topics r…
…eady (#2133) Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 8f5fcc5 - Browse repository at this point
Copy the full SHA 8f5fcc5View commit details
Commits on Nov 8, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 73e8901 - Browse repository at this point
Copy the full SHA 73e8901View commit details -
feat(tools/perf): run benchmark without consumer (#2135)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for cbaf3a2 - Browse repository at this point
Copy the full SHA cbaf3a2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 90516c7 - Browse repository at this point
Copy the full SHA 90516c7View commit details -
Configuration menu - View commit details
-
Copy full SHA for a74cf69 - Browse repository at this point
Copy the full SHA a74cf69View commit details -
Configuration menu - View commit details
-
Copy full SHA for 351e1e0 - Browse repository at this point
Copy the full SHA 351e1e0View commit details
Commits on Nov 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for ab249e0 - Browse repository at this point
Copy the full SHA ab249e0View commit details -
chore(github): update code owners (#2155)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 5eea51d - Browse repository at this point
Copy the full SHA 5eea51dView commit details
Commits on Nov 14, 2024
-
feat(quota): support to update broker request rate quota (#2158)
* refactor(quota): refactor `maybeRecordAndGetThrottleTimeMs` Signed-off-by: Ning Yu <ningyu@automq.com> * fix(quota): throttle the produce request whatever the acks is Signed-off-by: Ning Yu <ningyu@automq.com> * refactor(quota): separate `Request` in `ClientQuotaManager` and `RequestRate` in `BrokerQuotaManager` Signed-off-by: Ning Yu <ningyu@automq.com> * sytle: fix lint Signed-off-by: Ning Yu <ningyu@automq.com> * feat(quota): support to update broker request rate quota Signed-off-by: Ning Yu <ningyu@automq.com> * test(quota): test update quota Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 54ea5d4 - Browse repository at this point
Copy the full SHA 54ea5d4View commit details -
feat(quota): support broker quota for slow fetch (#2160)
* feat(quota): introduce `SLOW_FETCH` broker quota Signed-off-by: Ning Yu <ningyu@automq.com> * feat(quota): add slow fetch quota Signed-off-by: Ning Yu <ningyu@automq.com> * test(quota): test broker slow fetch quota Signed-off-by: Ning Yu <ningyu@automq.com> * test(quota): test zero quota value Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 4597b74 - Browse repository at this point
Copy the full SHA 4597b74View commit details
Commits on Nov 15, 2024
-
feat(backpressure): back pressure by system load (#2161)
* feat(backpressure): init backpressure module Signed-off-by: Ning Yu <ningyu@automq.com> * feat(backpressure): implement `DefaultBackPressureManager` Signed-off-by: Ning Yu <ningyu@automq.com> * test(backpressure): test `DefaultBackPressureManager` Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for bcdd7e1 - Browse repository at this point
Copy the full SHA bcdd7e1View commit details -
refactor(backpressure): introduce interface
Checker
(#2162)Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 7d6c2c9 - Browse repository at this point
Copy the full SHA 7d6c2c9View commit details -
feat(quota): support to get current quota by type (#2163)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for e2f0e95 - Browse repository at this point
Copy the full SHA e2f0e95View commit details
Commits on Nov 20, 2024
-
feat(tools/perf): create topics in batch (#2166)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for ff3b68e - Browse repository at this point
Copy the full SHA ff3b68eView commit details -
chore(backpressure): log it on back pressure (#2164)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 3073399 - Browse repository at this point
Copy the full SHA 3073399View commit details -
feat(table): table topic aspect (#2167)
* feat(table): table topic aspect Signed-off-by: Robin Han <hanxvdovehx@gmail.com> * chore(table): fix PR review Signed-off-by: Robin Han <hanxvdovehx@gmail.com> * fix(table): fix unit test Signed-off-by: Robin Han <hanxvdovehx@gmail.com> --------- Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 2e3d94a - Browse repository at this point
Copy the full SHA 2e3d94aView commit details -
docs: Introducing AutoMQ Guru on Gurubase.io (#2159)
Introducing AutoMQ Guru on Gurubase.io Signed-off-by: Kursat Aktas <kursat.ce@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for ef1520a - Browse repository at this point
Copy the full SHA ef1520aView commit details
Commits on Nov 21, 2024
-
chore(workflow): add spotless check (#2168)
chore(workflow): spotless check Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 1e217ee - Browse repository at this point
Copy the full SHA 1e217eeView commit details
Commits on Nov 22, 2024
-
fix(stream): release
FetchResult
s if the subsequent fetch fails (#2172) * fix(stream): release `FetchResult`s if the subsequent fetch fails Signed-off-by: Ning Yu <ningyu@automq.com> * revert: "fix(stream): release `FetchResult`s if the subsequent fetch fails" This reverts commit 5836a6a. * refactor: add the `FetchResult` into the list in order rather than in reverse order Signed-off-by: Ning Yu <ningyu@automq.com> * fix: release `FetchResult`s if failed to fetch Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for e9bbf7a - Browse repository at this point
Copy the full SHA e9bbf7aView commit details -
chore(stream): move asyncsemaphore to util (#2173)
Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for d7b73f0 - Browse repository at this point
Copy the full SHA d7b73f0View commit details
Commits on Nov 25, 2024
-
feat(quota): support to get current quota metric value... (#2170)
* fix: fix logs Signed-off-by: Ning Yu <ningyu@automq.com> * feat(quota): support to get current quota metric value Signed-off-by: Ning Yu <ningyu@automq.com> * refactor(backpressure): remove `Regulator#minimize` Signed-off-by: Ning Yu <ningyu@automq.com> * perf(quota): increase the max of broker quota throttle time Signed-off-by: Ning Yu <ningyu@automq.com> * perf(backpressure): decrease cooldown time Signed-off-by: Ning Yu <ningyu@automq.com> * perf(quota): increase the max of broker quota throttle time Signed-off-by: Ning Yu <ningyu@automq.com> * docs: update comments Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 89f2c6b - Browse repository at this point
Copy the full SHA 89f2c6bView commit details -
feat(quota): exclude internal client IDs from broker quota (#2179)
* feat(quota): exclude internal client IDs from broker quota Signed-off-by: Ning Yu <ningyu@automq.com> * feat(autobalancer): mark producers and consumers internal clients Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 018833e - Browse repository at this point
Copy the full SHA 018833eView commit details
Commits on Nov 26, 2024
-
fix(quota): limit the max throttle time (#2180)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for bfc0e61 - Browse repository at this point
Copy the full SHA bfc0e61View commit details -
fix(quota): check whether the client in white list before fetch (#2181)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 57d8e5f - Browse repository at this point
Copy the full SHA 57d8e5fView commit details -
chore(table): set table max.message.bytes to 20MiB (#2182)
Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 64b3865 - Browse repository at this point
Copy the full SHA 64b3865View commit details
Commits on Nov 28, 2024
-
fix: use the "adjusted"
maxSize
inElasticLogSegment#readAsync
(#……2184) Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for dab96d7 - Browse repository at this point
Copy the full SHA dab96d7View commit details -
fix: release
PooledMemoryRecords
if it's dropped in the fetch sessi……on (#2185) Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 2583617 - Browse repository at this point
Copy the full SHA 2583617View commit details -
feat(table): auto create table topic control topic (#2186)
Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for fba35b6 - Browse repository at this point
Copy the full SHA fba35b6View commit details
Commits on Nov 29, 2024
-
fix(issues2193): retry 2 times to cover most of BlockNotContinuousExc…
…eption (#2194) Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for d6641d7 - Browse repository at this point
Copy the full SHA d6641d7View commit details
Commits on Dec 2, 2024
-
feat(core): reuse unregistered node when requesting for next node id (#…
Configuration menu - View commit details
-
Copy full SHA for 6217fb1 - Browse repository at this point
Copy the full SHA 6217fb1View commit details -
chore(bin): increase the gc log file count (#2202)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 504ce4e - Browse repository at this point
Copy the full SHA 504ce4eView commit details -
feat(backpressure): add metrics (#2198)
* feat(backpressure): log it on recovery from backpressure Signed-off-by: Ning Yu <ningyu@automq.com> * feat: add metric fetch_limiter_waiting_task_num Signed-off-by: Ning Yu <ningyu@automq.com> * feat: add metric fetch_limiter_timeout_count Signed-off-by: Ning Yu <ningyu@automq.com> * feat: add metric fetch_limiter_time Signed-off-by: Ning Yu <ningyu@automq.com> * feat: add metric back_pressure_state Signed-off-by: Ning Yu <ningyu@automq.com> * feat: add metric broker_quota_limit Signed-off-by: Ning Yu <ningyu@automq.com> * fix(backpressure): run checkers with fixed delay Signed-off-by: Ning Yu <ningyu@automq.com> * style: fix lint Signed-off-by: Ning Yu <ningyu@automq.com> * perf: drop too large values Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: record -1 for other states Signed-off-by: Ning Yu <ningyu@automq.com> * test: fix tests Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for b470ba4 - Browse repository at this point
Copy the full SHA b470ba4View commit details
Commits on Dec 3, 2024
-
feat(backpressure): support dynamic configs (#2204)
* feat(backpressure): make back pressure manager configurable Signed-off-by: Ning Yu <ningyu@automq.com> * test: test diabled Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: move backpressure from s3stream to kafka.core Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: init `BackPressureManager` in `BrokerServer` Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: introduce `BackPressureConfig` Signed-off-by: Ning Yu <ningyu@automq.com> * feat: make `BackPressureManager` reconfigurable Signed-off-by: Ning Yu <ningyu@automq.com> * test: test reconfigurable Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: rename config key Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: move metric "back_pressure_state" from s3stream to core Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 52eb245 - Browse repository at this point
Copy the full SHA 52eb245View commit details -
fix(core): write next node id into image (#2206)
Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 46c0e76 - Browse repository at this point
Copy the full SHA 46c0e76View commit details -
feat(backpressure): stop and remove all scheduled tasks on shutdown (#…
…2207) Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 1cdce66 - Browse repository at this point
Copy the full SHA 1cdce66View commit details -
fix(backpressure): start before registering to dynamic configs (#2208)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for eab1c07 - Browse repository at this point
Copy the full SHA eab1c07View commit details -
fix(backpressure): fix metric value of back pressure state (#2209)
fix: fix metric value of back pressure state Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 89ccf10 - Browse repository at this point
Copy the full SHA 89ccf10View commit details -
feat(config): add table topic conversion type configuration (#2203)
* feat(config): add table topic conversion type configurations * feat(config): rename table topic type to schema type and update related configurations * feat(config): add table topic schema registry URL configuration and validation * test(config): add unit tests for ControllerConfigurationValidator table topic schema configuration * fix(tests): update exception type in ControllerConfigurationValidatorTableTest for schema validation * feat(config): polish code
Configuration menu - View commit details
-
Copy full SHA for af4dd1f - Browse repository at this point
Copy the full SHA af4dd1fView commit details
Commits on Dec 5, 2024
-
chore(gradle): update aws version to 2.29.26 (#2210)
Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for e95f608 - Browse repository at this point
Copy the full SHA e95f608View commit details -
fix(docker): fix docker compose quick start (#2213)
Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 35522a8 - Browse repository at this point
Copy the full SHA 35522a8View commit details
This comparison is taking too long to generate.
Unfortunately it looks like we can’t render this comparison for you right now. It might be too big, or there might be something weird with your repository.
You can try running this command locally to see the comparison on your machine:
git diff 1.3.2-rc0...main