-
Notifications
You must be signed in to change notification settings - Fork 237
Comparing changes
Open a pull request
base repository: AutoMQ/automq
base: 1.3.2-rc0
head repository: AutoMQ/automq
compare: main
Commits on Nov 1, 2024
-
perf: limit the inflight requests (#2100)
* docs: add todos Signed-off-by: Ning Yu <ningyu@automq.com> * perf(network): limit the inflight requests by size Signed-off-by: Ning Yu <ningyu@automq.com> * perf(ReplicaManager): limit the queue size of the `fetchExecutor`s Signed-off-by: Ning Yu <ningyu@automq.com> * perf(KafkaApis): limit the queue size of async request handlers Signed-off-by: Ning Yu <ningyu@automq.com> * refactor(network): make "queued.max.requests.size.bytes" configurable Signed-off-by: Ning Yu <ningyu@automq.com> * style: fix lint Signed-off-by: Ning Yu <ningyu@automq.com> * fix(network): limit the min queued request size per queue Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for a7250cd - Browse repository at this point
Copy the full SHA a7250cdView commit details
Commits on Nov 3, 2024
-
fix(issue2108): avoid blocking at the end of a compaction iteration w…
…hen there are un-uploaded data (#2109) Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 412a99b - Browse repository at this point
Copy the full SHA 412a99bView commit details -
fix(s3stream): wait force upload complete before return (#2112)
Signed-off-by: Shichao Nie <niesc@automq.com> Co-authored-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 8338f18 - Browse repository at this point
Copy the full SHA 8338f18View commit details
Commits on Nov 5, 2024
-
fix(compaction): prevent double release on compaction shutdown (#2115)
Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 04b53f4 - Browse repository at this point
Copy the full SHA 04b53f4View commit details -
fix(s3stream): fix available bandwidth metrics (#2119)
Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 4f93b92 - Browse repository at this point
Copy the full SHA 4f93b92View commit details
Commits on Nov 6, 2024
-
fix(checkstyle): fix checkstyle (#2122)
Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 0443529 - Browse repository at this point
Copy the full SHA 0443529View commit details -
fix(e2e): remove unstable autobalancer tests (#2124)
Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for e53c837 - Browse repository at this point
Copy the full SHA e53c837View commit details -
Configuration menu - View commit details
-
Copy full SHA for 08ca9ec - Browse repository at this point
Copy the full SHA 08ca9ecView commit details
Commits on Nov 7, 2024
-
perf(log): avoid too many checkpoint at the same time (#2130)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 9c51a61 - Browse repository at this point
Copy the full SHA 9c51a61View commit details -
perf(tools/perf): assuming all partitions have the same offset at the…
… same time (#2127) (#2128) * feat(tools/perf): log progress on resetting offsets * fix: reset timeouts * feat: increase the log interval * perf(tools/perf): assuming all partitions have the same offset at the same time * feat: limit the min of --backlog-duration --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 42debe7 - Browse repository at this point
Copy the full SHA 42debe7View commit details -
refactor(tools/perf): retry sending messages in when waiting topics r…
…eady (#2133) Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 8f5fcc5 - Browse repository at this point
Copy the full SHA 8f5fcc5View commit details
Commits on Nov 8, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 73e8901 - Browse repository at this point
Copy the full SHA 73e8901View commit details -
feat(tools/perf): run benchmark without consumer (#2135)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for cbaf3a2 - Browse repository at this point
Copy the full SHA cbaf3a2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 90516c7 - Browse repository at this point
Copy the full SHA 90516c7View commit details -
Configuration menu - View commit details
-
Copy full SHA for a74cf69 - Browse repository at this point
Copy the full SHA a74cf69View commit details -
Configuration menu - View commit details
-
Copy full SHA for 351e1e0 - Browse repository at this point
Copy the full SHA 351e1e0View commit details
Commits on Nov 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for ab249e0 - Browse repository at this point
Copy the full SHA ab249e0View commit details -
chore(github): update code owners (#2155)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 5eea51d - Browse repository at this point
Copy the full SHA 5eea51dView commit details
Commits on Nov 14, 2024
-
feat(quota): support to update broker request rate quota (#2158)
* refactor(quota): refactor `maybeRecordAndGetThrottleTimeMs` Signed-off-by: Ning Yu <ningyu@automq.com> * fix(quota): throttle the produce request whatever the acks is Signed-off-by: Ning Yu <ningyu@automq.com> * refactor(quota): separate `Request` in `ClientQuotaManager` and `RequestRate` in `BrokerQuotaManager` Signed-off-by: Ning Yu <ningyu@automq.com> * sytle: fix lint Signed-off-by: Ning Yu <ningyu@automq.com> * feat(quota): support to update broker request rate quota Signed-off-by: Ning Yu <ningyu@automq.com> * test(quota): test update quota Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 54ea5d4 - Browse repository at this point
Copy the full SHA 54ea5d4View commit details -
feat(quota): support broker quota for slow fetch (#2160)
* feat(quota): introduce `SLOW_FETCH` broker quota Signed-off-by: Ning Yu <ningyu@automq.com> * feat(quota): add slow fetch quota Signed-off-by: Ning Yu <ningyu@automq.com> * test(quota): test broker slow fetch quota Signed-off-by: Ning Yu <ningyu@automq.com> * test(quota): test zero quota value Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 4597b74 - Browse repository at this point
Copy the full SHA 4597b74View commit details
Commits on Nov 15, 2024
-
feat(backpressure): back pressure by system load (#2161)
* feat(backpressure): init backpressure module Signed-off-by: Ning Yu <ningyu@automq.com> * feat(backpressure): implement `DefaultBackPressureManager` Signed-off-by: Ning Yu <ningyu@automq.com> * test(backpressure): test `DefaultBackPressureManager` Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for bcdd7e1 - Browse repository at this point
Copy the full SHA bcdd7e1View commit details -
refactor(backpressure): introduce interface
Checker
(#2162)Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 7d6c2c9 - Browse repository at this point
Copy the full SHA 7d6c2c9View commit details -
feat(quota): support to get current quota by type (#2163)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for e2f0e95 - Browse repository at this point
Copy the full SHA e2f0e95View commit details
Commits on Nov 20, 2024
-
feat(tools/perf): create topics in batch (#2166)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for ff3b68e - Browse repository at this point
Copy the full SHA ff3b68eView commit details -
chore(backpressure): log it on back pressure (#2164)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 3073399 - Browse repository at this point
Copy the full SHA 3073399View commit details -
feat(table): table topic aspect (#2167)
* feat(table): table topic aspect Signed-off-by: Robin Han <hanxvdovehx@gmail.com> * chore(table): fix PR review Signed-off-by: Robin Han <hanxvdovehx@gmail.com> * fix(table): fix unit test Signed-off-by: Robin Han <hanxvdovehx@gmail.com> --------- Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 2e3d94a - Browse repository at this point
Copy the full SHA 2e3d94aView commit details -
docs: Introducing AutoMQ Guru on Gurubase.io (#2159)
Introducing AutoMQ Guru on Gurubase.io Signed-off-by: Kursat Aktas <kursat.ce@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for ef1520a - Browse repository at this point
Copy the full SHA ef1520aView commit details
Commits on Nov 21, 2024
-
chore(workflow): add spotless check (#2168)
chore(workflow): spotless check Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 1e217ee - Browse repository at this point
Copy the full SHA 1e217eeView commit details
Commits on Nov 22, 2024
-
fix(stream): release
FetchResult
s if the subsequent fetch fails (#2172) * fix(stream): release `FetchResult`s if the subsequent fetch fails Signed-off-by: Ning Yu <ningyu@automq.com> * revert: "fix(stream): release `FetchResult`s if the subsequent fetch fails" This reverts commit 5836a6a. * refactor: add the `FetchResult` into the list in order rather than in reverse order Signed-off-by: Ning Yu <ningyu@automq.com> * fix: release `FetchResult`s if failed to fetch Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for e9bbf7a - Browse repository at this point
Copy the full SHA e9bbf7aView commit details -
chore(stream): move asyncsemaphore to util (#2173)
Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for d7b73f0 - Browse repository at this point
Copy the full SHA d7b73f0View commit details
Commits on Nov 25, 2024
-
feat(quota): support to get current quota metric value... (#2170)
* fix: fix logs Signed-off-by: Ning Yu <ningyu@automq.com> * feat(quota): support to get current quota metric value Signed-off-by: Ning Yu <ningyu@automq.com> * refactor(backpressure): remove `Regulator#minimize` Signed-off-by: Ning Yu <ningyu@automq.com> * perf(quota): increase the max of broker quota throttle time Signed-off-by: Ning Yu <ningyu@automq.com> * perf(backpressure): decrease cooldown time Signed-off-by: Ning Yu <ningyu@automq.com> * perf(quota): increase the max of broker quota throttle time Signed-off-by: Ning Yu <ningyu@automq.com> * docs: update comments Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 89f2c6b - Browse repository at this point
Copy the full SHA 89f2c6bView commit details -
feat(quota): exclude internal client IDs from broker quota (#2179)
* feat(quota): exclude internal client IDs from broker quota Signed-off-by: Ning Yu <ningyu@automq.com> * feat(autobalancer): mark producers and consumers internal clients Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 018833e - Browse repository at this point
Copy the full SHA 018833eView commit details
Commits on Nov 26, 2024
-
fix(quota): limit the max throttle time (#2180)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for bfc0e61 - Browse repository at this point
Copy the full SHA bfc0e61View commit details -
fix(quota): check whether the client in white list before fetch (#2181)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 57d8e5f - Browse repository at this point
Copy the full SHA 57d8e5fView commit details -
chore(table): set table max.message.bytes to 20MiB (#2182)
Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 64b3865 - Browse repository at this point
Copy the full SHA 64b3865View commit details
Commits on Nov 28, 2024
-
fix: use the "adjusted"
maxSize
inElasticLogSegment#readAsync
(#……2184) Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for dab96d7 - Browse repository at this point
Copy the full SHA dab96d7View commit details -
fix: release
PooledMemoryRecords
if it's dropped in the fetch sessi……on (#2185) Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 2583617 - Browse repository at this point
Copy the full SHA 2583617View commit details -
feat(table): auto create table topic control topic (#2186)
Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for fba35b6 - Browse repository at this point
Copy the full SHA fba35b6View commit details
Commits on Nov 29, 2024
-
fix(issues2193): retry 2 times to cover most of BlockNotContinuousExc…
…eption (#2194) Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for d6641d7 - Browse repository at this point
Copy the full SHA d6641d7View commit details
Commits on Dec 2, 2024
-
feat(core): reuse unregistered node when requesting for next node id (#…
Configuration menu - View commit details
-
Copy full SHA for 6217fb1 - Browse repository at this point
Copy the full SHA 6217fb1View commit details -
chore(bin): increase the gc log file count (#2202)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 504ce4e - Browse repository at this point
Copy the full SHA 504ce4eView commit details -
feat(backpressure): add metrics (#2198)
* feat(backpressure): log it on recovery from backpressure Signed-off-by: Ning Yu <ningyu@automq.com> * feat: add metric fetch_limiter_waiting_task_num Signed-off-by: Ning Yu <ningyu@automq.com> * feat: add metric fetch_limiter_timeout_count Signed-off-by: Ning Yu <ningyu@automq.com> * feat: add metric fetch_limiter_time Signed-off-by: Ning Yu <ningyu@automq.com> * feat: add metric back_pressure_state Signed-off-by: Ning Yu <ningyu@automq.com> * feat: add metric broker_quota_limit Signed-off-by: Ning Yu <ningyu@automq.com> * fix(backpressure): run checkers with fixed delay Signed-off-by: Ning Yu <ningyu@automq.com> * style: fix lint Signed-off-by: Ning Yu <ningyu@automq.com> * perf: drop too large values Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: record -1 for other states Signed-off-by: Ning Yu <ningyu@automq.com> * test: fix tests Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for b470ba4 - Browse repository at this point
Copy the full SHA b470ba4View commit details
Commits on Dec 3, 2024
-
feat(backpressure): support dynamic configs (#2204)
* feat(backpressure): make back pressure manager configurable Signed-off-by: Ning Yu <ningyu@automq.com> * test: test diabled Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: move backpressure from s3stream to kafka.core Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: init `BackPressureManager` in `BrokerServer` Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: introduce `BackPressureConfig` Signed-off-by: Ning Yu <ningyu@automq.com> * feat: make `BackPressureManager` reconfigurable Signed-off-by: Ning Yu <ningyu@automq.com> * test: test reconfigurable Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: rename config key Signed-off-by: Ning Yu <ningyu@automq.com> * refactor: move metric "back_pressure_state" from s3stream to core Signed-off-by: Ning Yu <ningyu@automq.com> --------- Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 52eb245 - Browse repository at this point
Copy the full SHA 52eb245View commit details -
fix(core): write next node id into image (#2206)
Signed-off-by: Shichao Nie <niesc@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 46c0e76 - Browse repository at this point
Copy the full SHA 46c0e76View commit details -
feat(backpressure): stop and remove all scheduled tasks on shutdown (#…
…2207) Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 1cdce66 - Browse repository at this point
Copy the full SHA 1cdce66View commit details -
fix(backpressure): start before registering to dynamic configs (#2208)
Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for eab1c07 - Browse repository at this point
Copy the full SHA eab1c07View commit details -
fix(backpressure): fix metric value of back pressure state (#2209)
fix: fix metric value of back pressure state Signed-off-by: Ning Yu <ningyu@automq.com>
Configuration menu - View commit details
-
Copy full SHA for 89ccf10 - Browse repository at this point
Copy the full SHA 89ccf10View commit details -
feat(config): add table topic conversion type configuration (#2203)
* feat(config): add table topic conversion type configurations * feat(config): rename table topic type to schema type and update related configurations * feat(config): add table topic schema registry URL configuration and validation * test(config): add unit tests for ControllerConfigurationValidator table topic schema configuration * fix(tests): update exception type in ControllerConfigurationValidatorTableTest for schema validation * feat(config): polish code
Configuration menu - View commit details
-
Copy full SHA for af4dd1f - Browse repository at this point
Copy the full SHA af4dd1fView commit details
Commits on Dec 5, 2024
-
chore(gradle): update aws version to 2.29.26 (#2210)
Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for e95f608 - Browse repository at this point
Copy the full SHA e95f608View commit details -
fix(docker): fix docker compose quick start (#2213)
Signed-off-by: Robin Han <hanxvdovehx@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 35522a8 - Browse repository at this point
Copy the full SHA 35522a8View commit details
There are no files selected for viewing