etcd: Max Storage Size Update

Question

Can anyone confirm whether the improvements mentioned How Does Alibaba Ensure the Performance of System Components in a 10,000-node Kubernetes Cluster? have actually been included in etcd 3.4.0?

Docs still say the recommended limit is 8GB. Article says the limit has been increased.

I see the question has been edited and downvoted. What was wrong with it? Should I delete the question? Was it the wording? — Rob, Feb 22 '21 at 09:50
You are requesting experience with a web article, which we all have. What is *exactly* your problem? — bjoster, Feb 25 '21 at 15:46

score 1 · Accepted Answer · answered Feb 25 '21 at 16:38

The mentioned alibabacloud article links to a CNCF blog post with regards to optimizations of the idle page management algorithm of etcd. The CNCF blog post mentions a pull request for the changes. That pull request has been merged in the mean time. So, yes, I assume that the improvements have been merged into etcd (bolt to be more precise).

The etcd dev guide states:

8GB is a suggested maximum size for normal environments

I would emphasise suggested and normal environments. I haven't found any resources on actual limits. So in my reading the suggested maximum size doesn't necessary mean that those improvements haven't been implemented. I assume it is recommend because it is enough for the average use case.

Thank you kindly. I am vetting options for a proof of concept, and etcd has a few interesting capabilities I’d like to use. It’s usually associated with Kubernetes, and probably most documentation is skewed towards its usecases. I felt I had to ask before venturing into a dead end. I’m also curious if a restart with a new storage limit configuration is enough to increase it should need be. — Rob, Feb 25 '21 at 21:16

etcd: Max Storage Size Update

1 Answers1