--- title: "Optimizing Cloud Scalability: Implementing Horizontal Pod Autoscalers with Kubernetes" description: How can a company tackle scalability issues in their cloud environment? In this blog Maurits Beudeker shares how he takes on questions like these. image: https://www.cloudnation.nl/hubfs/jackman-chiu-36Vbwo1OiZU-unsplash.jpg --- English [ Nederlands](https://www.cloudnation.nl/inspiratie/blogs/optimaliseren-van-cloud-schaalbaarheid-implementatie-van-horizontal-pod-autoscalers-met-kubernetes) an IG&H company [![_CN_Monogram_Color_White_rgb](https://www.cloudnation.nl/hubfs/_CN_Monogram_Color_White_rgb.png "Back to home") ![preview__CN_Logo_Left_Color_Black_rgb](https://www.cloudnation.nl/hubfs/preview__CN_Logo_Left_Color_Black_rgb.png "Back to home") ](https://www.cloudnation.nl/en/) Services Migrate [ Cloud Migration Realize a seamless transition to the cloud ](https://www.cloudnation.nl/en/services/cloud-migration) [ Cloud Readiness Assessment Before you start your journey on the cloud. ](https://www.cloudnation.nl/en/services/cloud-readiness-assessment) [ Cloud Landing Zone Accelerator The start of a cloud journey. ](https://www.cloudnation.nl/en/services/cloud-landing-zone-accelerator) [ Advice & Strategy Use the knowhow of our best experts. ](https://www.cloudnation.nl/en/services/strategy) [ Application Modernization Modernize, simplify and transform applications. ](https://www.cloudnation.nl/en/services/applicationmodernization) Improve & Modernize [ Cloud Security & Compliance Security & compliance ](https://www.cloudnation.nl/en/services/cloud-security/old) [ Cloud Competence Center Accelerate development. ](https://www.cloudnation.nl/en/cloud-center-of-excellence-cloudnation) [ FinOps Turn cloud spend into business value ](https://www.cloudnation.nl/en/cloudnation-finops) Integrate [ Hybrid cloud Combine the best of private and public cloud. ](https://www.cloudnation.nl/en/services/hybrid-cloud) [ Network & connectivity Use the cloud optimally and create value. ](https://www.cloudnation.nl/en/services/networking-connectivity) [ Managed Cloud Services ](https://www.cloudnation.nl/en/services/managed-cloud-services) [ Managed Kubernetes Services ](https://www.cloudnation.nl/en/en/services/managed-kubernetes-services) Data & AI [ AI Solutions Harness the power of artificial intelligence ](https://www.cloudnation.nl/en/artificial-intelligence) [ Data Landing Zone A secure and scalable foundation for your data operations. ](https://www.cloudnation.nl/en/services/data-landing-zone) [ Agent Lake The governed foundation for enterprise AI agents ](https://www.cloudnation.nl/en/agent-lake) [![aws-grey](https://www.cloudnation.nl/hubfs/aws-grey.svg) ](https://aws.amazon.com/free/?trk=3c7428a8-c52c-45ed-8072-8e2ba8bf9225&sc_channel=ps&ef_id=Cj0KCQjwwvilBhCFARIsADvYi7InrIXPaSi0tr77kUKV_-nyhN-NviOxvxIBVTUFilC3rM2czBruU-gaAuXlEALw_wcB:G:s&s_kwcid=AL!4422!3!649687334390!e!!g!!aws!19738730142!145148221566&all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc&awsf.Free%20Tier%20Types=*all&awsf.Free%20Tier%20Categories=*all) [![azure-grey](https://www.cloudnation.nl/hubfs/azure-grey.svg) ](https://azure.microsoft.com/en-us/free/search/?ef_id=_k_Cj0KCQjwwvilBhCFARIsADvYi7IzQ1lpK0myTZJUEGM4La7kZrvaGTatFZ5ommalhQTlkevfIc4qPNsaAl4FEALw_wcB_k_&OCID=AIDcmmy4pl1olr_SEM__k_Cj0KCQjwwvilBhCFARIsADvYi7IzQ1lpK0myTZJUEGM4La7kZrvaGTatFZ5ommalhQTlkevfIc4qPNsaAl4FEALw_wcB_k_&gclid=Cj0KCQjwwvilBhCFARIsADvYi7IzQ1lpK0myTZJUEGM4La7kZrvaGTatFZ5ommalhQTlkevfIc4qPNsaAl4FEALw_wcB) [![google-cloud-grey](https://www.cloudnation.nl/hubfs/google-cloud-grey.svg) ](https://cloud.google.com/gcp/?hl=nl&utm_source=google&utm_medium=cpc&utm_campaign=emea-nl-all-nl-bkws-all-all-trial-e-gcp-1011340&utm_content=text-ad-none-any-DEV_c-CRE_495030366170-ADGP_Hybrid+%7C+BKWS+-+EXA+%7C+Txt+~+GCP+~+General%23v3-KWID_43700060393215884-kwd-6458750523-userloc_9064924&utm_term=KW_google%20cloud-NET_g-PLAC_&&gad=1&gclid=Cj0KCQjwwvilBhCFARIsADvYi7Kh3LYZSTLyTiCJcfyw5z0iKjKdP0z6hgphICBbRRXr230tD1FvZiIaAh7OEALw_wcB&gclsrc=aw.ds) [![oracle-ci-grey](https://www.cloudnation.nl/hubfs/oracle-ci-grey.svg) ](https://www.oracle.com/) [ Services overview ](https://www.cloudnation.nl/en/services) [ Success stories ](https://www.cloudnation.nl/en/success-stories) Industries Our **cloud-native specialists** have deep** knowhow** and relevant **experience** in various industries [ Branches overview ](https://www.cloudnation.nl/en/industries) [ FinTech Accelerate FinTech innovations ](https://www.cloudnation.nl/en/industries/finance-fintech) [ ISV Remain future proof and transform your applications through the cloud ](https://www.cloudnation.nl/en/industries/isv) [ Manufacturing Improve operational efficiency, security and scalability of your processes. ](https://www.cloudnation.nl/en/industries/production-industry) [ Digital Natives Unlock new possibilities with cloud solutions designed for the digital pioneer. ](https://www.cloudnation.nl/en/branches/digital-natives) [ Inspiration ](https://www.cloudnation.nl/en/inspiration) About Us [ About CloudNation ](https://www.cloudnation.nl/en/about-us) [ Careers ](https://www.cloudnation.nl/en/careers) [ Our partners ](https://www.cloudnation.nl/en/partners) [ CloudNation Academy ](https://www.cloudnation.nl/en/cloud-academy) [ Contact ](https://www.cloudnation.nl/en/contact) [Plan a call ](https://www.cloudnation.nl/en/schedule-a-meeting) [![_CN_Monogram_Color_White_rgb](https://www.cloudnation.nl/hubfs/_CN_Monogram_Color_White_rgb.png "Back to home") ![preview__CN_Logo_Left_Color_Black_rgb](https://www.cloudnation.nl/hubfs/preview__CN_Logo_Left_Color_Black_rgb.png "Back to home") ](https://www.cloudnation.nl/en/) Services Migrate [ Cloud Migration Realize a seamless transition to the cloud ](https://www.cloudnation.nl/en/services/cloud-migration) [ Cloud Readiness Assessment Before you start your journey on the cloud. ](https://www.cloudnation.nl/en/services/cloud-readiness-assessment) [ Cloud Landing Zone Accelerator The start of a cloud journey. ](https://www.cloudnation.nl/en/services/cloud-landing-zone-accelerator) [ Advice & Strategy Use the knowhow of our best experts. ](https://www.cloudnation.nl/en/services/strategy) [ Application Modernization Modernize, simplify and transform applications. ](https://www.cloudnation.nl/en/services/applicationmodernization) Improve & Modernize [ Cloud Security & Compliance Security & compliance ](https://www.cloudnation.nl/en/services/cloud-security/old) [ Cloud Competence Center Accelerate development. ](https://www.cloudnation.nl/en/cloud-center-of-excellence-cloudnation) [ FinOps Turn cloud spend into business value ](https://www.cloudnation.nl/en/cloudnation-finops) Integrate [ Hybrid cloud Combine the best of private and public cloud. ](https://www.cloudnation.nl/en/services/hybrid-cloud) [ Network & connectivity Use the cloud optimally and create value. ](https://www.cloudnation.nl/en/services/networking-connectivity) [ Managed Cloud Services ](https://www.cloudnation.nl/en/services/managed-cloud-services) [ Managed Kubernetes Services ](https://www.cloudnation.nl/en/en/services/managed-kubernetes-services) Data & AI [ AI Solutions Harness the power of artificial intelligence ](https://www.cloudnation.nl/en/artificial-intelligence) [ Data Landing Zone A secure and scalable foundation for your data operations. ](https://www.cloudnation.nl/en/services/data-landing-zone) [ Agent Lake The governed foundation for enterprise AI agents ](https://www.cloudnation.nl/en/agent-lake) [![aws-grey](https://www.cloudnation.nl/hubfs/aws-grey.svg) ](https://aws.amazon.com/free/?trk=3c7428a8-c52c-45ed-8072-8e2ba8bf9225&sc_channel=ps&ef_id=Cj0KCQjwwvilBhCFARIsADvYi7InrIXPaSi0tr77kUKV_-nyhN-NviOxvxIBVTUFilC3rM2czBruU-gaAuXlEALw_wcB:G:s&s_kwcid=AL!4422!3!649687334390!e!!g!!aws!19738730142!145148221566&all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc&awsf.Free%20Tier%20Types=*all&awsf.Free%20Tier%20Categories=*all) [![azure-grey](https://www.cloudnation.nl/hubfs/azure-grey.svg) ](https://azure.microsoft.com/en-us/free/search/?ef_id=_k_Cj0KCQjwwvilBhCFARIsADvYi7IzQ1lpK0myTZJUEGM4La7kZrvaGTatFZ5ommalhQTlkevfIc4qPNsaAl4FEALw_wcB_k_&OCID=AIDcmmy4pl1olr_SEM__k_Cj0KCQjwwvilBhCFARIsADvYi7IzQ1lpK0myTZJUEGM4La7kZrvaGTatFZ5ommalhQTlkevfIc4qPNsaAl4FEALw_wcB_k_&gclid=Cj0KCQjwwvilBhCFARIsADvYi7IzQ1lpK0myTZJUEGM4La7kZrvaGTatFZ5ommalhQTlkevfIc4qPNsaAl4FEALw_wcB) [![google-cloud-grey](https://www.cloudnation.nl/hubfs/google-cloud-grey.svg) ](https://cloud.google.com/gcp/?hl=nl&utm_source=google&utm_medium=cpc&utm_campaign=emea-nl-all-nl-bkws-all-all-trial-e-gcp-1011340&utm_content=text-ad-none-any-DEV_c-CRE_495030366170-ADGP_Hybrid+%7C+BKWS+-+EXA+%7C+Txt+~+GCP+~+General%23v3-KWID_43700060393215884-kwd-6458750523-userloc_9064924&utm_term=KW_google%20cloud-NET_g-PLAC_&&gad=1&gclid=Cj0KCQjwwvilBhCFARIsADvYi7Kh3LYZSTLyTiCJcfyw5z0iKjKdP0z6hgphICBbRRXr230tD1FvZiIaAh7OEALw_wcB&gclsrc=aw.ds) [![oracle-ci-grey](https://www.cloudnation.nl/hubfs/oracle-ci-grey.svg) ](https://www.oracle.com/) [ Services overview ](https://www.cloudnation.nl/en/services) [ Success stories ](https://www.cloudnation.nl/en/success-stories) Industries Our **cloud-native specialists** have deep** knowhow** and relevant **experience** in various industries [ Branches overview ](https://www.cloudnation.nl/en/industries) [ FinTech Accelerate FinTech innovations ](https://www.cloudnation.nl/en/industries/finance-fintech) [ ISV Remain future proof and transform your applications through the cloud ](https://www.cloudnation.nl/en/industries/isv) [ Manufacturing Improve operational efficiency, security and scalability of your processes. ](https://www.cloudnation.nl/en/industries/production-industry) [ Digital Natives Unlock new possibilities with cloud solutions designed for the digital pioneer. ](https://www.cloudnation.nl/en/branches/digital-natives) [ Inspiration ](https://www.cloudnation.nl/en/inspiration) About Us [ About CloudNation ](https://www.cloudnation.nl/en/about-us) [ Careers ](https://www.cloudnation.nl/en/careers) [ Our partners ](https://www.cloudnation.nl/en/partners) [ CloudNation Academy ](https://www.cloudnation.nl/en/cloud-academy) [ Contact ](https://www.cloudnation.nl/en/contact) [Plan a call ](https://www.cloudnation.nl/en/schedule-a-meeting) [![_CN_Monogram_Color_White_rgb](https://www.cloudnation.nl/hubfs/_CN_Monogram_Color_White_rgb.png "Back to home") ![preview__CN_Logo_Left_Color_Black_rgb](https://www.cloudnation.nl/hubfs/preview__CN_Logo_Left_Color_Black_rgb.png "Back to home") ](https://www.cloudnation.nl/en/) [ Let's talk ](https://www.cloudnation.nl/en/schedule-a-meeting) Menu [![_CN_Monogram_Color_White_rgb](https://www.cloudnation.nl/hubfs/_CN_Monogram_Color_White_rgb.png "Back to home") ![preview__CN_Logo_Left_Color_Black_rgb](https://www.cloudnation.nl/hubfs/preview__CN_Logo_Left_Color_Black_rgb.png "Back to home") ](https://www.cloudnation.nl/en/) [ Let's talk ](https://www.cloudnation.nl/en/schedule-a-meeting) Menu Services Migrate [ Cloud Migration ](https://www.cloudnation.nl/en/services/cloud-migration) [ Cloud Readiness Assessment ](https://www.cloudnation.nl/en/services/cloud-readiness-assessment) [ Cloud Landing Zone Accelerator ](https://www.cloudnation.nl/en/services/cloud-landing-zone-accelerator) [ Advice & Strategy ](https://www.cloudnation.nl/en/services/strategy) [ Application Modernization ](https://www.cloudnation.nl/en/services/applicationmodernization) Improve & Modernize [ Cloud Security & Compliance ](https://www.cloudnation.nl/en/services/cloud-security/old) [ Cloud Competence Center ](https://www.cloudnation.nl/en/cloud-center-of-excellence-cloudnation) [ FinOps ](https://www.cloudnation.nl/en/cloudnation-finops) Integrate [ Hybrid cloud ](https://www.cloudnation.nl/en/services/hybrid-cloud) [ Network & connectivity ](https://www.cloudnation.nl/en/services/networking-connectivity) [ Managed Cloud Services ](https://www.cloudnation.nl/en/services/managed-cloud-services) [ Managed Kubernetes Services ](https://www.cloudnation.nl/en/en/services/managed-kubernetes-services) Data & AI [ AI Solutions ](https://www.cloudnation.nl/en/artificial-intelligence) [ Data Landing Zone ](https://www.cloudnation.nl/en/services/data-landing-zone) [ Agent Lake ](https://www.cloudnation.nl/en/agent-lake) [Services overview ](https://www.cloudnation.nl/en/services) [ Success stories ](https://www.cloudnation.nl/en/success-stories) Industries [ FinTech ](https://www.cloudnation.nl/en/industries/finance-fintech) [ ISV ](https://www.cloudnation.nl/en/industries/isv) [ Manufacturing ](https://www.cloudnation.nl/en/industries/production-industry) [ Digital Natives ](https://www.cloudnation.nl/en/branches/digital-natives) [Branches overview ](https://www.cloudnation.nl/en/industries) [ Inspiration ](https://www.cloudnation.nl/en/inspiration) About Us [ About CloudNation ](https://www.cloudnation.nl/en/about-us) [ Careers ](https://www.cloudnation.nl/en/careers) [ Our partners ](https://www.cloudnation.nl/en/partners) [ CloudNation Academy ](https://www.cloudnation.nl/en/cloud-academy) [ Contact ](https://www.cloudnation.nl/en/contact) [Let's talk ](https://www.cloudnation.nl/en/schedule-a-meeting) [ nl](https://www.cloudnation.nl/inspiratie/blogs/optimaliseren-van-cloud-schaalbaarheid-implementatie-van-horizontal-pod-autoscalers-met-kubernetes) [Back ](https://www.cloudnation.nl/en/inspiration) # Optimizing Cloud Scalability: Implementing Horizontal Pod Autoscalers with Kubernetes ![](https://www.cloudnation.nl/hubfs/Maurits%20B%20-%20LR.jpeg) **Maurits Beudeker** Cloud consultant Publish date: 16 May 2024 ![](https://www.cloudnation.nl/hs-fs/hubfs/jackman-chiu-36Vbwo1OiZU-unsplash.jpg?width=1600) [mailto:info@example.com?&subject=&body=https://www.cloudnation.nl/en/inspiration/blogs/optimizing-cloud-scalability-implementing-horizontal-pod-autoscalers-with-kubernetes](mailto:info@example.com?&subject=&body=https://www.cloudnation.nl/en/inspiration/blogs/optimizing-cloud-scalability-implementing-horizontal-pod-autoscalers-with-kubernetes) **In a recent collaboration between CloudNation and one of its clients, a key issue was at the forefront: how can the client better manage scalability in their cloud environment? In this blog, Maurits Beudeker, a Cloud Consultant at CloudNation, shares how he stepped in to tackle this challenge and the lessons he learned from the experience.** ## The Challenge The client needed specific help with a problem: they occasionally received a large volume of messages all at once, which couldn’t be processed simultaneously. This caused delays within the application. To prevent this, they wanted to use Horizontal Pod Autoscalers in their Kubernetes cluster, which allows the number of workers to scale dynamically with a high number of requests. ## Why Horizontal Pod Autoscalers? An Analogy: Imagine you’re a supermarket manager who needs to unload 100 trucks every day to keep the warehouse stocked, but you don't know exactly when the trucks will arrive, and you only have 3 parking spots. If you don't know the exact arrival times of the trucks, would you pay 30 warehouse workers for the whole day? You risk having workers idle when there’s no work, and if nine trucks suddenly arrive at once, 30 workers might still be too few. Wouldn’t it be fantastic to have, on-demand, exactly the right number of workers based on the number of trucks waiting to be unloaded, who magically disappear when not needed (so you don’t have to pay 60 times the minimum wage)? Three things are needed for this: - Application Metrics (Application-specific statistics)  - In the analogy, this is someone noting how many trucks are currently waiting to park and be unloaded. - Prometheus (an application that collects and displays these statistics over time) - In the analogy, this is the person collecting and remembering when each measurement was taken. - Horizontal Pod Autoscalers (HPAs): Kubernetes objects that can scale the number of pods of an application based on its usage. - These are like micromanagers who determine, based on the collected data, how many warehouse workers are currently needed to unload the trucks as quickly as possible. Be aware that this system can be misused; if you don’t set a maximum number of workers/pods, a malicious person could cause infinite scaling, resulting in extremely high costs. Therefore, it's wise to set a maximum scale limit to avoid unforeseen expenses. ## From Request to Design Armed with solid background knowledge, the team headed to the client’s location. Once there, the project scope was quickly established, clearly defining the exact requirements and necessary steps. This resulted in a clear course of action. Moreover, collaborating with the client's colleagues was smooth and pleasant, enhancing the overall atmosphere. Intense work on the design was done throughout the day, aiming for rapid implementation. However, early on, the team encountered a dependency: standard Horizontal Pod Autoscalers (HPAs) could only scale based on CPU and memory usage, while the client specifically wanted to scale based on the application queue length. Since processing the queue was a separate process with limited impact on CPU usage, the standard parameters were insufficient. Thus, it was decided to scale based on the queue length. To achieve this, the application needed to provide metrics to the Kubernetes cluster so the HPAs could use them. This required adding the Prometheus Adapter to the Kubernetes cluster. With the design in an advanced stage, discussions were held with the client to determine the location of the Application Metrics, ensuring seamless integration of all necessary elements. However, the published metrics were not yet in a format interpretable by Prometheus. Fortunately, the product owner was on-site, allowing an immediate request to make the application metrics suitable for publication. ## From Design to Implementation: A Seamless Transition Upon returning on Thursday, it was found that the client's developers had made the necessary adjustments. This enabled the export and use of application-specific statistics to scale the workload. Nonetheless, it was challenging to finalize this process as it was not yet clear which statistics should be used for scaling the application. Ultimately, it was decided to scale based on the estimated remaining time. This meant that by scaling the number of worker pods, the number of processed messages would increase, and the remaining processing time would decrease. By the end of the day, the results could be evaluated: using Grafana, it was observed how the workload increased and the time to process messages decreased until the maximum number of worker pods was reached. In case of a long queue, Kubernetes would automatically scale the number of worker pods, increasing the number of processed messages per second and reducing the remaining time. ## Successful Implementation The result was impressive: the system functioned excellently, and it was gratifying to see the desired effect achieved within two days. Despite the challenges, there was satisfaction at the end of the process, knowing the client was pleased with the solution. For the team, it was also a fulfilling experience to successfully complete a complex task. #### Want to know more about scalability challenges of cloud environments?  Get in touch with cloud consultant Maurice to talk about your case.  [Get in touch ](https://www.cloudnation.nl/en/contact) ![Maurits B - LR](https://7979774.fs1.hubspotusercontent-na1.net/hubfs/7979774/Maurits%20B%20-%20LR.jpg) [mailto:info@example.com?&subject=&body=https://www.cloudnation.nl/en/inspiration/blogs/optimizing-cloud-scalability-implementing-horizontal-pod-autoscalers-with-kubernetes](mailto:info@example.com?&subject=&body=https://www.cloudnation.nl/en/inspiration/blogs/optimizing-cloud-scalability-implementing-horizontal-pod-autoscalers-with-kubernetes) ![](https://www.cloudnation.nl/hubfs/Maurits%20B%20-%20LR.jpeg) **Maurits Beudeker** Cloud consultant Publish date: 16 May 2024 ## More knowledge, how-tos and insights for inspiration [![](https://7979774.fs1.hubspotusercontent-na1.net/hubfs/7979774/Right%20Banner%20size%20%2853%29.png) ## The three biggest hidden cloud costs Lees verder ](https://www.cloudnation.nl/en/inspiration/blogs/the-three-biggest-hidden-cloud-costs) [![](https://7979774.fs1.hubspotusercontent-na1.net/hubfs/7979774/Right%20Banner%20size%20%2842%29.png) News ## IG&H acquires CloudNation from Atomic Group Lees verder ](https://www.cloudnation.nl/en/inspiration/blogs/igh-acquires-cloudnation-from-atomic-group) [![](https://7979774.fs1.hubspotusercontent-na1.net/hubfs/7979774/Right%20Banner%20size%20%2810%29-1.png) News Azure ## Microsoft Channel AI Market Maker Partner of the Year 2025! Lees verder ](https://www.cloudnation.nl/en/inspiration/blogs/microsoft-channel-ai-market-maker-partner-of-the-year-2025) Follow us: ##### Contact Kosterijland 10 3981 AJ Bunnik [![blue-chat-icon](https://www.cloudnation.nl/hubfs/Development%20assets/blue-chat-icon.svg)   Chat with us ](https://www.cloudnation.nl/en/inspiration/blogs/optimizing-cloud-scalability-implementing-horizontal-pod-autoscalers-with-kubernetes#hs-chat-open) [![blue-phone-call](https://www.cloudnation.nl/hubfs/Development%20assets/blue-phone-call.svg)   +31 (0)6 48 016 896 ](tel:0031648016896) [![blue-mail](https://www.cloudnation.nl/hubfs/Development%20assets/blue-mail.svg)   info@cloudnation.nl ](mailto:info@cloudnation.nl) ![iso 27001](https://www.cloudnation.nl/hubfs/iso%2027001.svg)  ![gdpr compliant](https://www.cloudnation.nl/hubfs/gdpr%20compliant.svg)   ![iso 27001](https://www.cloudnation.nl/hubfs/iso%2027001.svg)  ![gdpr compliant](https://www.cloudnation.nl/hubfs/gdpr%20compliant.svg)   ##### CloudNation [ About CloudNation ](https://www.cloudnation.nl/en/about-us) [ Careers ](https://www.cloudnation.nl/werken-bij) [ CloudNation Academy ](https://www.cloudnation.nl/en/cloud-academy) [ Contact ](https://www.cloudnation.nl/contact) ##### Partners [ All our partners ](https://www.cloudnation.nl/en/partners) [ AWS ](https://www.cloudnation.nl/en/partners/amazon-web-services#aws-partner) [ Azure ](https://www.cloudnation.nl/en/partners#microsoft-azure-partner) [ And lots more ](https://www.cloudnation.nl/en/partners) ##### Knowledge, howto's and insights of CloudNation in your mailbox