The lightweight nature of Operating System virtualization give birth to the containers, and their high efficiency for application deployment prefers its usage in Cloud computing. Containers encapsulate and bundle the required dependencies for application development and deployment in libs packages as a single entity. The nature of containers eases application migration within the High-Performance Computing environment to handle the scientific workloads smoothly. Singularity containers are aimed to be only for High-Performance Computing (HPC) applications. The existing HPC workload managers are good with container monitoring, scheduling, and resource management, but container orchestration is always a concern. This study proposes a framework that will ease container orchestration using Kubernetes to handle the scientific applications workload. HPC cluster is built using interconnected containers in a private cloud environment. The architecture is derived based on the required configuration for containers to deploy the application and scheduling jobs.