CloudShield: Real-time Anomaly Detection in the Cloud

He, Zecheng; Hu, Guangyuan; Lee, Ruby B.

doi:10.1145/3577923.3583639

Proceedings of the Thirteenth ACM Conference on Data and Application Security and Privacy 2023

DOI: 10.1145/3577923.3583639

|View full text |Cite

CloudShield: Real-time Anomaly Detection in the Cloud

Zecheng He

Guangyuan Hu

Ruby B. Lee

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Signature-based Adaptive Cloud Resource Usage Prediction Using Machine Learning and Anomaly Detection

Sus,

Nawrocki

2024

J Grid Computing

View full text Add to dashboard Cite

One of the challenges in managing cloud computing clusters is assigning resources based on the customers’ needs. For this mechanism to work efficiently, it is imperative that there are sufficient resources reserved to maintain continuous operation, but not too much to avoid overhead costs. Additionally, to avoid the overhead of acquisition time, it is important to reserve resources sufficiently in advance. This paper presents a novel reliable general-purpose mechanism for prediction-based resource usage reservation. The proposed solution should be capable of operating for long periods of time without drift-related problems, and dynamically adapt to changes in system usage. To achieve this, a novel signature-based ensemble prediction method is presented, which utilizes multiple distinct prediction algorithms suited for various use-cases, as well as an anomaly detection mechanism used to improve prediction accuracy. This ensures that the mechanism can operate efficiently in different real-life scenarios. Thanks to a novel signature-based selection algorithm, it is possible to use the best available prediction algorithm for each use-case, even over long periods of time, which would typically lead to drifts. The proposed approach has been evaluated using real-life historical data from various production servers, which include traces from more than 1,500 machines collected over more than a year. Experimental results have demonstrated an increase in prediction accuracy of up to 21.4 percent over the neural network approach. The evaluation of the proposed approach highlights the importance of choosing the appropriate prediction method, especially in diverse scenarios where the load changes frequently.

show abstract

Signature-based Adaptive Cloud Resource Usage Prediction Using Machine Learning and Anomaly Detection

Sus,

Nawrocki

2024

J Grid Computing

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

hi@scite.ai

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

CloudShield: Real-time Anomaly Detection in the Cloud

Cited by 1 publication

References 16 publications

Signature-based Adaptive Cloud Resource Usage Prediction Using Machine Learning and Anomaly Detection

Signature-based Adaptive Cloud Resource Usage Prediction Using Machine Learning and Anomaly Detection

Contact Info

Product

Resources

About