Vigiles: Fine-Grained Access Control for MapReduce Systems

Abstract

Abstract-Security concerns surrounding the rise of Big Data systems have stimulated myriad new Big Data security models and implementations over the past few years. A significant disadvantage shared by most of these implementations is that they customize the underlying system source code to enforce new policies, making the customizations difficult to maintain as these layers evolve over time (e.g., over version updates).This paper demonstrates how a broad class of safety policies, including fine-grained access control policies at the level of keyvalue data pairs rather than files, can be elegantly enforced on MapReduce clouds with minimal overhead and without any change to the system or OS implementations. The approach realizes policy enforcement as a middleware layer that rewrites the cloud's front-end API with reference monitors. After rewriting, the jobs run on input data authorized by fine-grained access control policies, allowing them to be safely executed without additional system-level controls. Detailed empirical studies show that this more modular approach exhibits just 1% overhead compared to a less modular implementation that customizes MapReduce directly to enforce the same policies.

Security and privacy aspects in MapReduce on clouds: A survey

“…Apache Accumulo is built on top of Apache Hadoop, Zookeeper, and Thrift. [3] M 8 Apache Sentry [4] S Apache Ranger [4] M Project Rhino [5] S Apache Accumulo [6] S Airavat [92] S Khaled et al [57] Vigiles [109] GuardMR [107] G-Hadoop [135] SecDM [97] M iBigTable [119] Lin et al [64] S 9 10 SAPSC [96] M ClusterBFT [99] S, H 11 Moca et al [76] SecureMR [118] S AccountableMR [123] S VIAF [115] S CCMR [116] M IntegrityMR [117] M VAWS [39] S Hatman [58] S 12 TrustMR [108] S TS-TRV [38] S Log-based [125] S Watermarking based [53,37] S Accountable MapReduce (RBAC) [110] S Airavat. Airavat [92] is a system that provides mandatory access control together with differential privacy for data protection.…”

Honeypot based unauthorized data access detection in MapReduce systems

“…In [6], [7], it has been proposed to create dynamic authorized data views via the enforcement of filter functions on the individual records of the input files. The filter functions can support a broad class of security checks on the records, ranging from blacklisting to advanced pattern matching.…”

“…In [6], the data flow of MapReduce is transparently interposed during the preprocessing step, and specified functions are applied to the newly formed key-values to filter out the unauthorized pairs. The interposition is carried out via aspect oriented programming (AOP) without changing the source code.…”

Survey on Access Control Mechanisms in Cloud Computing

“…This became the reason for the system policies to be more understandable. Another advantage of FGAC is that the users have the right to arrange their own policies and determine who can reach their own information [70,[75][76][77][78][79][80][81]. Until FGAC was introduced, many access control mechanisms were using an all-or-nothing approach.…”