What do we mean by metadata partitions in terms of distributed storage services? -
i read term lot in case of distributed storage systems ex: this paper
metadata relatively of small size compared data, , summary information of data. in system, there many pieces of data, , there many pieces of metadata, because each piece of data has own metadata.in gfs(google file system), metadata stored in master node, in way, query efficient, there may problem of single failure , master may bottleneck of system. address these problems, people propose splitting metadata , store them in several nodes, means, instead of storing metadata in single node, may split metadata , store them several nodes. example, suppose there 4 pieces of metadata in system, namely m1, m2, m3 , m4. in gfs, these 4 pieces of metadata stored in master node, while metadata partition, can store m1, m2 in node a, , store m3, m4 in node b, overlap allowed, , overlapped purpose of high availability.
hope helps!
Comments
Post a Comment