Is there solution for viewing chunks distribution in ceph's pools with erasure code?
According to the picture from this page ceph splits objects on chunks and writes them on osds.
For viewing objects distribution with replication algorithm I can use commands like ceph pg dump or ceph osd map.
But I can't find commands to view data chunk distribution.
Solution
You can use the ceph-objectstore-tool to query offline OSDs and see which OSD contains which data chunk:
[ceph: root@pacific /]# ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1/ --op list
["11.2s2",{"oid":"file","key":"","snapid":-2,"hash":779072666,"max":0,"pool":11,"namespace":"","shard_id":2,"max":0}]
The first entry contains the shard ID: "11.2s2". So the PG is 11.2 and shard ID is 2. To query a cephadm deployed OSD you need to stop it via cephadm and then enter the container:
pacific:~ # cephadm unit stop --name osd.1
Inferring fsid 0a8034bc-15f4-11ec-8330-fa163eed040c
pacific:~ # cephadm shell --name osd.1
- Python: Understanding dictionary view objects
- Reorder dictionaries within a list
- Get all values from nested dictionaries in python
- Does OCaml have general map()/reduce() functions?
- How to gather a keyset from multiple maps from a stream that is filtered?
- Convert enhanced for loop with inner iterator to stream
- Struct field with multiple const types
- Destructuring-bind dictionary contents
- Comparing two dictionaries and checking how many (key, value) pairs are equal
- How to merge and sum of two dictionaries in Python?
- How to get an array of nested map value properties using the Java Stream API
- Python json.dumps() outputs all my data into one line but I want to have a new line for each entry
- How to save a dict into a slice?
- What's the difference between a ConcurrentDictionary and an ImmutableDictionary?
- Writing dictionary items in csv correct format
- How to increment a counter in a map and get the current count
- Java streams: transforming map's values
- ConcurrentDictionary.AddOrUpdate method in C# how efficient is it?
- How can I implement a dictionary in python that is persistent to disk in a way I can recover from a failure?
- while using openweather.org api using for temperature and weather it shows an keyerror
- python dict: get vs setdefault
- ConcurrentDictionary<TKey, TValue> - How to efficiently "get N elements, starting from key K"?
- I need to mimic a ConcurrentDictionary with a normal Dictionary in C#
- How to get nested dictionary key value with .get()
- How do I merge a list of dicts into a single dict?
- Reverse / invert a dictionary mapping
- Change the name of a key in dictionary
- Modify list and dictionary during iteration, why does it fail on dict?
- Reshape dictionary to make violin plot
- Iterating a api dictionary in ForEach