Hitachi Content Platform​

 View Only

 Is there any problem put small data(xKBs) in HCP S series?

  • Object Storage
  • Hitachi Content Platform HCP
sanghoon lee's profile image
sanghoon lee posted 01-17-2019 04:58

Hi-guys. I'm sanGhoon S-Korea.

I have Questions about configuration HCP S series.

HCP S series protect data Thourh EC(Erasure Coding).

In HCP S series, HCP divide data into 64MB Chunks called extent, and store.

I think the EC is effective in storing large number of large files.(Because of Chunk Size.)

So, Is there any problem saving a large amount of small files in HCP S series?

For example, Billions of KBs of files... (of factory machine log data, Image data, etc..)

 

I wonder if there is a problem because of the chunk size of the HCP S series.

 

If you have any knowledge or experience in this matter, I would appreciate it.


#HitachiContentPlatformHCP
Christie Nguyen's profile image
Christie Nguyen

Hi sanGhoon,

My understanding is - even though the EC chunk size is 64MB, the write size is in 4KB blocks. HCP would not allocate another chunk until the whole 64MB is consumed. So it is still space efficient for small files.