Veracity Coldstore OverviewBy Ethan Ace, Published on Jun 20, 2012
What if you could reduce your costs for buying storage, powering that storage while eliminating RAID rebuild concerns? That's the basic pitch of Veracity's "Coldstore" offering - a different approach to video surveillance focus than the JBOD or RAID options typically used. But how much does it truly save and what are the potential downsides of using it? In this note, we dig into the Coldstore to answer these questions.
Veracity's Coldstore [link no longer available] is a network storage system specifically tailored to video surveillance, with the following key features:
- 15-bay, 4U rack-mount chassis, dual Gigabit Ethernet uplinks, dual redundant power supplies optional.
- Supports up to 3TB drives, 45TB total.
- 320Mbit/sec throughput handling.
- Power consumption as low as 45W.
Street pricing on Coldstore averages to about $9,000-10,000 USD, depending on configuration, not including drives. Drives are avilable from Veracity, as well, for $175-220 (2TB/3TB), or may be purchased separately. Fully loaded with 3TB disks (an additional $3,300), a 45TB Coldstore has a street price between $12,000-13,000, or an average of about $275 per terabyte.
Differences from Conventional Storage Systems
Typically, RAID storage are used in surveillance systems with higher camera counts or longer retention periods. RAID (in most cases) splits data up across multiple disks, simultaneously writing to all disks in the array. This allows the array to be rebuilt in case of one (or more, depending on RAID level) disk failure.
Coldstore works fundamentally differently, writing data across disks one at a time, in chronological order, using a proprietary file system called SFS (Sequential File System). Using SFS, drives are spun up from idle one at a time until filled, at which point the next drive is filled and previous is powered down unless video must be retrieved from it. When all drives are full, Coldstore begins overwriting the first drive and repeats the process. During writes, the risk of failure is greatest, so Coldstore mirrors data to two drives at a time to provide redundancy while the array is most likely to fail. Thus, in a 15-bay chassis, 14 drives at one time will contain archive video, with one sequentially being used for redundancy during writing.
Because of the unique way it handles data, Coldstore requires custom integration with the VMS. This list is currently limited, with many of the major VMSs absent. Current integrations include: Genetec, Video Insight, Instek Digital, SoleraTec, Digital Barriers (formerly Codestuff), Synectics, HD Witness, Pixel Velocity, and Trinity VSE. Others are in progress, but with no public timelines.
Up Front Costs
Coldstore may potentially be significantly less costly than some forms of network storage. Typically, in surveillance systems, users choose between NAS or SAN storage, depending on capacity and performance levels required. Coldstore's street pricing of ~$275 per terabyte is moderately lower than brand name NAS models, such as the Iomega StorCenter px12-350r [link no longer available] ($11,500 online, ~$320/TB). Versus enterprise-level models, such as Dell or EMC, Coldstore becomes even more competitive. Models such as the Dell NX3100 sell online for over $15,000 when fully loaded with 3TB drives, or about $434 per terabyte.
Lower Operational Costs
Since only two disks are in use at a time, Veracity claims the entire array may use as little as 45W while in use. Typical storage arrays range from 100-200W for smaller NAS devices to 500W or more for SANs. If Coldstore provides the energy savings claimed, users may save 450W per hour or more (versus a SAN), this may save $300 per year or more, depending on electricity rates.
No Rebuild Concerns
With drive sizes increasing in recent years, the time and risk involved in rebuilding a RAID array upon disk failure have increased. Rebuilding large arrays with 1-2TB drives may take many hours, during which write performance is decreased, and the risk of drive failure increases, which may cause the entire array to fail. Since failures in Coldstore are most likely to be during writes, when data is mirrored, no rebuild takes place. The array marks the disk as bad, and may be hotswapped, and writes move to the next available drive.
Because of its unique file system, there are potential disadvantes to using Coldstore, as well.
- Video retrieval delays: Since drives must be spun up when video is retrieved, there may be an up to 20-second delay before playback begins. (Update: User reports a 48 second delay). There are ways to avoid this delay by keeping disks powered-up, but this negates the potential energy-saving benefits of Coldstore.
- Lack of VMS integrations: Given the relatively short list of VMS integrations, a user's chosen platform may not support Coldstore. Performing this integration work could add time and expense to the installation, if the VMS provider is even willing to perform the integration.
- Multiple retention periods: Due to the way data is written sequentially across disks, configuring cameras with differing retention periods requires that multiple Coldstore chassis be used.
- Frame pruning not possible: When using Coldstore, VMSs that use frame pruning or other methods of reducing the size of archived video based on age are not possible. Coldstore can prune this video, but will not fill in data in the pruned areas, essentially wasting disk space.
- Not truly redundant: Unlike RAID systems where data is written across a set of drives, if a Coldstore drive not currently being written to is lost, data may not be recovered in normal mode. However, the unit may be run in mirrored pair mode (similar to RAID 1), which retains a mirror of each drive as it is written, but this doubles the cost of storage, since capacity of the array is cut in half.
- Chassis size: Coldstore is not available in varying chassis sizes, meaning it is typically suitable only for those systems where higher camera counts and longer storage retention periods are required. Smaller systems will likely not benefit from the longer retention period, nor afford its price tag, instead favoring less expensive NAS storage units.
We recently had an excellent discussion of Coldstore with both users and Veracity in our LinkedIn group [link no longer available]. Users seeking further explanation of Coldstore's features and performance, or who wish to ask direct questions, may see this discussion for more detail.