空中客车公司Defence And Space Launches a Petascale Archive for Satellite Data With StorNext Scale-out Storage

Archiving Petabytes of Satellite Data

欧洲航天局(ESA)在该计划开始的几年内,为每个Sentinel任务发起了两个卫星,欧安科将在轨道上有四个哨兵卫星。每颗卫星流每年超过1pb,长达15年。保留所有这些数据都需要一个新的存档。“我们不仅存档了原始,0级,仪器数据,还通过ESA的有效载荷数据接地段处理,该数据接地段,它产生1级和2级产品,”空中客车防御和空间的技术设计权威“。“为所有这些数据提供长期存档,我们需要一个可以扩展到几十张Petabytes的存储解决方案。”

Managing Millions of Files, Leveraging the Economics of Tape

“When there are four satellites in orbit, we’ll need to archive 40,000 files per day,” says Curtis. “We needed a robust file system to support tens of millions of files.” And it needed to support a wide variety of sizes and types.

“Controlling costs is critical since we need to store tens of petabytes of data for the Sentinel missions,” says Curtis. “Tape is very economical: Each tape cartridge can store a huge amount of data inexpensively, and tape libraries require less power and cooling than higher speed storage systems.” And tape is well suited for applications where large volumes of data are streamed.

使用StorNext构建可伸缩的多层归档

空中客车团队选择了一个多层Stornext解决方案,包括StorNext Ael6000磁带档案,元数据设备和磁盘缓存 - 所有由StorNext提供支持。由于以前在InfoTerra的Quantum在InfoTerra的经验中选择了Stordext,这是谷歌地球的图像的供应商,现在是空中客车防御和空间的一部分。

Curtis说:“Quantum一直在倾听我们的要求,改进他们的解决方案。”。“在StorNext的案例中,Quantum吸收了我们和其他组织的投入,这有助于生产出更强大的存储解决方案。”

存档最初支持18PB的数据,但可以扩展到37PB。“StorNext使我们能够轻松地扩展我们的档案,”Curtis解释道,“这样我们就可以支持新的卫星任务,并在未来收集更多的数据。”

Enabling Continuous High-speed Data Ingest and Access

“我们的当前配置支持1.1GB / S的性能与StorNext文件系统,”Curtis说。“结果,我们可以迅速摄取我们收到的所有原始和处理的数据,并在必要时快速检索它。”在大多数情况下,空中客车团队可以从分钟内从存档中检索各个文件,光纤通道连接意味着大型传输也会快速传递。该系统支持全系列的操作系统,包括Linux和Windows。

Safeguarding Data While Keeping Staff Levels Low

The system’s extended data life management (EDLM) features help safeguard data. “The policy-based EDLM features of the StorNext tape archive help proactively maintain the integrity of data on the tapes over the long term,” explains Curtis. “If a problem develops with a tape, StorNext automatically migrates data to better tape, without our administrators having to lift a finger. EDLM provides a huge advantage.”

“Administration costs with StorNext are quite low,” says Curtis. “With the Quantum solution, two of us can easily manage this growing petascale archive of satellite data.”

Gaining Flexibility for Unexpected Data Growth

StorNext also helps meet changing requirements. A newly planned relay satellite system, for example, is expected to increase storage needs beyond original estimates. “Fortunately, StorNext enables us to easily scale our environment. We can add new archive systems—and move toLTO-7型- 在没有重大大修的情况下满足这些新的数据收集要求,“柯蒂斯说。

“As ESA launches the next series of Sentinel satellites, storage requirements could change again,” says Curtis. “With the StorNext solution, we’re prepared.”