Side by side
Apache Hadoop HDFS vs HPCC Systems
Both stand on data lake software. Which one you can start free with, which one lets you read the code, and what each costs once you pay.
Free plan Open source APILinuxSelf-hosted+1
HDFS is built for distributed, high-throughput storage with replication and several access interfaces. Its write model and security requirements should fit the workload and deployment plan.
Visit Apache Hadoop HDFS
Free plan Open source APIExtensionLinux+4
HPCC Systems combines parallel data processing, data-lake management, and a broad set of deployment, security, and integration capabilities. It is free under Apache 2.0, but deployment is self-hosted and a Linux system is required for a single-node cluster.
Visit HPCC SystemsThe facts
| Apache Hadoop HDFS | HPCC Systems | |
|---|---|---|
| Free plan | Yes | Yes |
| Open source | Yes | Yes |
| Runs on | API, Linux, Self-hosted, Windows | API, Extension, Linux, Mac, Self-hosted, Web, Windows |
| Lowest paid plan | Free or on request | Free or on request |
| Plans published | 2 | 3 |
| Maker | Not published | Not published |
| Website | hadoop.apache.org | hpccsystems.com |
| On data lake software | #1 of 19 | #2 of 19 |
Apache Hadoop HDFS: what it does well
- Designed to scale across hundreds of nodes.
- Replicates blocks and detects failed DataNodes.
- Supports Java, REST, browser, and NFS access.
- Transparent encryption is supported.
- Connectors are listed for major cloud storage services.
What to know first
- Not tuned for low-latency interactive workloads.
- Arbitrary in-place file updates are unavailable.
- Clusters without Kerberos caller authentication expose access to network users.
- Production deployment requires attention to cluster security.
HPCC Systems: what it does well
- Apache 2.0 licensed and free to use.
- Clusters can scale beyond a thousand nodes.
- Supports Azure Kubernetes Service and Amazon EKS.
- Includes ECL-accessible machine-learning algorithms.
- Offers XML, HTTP, SOAP, and REST query interfaces.
What to know first
- The platform is self-hosted.
- A supported Linux system is required for a single-node cluster.
- ECL IDE is available for Windows.
- Apple OSX has client tools only.
Alternatives to Apache Hadoop HDFS Alternatives to HPCC Systems The whole list